00000001:02000400:2.0F:1788813167.936294:0:2971:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg447-server.virtnet: executing set_hostid 00000001:02000400:2.0:1788813190.212188:0:3195:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg447-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1788813192.367324:0:3238:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 727 MB/s 00000001:01000000:3.0:1788813192.618255:0:3238:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 498 MB/s 00000001:01000000:2.0:1788813192.868026:0:3238:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5395 MB/s 00000020:02000000:2.0:1788813193.484512:0:3286:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_40_gea5fd3f 00000400:02000000:0.0F:1788813194.411157:0:3302:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.147@tcp [8/256/0/180] 00008000:02000000:2.0:1788813198.094163:0:3451:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788813249.678291:0:5256:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg447-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788813260.423218:0:5830:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788813260.423224:0:5830:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788813260.423360:0:5830:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000001f40b836 00000080:02000400:2.0:1788813260.423372:0:5830:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788813260.429849:0:5830:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788813260.429864:0:5830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788813260.429903:0:5830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000002172a37d) 00000020:00000080:2.0:1788813260.429923:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788813260.447776:0:5830:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788813260.448167:0:5830:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788813260.468776:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788813260.468816:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788813260.468838:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788813260.468888:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788813260.468914:0:5830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788813260.469358:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788813260.469366:0:5830:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788813260.469374:0:5830:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d74dbab2ddb1474 00000020:01000004:2.0:1788813260.469383:0:5830:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788813260.469387:0:5830:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788813260.469391:0:5830:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001f40b836 from MGS 00000020:01000004:2.0:1788813260.469396:0:5830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788813260.469405:0:5830:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000005383e1d1) 00000020:00000080:2.0:1788813260.469413:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788813260.469458:0:5830:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001f40b836 from MGS, refs=2 00080000:01000000:2.0:1788813260.469463:0:5830:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788813260.469466:0:5830:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d74dbab2ddb1482 00000100:00100000:2.0:1788813260.469715:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788813260.469857:0:5830:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788813260.469863:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788813260.470356:0:5830:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788813260.470362:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788813260.471479:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788813260.471711:0:5830:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788813260.471716:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788813260.472865:0:5830:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788813260.472874:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788813260.473852:0:5830:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788813260.473872:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0F:1788813260.474539:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813260.474549:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813260.474550:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813260.475120:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813260.475123:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813260.475125:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813260.476456:0:5830:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788813260.478965:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1788813260.725766:0:5830:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3531 MB/s 00000001:01000000:2.0:1788813260.975627:0:5830:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4307 MB/s 00000001:01000000:0.0:1788813261.225916:0:5830:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 511 MB/s 00000001:01000000:1.0:1788813261.476099:0:5830:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 627 MB/s 00010000:00010000:1.0:1788813261.500937:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788813261.517003:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1788813261.549547:0:5830:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788813261.549574:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788813261.549594:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788813261.552333:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788813261.552436:0:5830:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788813261.552509:0:5830:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788813261.552865:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788813261.552894:0:5830:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788813261.553344:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813261.553524:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788813261.553530:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788813261.560797:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788813261.560850:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788813261.561163:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788813261.561169:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788813261.569291:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788813261.569321:0:5830:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.147@tcp' 00000020:01000004:3.0:1788813261.569323:0:5830:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788813261.569365:0:5830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.147@tcp (typ=mgc) 00000020:00000080:3.0:1788813261.569393:0:5830:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.147@tcp (000000005be18b40) 00000020:00000080:3.0:1788813261.569426:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788813261.569607:0:5830:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000066f06e4@MGC192.168.204.147@tcp: add connection 192.168.204.147@tcp at head 00010000:00010000:3.0:1788813261.569785:0:5830:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.147@tcp-0 is initialized 00000040:01000000:3.0:1788813261.569792:0:5830:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.147@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788813261.570208:0:5845:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788813261.579967:0:5846:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788813261.580416:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.147@tcp (uuid cd1fd158-af17-4a1b-8f0b-82e57114d008) 00000020:00000080:3.0:1788813261.580440:0:5830:0:(genops.c:1384:class_connect()) connect: client cd1fd158-af17-4a1b-8f0b-82e57114d008, cookie 0x6d74dbab2ddb1490 00000100:00080000:3.0:1788813261.580453:0:5830:0:(import.c:545:import_select_connection()) MGC192.168.204.147@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788813261.580464:0:5830:0:(import.c:666:import_select_connection()) MGC192.168.204.147@tcp: import 00000000066f06e4 using connection 192.168.204.147@tcp/0@lo 00000100:00100000:3.0:1788813261.581047:0:5830:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000da101576 x1875706583711872/t0(0) o250->MGC192.168.204.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813261.581177:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000da101576 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cd1fd158-af17-4a1b-8f0b-82e57114d008:3317:1875706583711872:0@lo:250: 00000100:00100000:2.0:1788813261.581277:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813261.581341:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583711872 00000100:00100000:0.0:1788813261.581350:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583711872 00000100:00080000:3.0:1788813261.581351:0:5830:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import cd1fd158-af17-4a1b-8f0b-82e57114d008->MGS 00000020:01000004:3.0:1788813261.581377:0:5830:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788813261.581383:0:5830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000100:00100000:0.0:1788813261.581391:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000020:00000080:3.0:1788813261.581398:0:5830:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000002119318f) 00000100:00100000:0.0:1788813261.581409:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000031f6dc0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3317:x1875706583711872:12345-0@lo:250: 00000020:00000080:3.0:1788813261.581414:0:5830:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00010000:00080000:0.0:1788813261.581433:0:5841:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from cd1fd158-af17-4a1b-8f0b-82e57114d008@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:0.0:1788813261.581453:0:5841:0:(genops.c:1384:class_connect()) connect: client cd1fd158-af17-4a1b-8f0b-82e57114d008, cookie 0x6d74dbab2ddb149e 00000100:00080000:0.0:1788813261.581628:0:5841:0:(import.c:65:import_set_state_nolock()) 000000007bd30d10 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788813261.598222:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000031f6dc0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+5:3317:x1875706583711872:12345-0@lo:250: Request processed in 16804us (16936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813261.598238:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788813261.600835:0:3317:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.147@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788813261.600851:0:3317:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.147@tcp: connect to target with instance 0 00000100:00080000:2.0:1788813261.600859:0:3317:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.147@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788813261.600865:0:3317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788813261.600869:0:3317:0:(import.c:65:import_set_state_nolock()) 00000000066f06e4 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788813261.600873:0:3317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788813261.600882:0:3317:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788813261.600889:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000da101576 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cd1fd158-af17-4a1b-8f0b-82e57114d008:3317:1875706583711872:0@lo:250: 00000100:00100000:3.0:1788813261.604851:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813261.605094:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788813261.605100:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788813261.608995:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788813261.609012:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788813261.609784:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788813261.609793:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788813261.617786:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813261.617973:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788813261.617991:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788813261.621175:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788813261.621189:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788813261.702051:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788813261.702296:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788813261.702304:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788813261.719408:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788813261.719431:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788813261.723653:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788813261.723851:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788813261.723857:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788813261.727228:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788813261.727244:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788813261.732304:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788813261.732493:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788813261.732500:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788813261.735145:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788813261.735159:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788813261.736282:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788813261.736463:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788813261.736469:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788813261.750291:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788813261.750319:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788813261.819821:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813261.820053:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788813261.820059:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788813261.825507:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788813261.825524:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788813261.833066:0:5830:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788813261.833087:0:5830:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788813261.846820:0:5830:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788813261.846996:0:5830:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788813261.847004:0:5830:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.147@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788813261.847147:0:5830:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.147@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788813261.847189:0:5830:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.147@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788813261.847194:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788813261.847195:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788813261.847197:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813261.847198:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813261.847199:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813261.847204:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813261.847206:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788813261.847207:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788813261.847208:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788813261.847209:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788813261.847210:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813261.847211:0:5830:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788813261.847214:0:5830:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788813261.847216:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788813261.847217:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788813261.847218:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813261.847219:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813261.847220:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813261.847220:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813261.847221:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788813261.847222:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788813261.847223:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788813261.847224:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788813261.847224:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813261.847225:0:5830:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788813261.847267:0:5830:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788813261.847285:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000093431358 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583712000:0@lo:253: 00000100:00100000:3.0:1788813261.847367:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813261.848319:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 0000000051b287c6 going to sleep for 11 seconds 00000100:00100000:2.0:1788813261.852103:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583712000 00000100:00100000:2.0:1788813261.852125:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583712000 00000100:00100000:2.0:1788813261.852181:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813261.852191:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eb163ee7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+5:5830:x1875706583712000:12345-0@lo:253: 20000000:01000000:2.0:1788813261.852266:0:5844:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788813261.852269:0:5844:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788813261.853274:0:5865:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788813261.853358:0:5844:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788813261.853828:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788813261.855298:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788813261.855832:0:5844:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788813261.855836:0:5844:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788813261.855841:0:5844:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788813261.855844:0:5844:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788813261.856021:0:5844:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788813261.856252:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788813261.856508:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788813261.856520:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788813261.856570:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788813261.858324:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788813261.858377:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788813261.858506:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788813261.858515:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788813261.858636:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788813261.858649:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788813261.858682:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788813261.858688:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788813261.858715:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788813261.858777:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788813261.858810:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788813261.858815:0:5844:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788813261.858829:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788813261.859087:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788813261.859097:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788813261.859132:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788813261.859166:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788813261.859215:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788813261.859226:0:5844:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788813261.859303:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788813261.859311:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788813261.859348:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788813261.859382:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788813261.859415:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788813261.859425:0:5844:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788813261.859505:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788813261.859513:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788813261.859545:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788813261.859608:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788813261.859764:0:5844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788813261.859811:0:5844:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788813261.859818:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788813261.861048:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788813261.861383:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788813261.861412:0:5844:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.147@tcp for mdt 20000000:01000000:3.0:1788813261.861414:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.147@tcp (null) (null) (null) 00000040:00080000:3.0:1788813261.861450:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788813261.861458:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788813261.861490:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788813261.861498:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.147@tcp (null) (null) 00000040:00080000:3.0:1788813261.861543:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788813261.861552:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788813261.861616:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788813261.861673:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788813261.861736:0:5844:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788813261.861744:0:5844:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788813261.861748:0:5844:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788813261.861774:0:5844:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788813261.861776:0:5844:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788813261.861807:0:5844:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788813261.861809:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788813261.865913:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1788813261.866275:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788813261.866326:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1788813261.866403:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1788813261.866415:0:5844:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788813261.866418:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788813261.867139:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788813261.867381:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788813261.867422:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788813261.867457:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1788813261.867472:0:5844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788813261.867474:0:5844:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1788813261.867480:0:5844:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788813261.867482:0:5844:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788813261.867488:0:5844:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788813261.867494:0:5844:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788813261.868129:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788813261.868233:0:5844:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788813261.887307:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788813261.887366:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788813261.887444:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788813261.887465:0:5844:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788813261.887483:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000083f48d9/0x6d74dbab2ddb14a5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.887512:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000083f48d9/0x6d74dbab2ddb14a5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.887523:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000083f48d9/0x6d74dbab2ddb14a5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.887529:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000083f48d9/0x6d74dbab2ddb14a5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.887536:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000083f48d9/0x6d74dbab2ddb14a5 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.887542:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000083f48d9/0x6d74dbab2ddb14a5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.887564:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000083f48d9 already unused, calling callback (000000004bef8063) 00010000:00010000:3.0:1788813261.887568:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000083f48d9/0x6d74dbab2ddb14a5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.887576:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000083f48d9/0x6d74dbab2ddb14a5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.889847:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000083f48d9/0x6d74dbab2ddb14a5 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.890097:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000083f48d9/0x6d74dbab2ddb14a5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813261.890105:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000083f48d9/0x6d74dbab2ddb14a5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788813261.890126:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788813262.168825:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eb163ee7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+5:5830:x1875706583712000:12345-0@lo:253: Request processed in 316628us (321451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813262.168841:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813262.168952:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000093431358 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583712000:0@lo:253: 10000000:01000000:1.0:1788813262.168979:0:5830:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788813262.168982:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788813262.168984:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788813262.168986:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813262.168986:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1788813262.168988:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813262.169004:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813262.169005:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788813262.169007:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788813262.169008:0:5830:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788813262.169010:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813262.169011:0:5830:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788813262.169044:0:5830:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001f40b836 from lustre-MDT0000 10000000:01000000:1.0:1788813262.169069:0:5830:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788813262.169071:0:5830:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788813262.169075:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff908749b5cd40 10000000:01000000:1.0:1788813262.169079:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788813262.169088:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff908749b5cd40 from 1 10000000:01000000:1.0:1788813262.169090:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788813262.169143:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: 00000000b81ed45c/0x6d74dbab2ddb14ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.169154:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: 00000000b81ed45c/0x6d74dbab2ddb14ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.169164:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: 00000000b81ed45c/0x6d74dbab2ddb14ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813262.169183:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d03f7bfd pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583712128:0@lo:101: 00000100:00100000:1.0:1788813262.169219:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813262.169273:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 0000000049fbbae6 going to sleep for 11 seconds 00000100:00100000:0.0:1788813262.169417:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583712128 00000100:00100000:0.0:1788813262.169424:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583712128 00000100:00100000:0.0:1788813262.169513:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788813262.169520:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000047e6f0e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+5:5830:x1875706583712128:12345-0@lo:101: 00010000:00010000:0.0:1788813262.169532:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813262.169546:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d7c38738/0x6d74dbab2ddb14b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb14ac expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813262.169610:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d7c38738/0x6d74dbab2ddb14b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb14ac expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813262.169622:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d7c38738/0x6d74dbab2ddb14b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb14ac expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813262.169630:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d7c38738, rc 0) 00000100:00100000:0.0:1788813262.169663:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000047e6f0e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+6:5830:x1875706583712128:12345-0@lo:101: Request processed in 144us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813262.169669:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788813262.169798:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d03f7bfd pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583712128:0@lo:101: 00010000:00010000:2.0:1788813262.169812:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: 00000000b81ed45c/0x6d74dbab2ddb14ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb14b3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813262.169819:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: 00000000b81ed45c/0x6d74dbab2ddb14ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb14b3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813262.169879:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003013a50d pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583712256:0@lo:501: 00000100:00100000:2.0:1788813262.169906:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813262.170015:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bda32780 going to sleep for 11 seconds 00000100:00100000:1.0:1788813262.170102:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583712256 00000100:00100000:1.0:1788813262.170107:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583712256 00000100:00100000:1.0:1788813262.170138:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813262.170145:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007bb17d1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+6:5830:x1875706583712256:12345-0@lo:501: 00000100:00100000:1.0:1788813262.170367:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007bb17d1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+6:5830:x1875706583712256:12345-0@lo:501: Request processed in 223us (460us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788813262.170374:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788813262.170489:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003013a50d pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583712256:0@lo:501: 10000000:01000000:2.0:1788813262.170651:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788813262.170707:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: 00000000b81ed45c/0x6d74dbab2ddb14ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb14b3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813262.170716:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: 00000000b81ed45c/0x6d74dbab2ddb14ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb14b3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813262.170725:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff908781c96000 10000000:01000000:2.0:1788813262.170730:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788813262.170735:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff908781c96000 10000000:01000000:2.0:1788813262.170737:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788813262.170739:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff908781c96000 from 1 10000000:01000000:2.0:1788813262.170741:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788813262.170763:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: 00000000c28342a8/0x6d74dbab2ddb14ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813262.170770:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: 00000000c28342a8/0x6d74dbab2ddb14ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813262.170778:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: 00000000c28342a8/0x6d74dbab2ddb14ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813262.170791:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003013a50d pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583712384:0@lo:101: 00000100:00100000:2.0:1788813262.170828:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813262.170857:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bda32780 going to sleep for 11 seconds 00000100:00100000:1.0:1788813262.171299:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583712384 00000100:00100000:1.0:1788813262.171306:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583712384 00000100:00100000:1.0:1788813262.171345:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813262.171352:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d8783d30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+6:5830:x1875706583712384:12345-0@lo:101: 00010000:00010000:1.0:1788813262.171361:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813262.171372:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d7e77f29/0x6d74dbab2ddb14c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb14ba expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.171388:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d7e77f29/0x6d74dbab2ddb14c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb14ba expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.171395:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d7e77f29/0x6d74dbab2ddb14c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb14ba expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.171402:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d7e77f29, rc 0) 00000100:00100000:1.0:1788813262.171434:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d8783d30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+7:5830:x1875706583712384:12345-0@lo:101: Request processed in 83us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813262.171440:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788813262.171891:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003013a50d pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583712384:0@lo:101: 00010000:00010000:2.0:1788813262.171904:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: 00000000c28342a8/0x6d74dbab2ddb14ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb14c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813262.171912:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: 00000000c28342a8/0x6d74dbab2ddb14ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb14c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813262.171928:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788813262.174390:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: 00000000c28342a8/0x6d74dbab2ddb14ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb14c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813262.174408:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: 00000000c28342a8/0x6d74dbab2ddb14ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb14c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813262.174417:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788813262.174427:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788813262.174434:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff908781c96000 10000000:01000000:2.0:1788813262.174436:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788813262.174439:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788813262.174441:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788813262.174475:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: 000000008e619de5/0x6d74dbab2ddb14c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813262.174482:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: 000000008e619de5/0x6d74dbab2ddb14c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813262.174491:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: 000000008e619de5/0x6d74dbab2ddb14c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813262.174628:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003013a50d pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583712512:0@lo:101: 00000100:00100000:2.0:1788813262.174699:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813262.174740:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bda32780 going to sleep for 11 seconds 00000100:00100000:3.0:1788813262.175089:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583712512 00000100:00100000:3.0:1788813262.175098:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583712512 00000100:00100000:3.0:1788813262.175141:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788813262.175149:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008fb69112 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+7:5830:x1875706583712512:12345-0@lo:101: 00010000:00010000:3.0:1788813262.175162:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813262.175175:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000083f48d9/0x6d74dbab2ddb14cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb14c8 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813262.175197:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000083f48d9/0x6d74dbab2ddb14cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb14c8 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813262.175207:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000083f48d9/0x6d74dbab2ddb14cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb14c8 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813262.175222:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000083f48d9, rc 0) 00000100:00100000:3.0:1788813262.175272:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008fb69112 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+8:5830:x1875706583712512:12345-0@lo:101: Request processed in 124us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813262.175278:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788813262.175449:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003013a50d pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583712512:0@lo:101: 00010000:00010000:2.0:1788813262.175464:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: 000000008e619de5/0x6d74dbab2ddb14c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb14cf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813262.175472:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: 000000008e619de5/0x6d74dbab2ddb14c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb14cf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813262.175642:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003013a50d pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583712640:0@lo:501: 00000100:00100000:2.0:1788813262.175673:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813262.175709:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bda32780 going to sleep for 11 seconds 00000100:00100000:3.0:1788813262.176108:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583712640 00000100:00100000:3.0:1788813262.176114:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583712640 00000100:00100000:3.0:1788813262.176151:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788813262.176158:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005d9eced7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+8:5830:x1875706583712640:12345-0@lo:501: 00000100:00100000:3.0:1788813262.176413:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005d9eced7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+9:5830:x1875706583712640:12345-0@lo:501: Request processed in 256us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813262.176421:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788813262.176813:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003013a50d pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583712640:0@lo:501: 00000100:00100000:0.0:1788813262.176874:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006e1aaf4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583712768:0@lo:503: 00000100:00100000:0.0:1788813262.176921:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813262.177096:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eb7e4254 going to sleep for 11 seconds 00000100:00100000:1.0:1788813262.177201:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583712768 00000100:00100000:1.0:1788813262.177209:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583712768 00000100:00100000:1.0:1788813262.177254:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788813262.177260:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000565efd59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+9:5830:x1875706583712768:12345-0@lo:503: 00000100:00100000:1.0:1788813262.177490:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000565efd59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+9:5830:x1875706583712768:12345-0@lo:503: Request processed in 230us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813262.177506:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788813262.177905:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006e1aaf4a pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583712768:0@lo:503: 00000100:00100000:3.0:1788813262.178633:0:5872:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b07e3899 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:5872:1875706583712896:0@lo:502: 00000100:00100000:3.0:1788813262.178691:0:5872:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813262.178779:0:5872:0:(client.c:2716:ptlrpc_set_wait()) set 000000000b8b419f going to sleep for 11 seconds 00000100:00100000:2.0:1788813262.178819:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583712896 00000100:00100000:2.0:1788813262.178826:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583712896 00000100:00100000:2.0:1788813262.178900:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788813262.178908:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e811a0f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+9:5872:x1875706583712896:12345-0@lo:502: 00000100:00100000:2.0:1788813262.179276:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e811a0f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+9:5872:x1875706583712896:12345-0@lo:502: Request processed in 368us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813262.179283:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788813262.179364:0:5872:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b07e3899 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:5872:1875706583712896:0@lo:502: 00000020:01000000:3.0:1788813262.179387:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813262.179397:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813262.179400:0:5872:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788813262.179405:0:5872:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788813262.179408:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788813262.179421:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000f683c2d7) 00000020:00000080:3.0:1788813262.179437:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788813262.179442:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788813262.179520:0:5872:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788813262.179527:0:5872:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d74dbab2ddb14dd 00000020:00000080:3.0:1788813262.179791:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788813262.179795:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813262.179803:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813262.179804:0:5872:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788813262.179807:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813262.179810:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813262.179811:0:5872:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788813262.179814:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788813262.179821:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000c1ceea36) 00000020:00000080:3.0:1788813262.179830:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788813262.179834:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788813262.179835:0:5872:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788813262.179838:0:5872:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788813262.179843:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788813262.179884:0:5872:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001f40b836 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788813262.179900:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000ae3d65dd) 00000020:00000080:3.0:1788813262.179909:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788813262.181080:0:5872:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788813262.181094:0:5872:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d74dbab2ddb14f2 00000020:00000080:3.0:1788813262.181252:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788813262.181259:0:5872:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788813262.181263:0:5872:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x6d74dbab2ddb14f9 00080000:01000000:3.0:1788813262.181269:0:5872:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788813262.181273:0:5872:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d74dbab2ddb1500 00080000:10000000:3.0:1788813262.182019:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788813262.182312:0:5872:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788813262.189752:0:5872:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1788813262.264759:0:5872:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1788813262.265205:0:5872:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1788813262.267989:0:5872:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1788813262.268299:0:5872:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788813262.311347:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000039ea7b40) 00000020:00000080:0.0:1788813262.311378:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788813262.311483:0:5872:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788813262.311709:0:5872:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d74dbab2ddb150e 00000020:00000080:2.0:1788813262.314134:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788813262.317394:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788813262.391401:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788813262.442444:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788813262.500036:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00010000:00010000:0.0:1788813262.527930:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788813262.595153:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788813262.667478:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1788813262.728563:0:5872:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x6d74dbab2ddb1515 00000020:00000080:3.0:1788813262.729335:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788813262.729346:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813262.729352:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813262.729354:0:5872:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788813262.729358:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813262.729361:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813262.729362:0:5872:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788813262.729372:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788813262.729373:0:5872:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788813262.729376:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813262.729378:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813262.729379:0:5872:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788813262.729381:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813262.729386:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813262.729387:0:5872:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788813262.729391:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788813262.729429:0:5872:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1788813262.729481:0:5872:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b07e3899 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:5872:1875706583713024:0@lo:502: 00000100:00100000:3.0:1788813262.729662:0:5872:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813262.729717:0:5872:0:(client.c:2716:ptlrpc_set_wait()) set 000000000b8b419f going to sleep for 11 seconds 00000100:00100000:2.0:1788813262.730017:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583713024 00000100:00100000:2.0:1788813262.730025:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583713024 00000100:00100000:2.0:1788813262.730078:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788813262.730086:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001cdf3872 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+9:5872:x1875706583713024:12345-0@lo:502: 00000100:00100000:2.0:1788813262.730684:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001cdf3872 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+9:5872:x1875706583713024:12345-0@lo:502: Request processed in 598us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813262.730694:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788813262.731078:0:5872:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b07e3899 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:5872:1875706583713024:0@lo:502: 00000020:01000000:3.0:1788813262.731113:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813262.731120:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813262.731122:0:5872:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1788813262.731125:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1788813262.731446:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1788813262.731466:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788813262.731606:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: 000000008e619de5/0x6d74dbab2ddb14c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb14cf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.731618:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: 000000008e619de5/0x6d74dbab2ddb14c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb14cf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813262.731626:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff908781c96000 from 1 10000000:01000000:1.0:1788813262.731628:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788813262.731660:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: 000000006d6f3676/0x6d74dbab2ddb151c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.731667:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: 000000006d6f3676/0x6d74dbab2ddb151c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.731675:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: 000000006d6f3676/0x6d74dbab2ddb151c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813262.731692:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a839a182 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583713152:0@lo:101: 00000100:00100000:1.0:1788813262.731738:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813262.732004:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c53b1985 going to sleep for 11 seconds 00000100:00100000:2.0:1788813262.732130:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583713152 00000100:00100000:2.0:1788813262.732138:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583713152 00000100:00100000:2.0:1788813262.732178:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788813262.732186:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f64c3f8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+9:5830:x1875706583713152:12345-0@lo:101: 00010000:00010000:2.0:1788813262.732197:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813262.732209:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c061e141/0x6d74dbab2ddb1523 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb151c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813262.732231:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c061e141/0x6d74dbab2ddb1523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb151c expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813262.732241:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c061e141/0x6d74dbab2ddb1523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb151c expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813262.732248:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c061e141, rc 0) 00000100:00100000:2.0:1788813262.732446:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f64c3f8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+10:5830:x1875706583713152:12345-0@lo:101: Request processed in 261us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813262.732453:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788813262.732738:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a839a182 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583713152:0@lo:101: 00010000:00010000:1.0:1788813262.732883:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: 000000006d6f3676/0x6d74dbab2ddb151c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1523 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.732951:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: 000000006d6f3676/0x6d74dbab2ddb151c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb1523 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813262.733745:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a839a182 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583713280:0@lo:256: 00000100:00100000:1.0:1788813262.734009:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813262.734091:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c53b1985 going to sleep for 11 seconds 00000100:00100000:3.0:1788813262.734148:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583713280 00000100:00100000:3.0:1788813262.734155:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583713280 00000100:00100000:3.0:1788813262.734239:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788813262.734248:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ee66ace9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+10:5830:x1875706583713280:12345-0@lo:256: 20000000:01000000:3.0:1788813262.734347:0:5843:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788813262.734355:0:5843:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788813262.734437:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ee66ace9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+10:5830:x1875706583713280:12345-0@lo:256: Request processed in 190us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813262.734444:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788813262.734540:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a839a182 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583713280:0@lo:256: 10000000:01000000:2.0:1788813262.735223:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788813262.735250:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: 000000006d6f3676/0x6d74dbab2ddb151c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1523 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813262.735836:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: 000000006d6f3676/0x6d74dbab2ddb151c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1523 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813262.735844:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff908781c96000 from 1 10000000:01000000:2.0:1788813262.735847:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788813262.735882:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: 00000000dc3b4b05/0x6d74dbab2ddb152a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813262.735934:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: 00000000dc3b4b05/0x6d74dbab2ddb152a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813262.735944:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: 00000000dc3b4b05/0x6d74dbab2ddb152a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813262.735974:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba9a3b86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583713408:0@lo:101: 00000100:00100000:2.0:1788813262.736038:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813262.736559:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b3509957 going to sleep for 11 seconds 00000100:00100000:1.0:1788813262.736722:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583713408 00000100:00100000:1.0:1788813262.736731:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583713408 00000100:00100000:1.0:1788813262.736789:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788813262.736797:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e6be1e9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+10:5830:x1875706583713408:12345-0@lo:101: 00010000:00010000:1.0:1788813262.736810:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813262.736823:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000078a86493/0x6d74dbab2ddb1531 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb152a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.736847:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000078a86493/0x6d74dbab2ddb1531 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb152a expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.736857:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000078a86493/0x6d74dbab2ddb1531 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb152a expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.736864:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000078a86493, rc 0) 00000100:00100000:1.0:1788813262.737170:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e6be1e9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:5830:x1875706583713408:12345-0@lo:101: Request processed in 373us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813262.737176:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788813262.737283:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba9a3b86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583713408:0@lo:101: 00010000:00010000:2.0:1788813262.737299:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: 00000000dc3b4b05/0x6d74dbab2ddb152a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1531 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813262.737307:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: 00000000dc3b4b05/0x6d74dbab2ddb152a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb1531 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813262.737362:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba9a3b86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583713536:0@lo:501: 00000100:00100000:2.0:1788813262.737391:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813262.737419:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b3509957 going to sleep for 11 seconds 00000100:00100000:1.0:1788813262.737608:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583713536 00000100:00100000:1.0:1788813262.737613:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583713536 00000100:00100000:1.0:1788813262.737633:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788813262.737638:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c9794243 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:5830:x1875706583713536:12345-0@lo:501: 00000100:00100000:1.0:1788813262.738243:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c9794243 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:5830:x1875706583713536:12345-0@lo:501: Request processed in 603us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813262.738251:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788813262.739195:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba9a3b86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583713536:0@lo:501: 00000100:00100000:2.0:1788813262.739253:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba9a3b86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583713664:0@lo:503: 00000100:00100000:2.0:1788813262.739326:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813262.739366:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b3509957 going to sleep for 11 seconds 00000100:00100000:1.0:1788813262.739480:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583713664 00000100:00100000:1.0:1788813262.739505:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583713664 00000100:00100000:1.0:1788813262.739538:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788813262.739545:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000081183be6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:5830:x1875706583713664:12345-0@lo:503: 00000040:00080000:1.0:1788813262.739615:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788813262.739658:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000081183be6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:5830:x1875706583713664:12345-0@lo:503: Request processed in 114us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813262.739666:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788813262.739938:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba9a3b86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583713664:0@lo:503: 00000040:00080000:2.0:1788813262.741054:0:5876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788813262.741266:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788813262.741284:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788813262.741305:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: 00000000dc3b4b05/0x6d74dbab2ddb152a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1531 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.741317:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: 00000000dc3b4b05/0x6d74dbab2ddb152a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1531 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813262.741362:0:5830:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788813262.741364:0:5830:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff908781c96000 10000000:01000000:1.0:1788813262.741367:0:5830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff908781c96000 10000000:01000000:1.0:1788813262.741372:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788813262.741377:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff908781c96000 from 1 10000000:01000000:1.0:1788813262.741380:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788813262.741415:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: 0000000034f6028e/0x6d74dbab2ddb1538 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.741423:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: 0000000034f6028e/0x6d74dbab2ddb1538 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.741432:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: 0000000034f6028e/0x6d74dbab2ddb1538 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813262.741450:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002c092528 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583713792:0@lo:101: 00000100:00100000:1.0:1788813262.741655:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813262.741688:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ca78d588 going to sleep for 11 seconds 00000100:00100000:1.0:1788813262.741709:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583713792 00000100:00100000:1.0:1788813262.741714:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583713792 00000100:00100000:1.0:1788813262.741741:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788813262.741747:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dc945e0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:5830:x1875706583713792:12345-0@lo:101: 00010000:00010000:1.0:1788813262.741892:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813262.741906:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005fe3761d/0x6d74dbab2ddb153f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb1538 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.741928:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005fe3761d/0x6d74dbab2ddb153f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1538 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.741938:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005fe3761d/0x6d74dbab2ddb153f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1538 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.741947:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005fe3761d, rc 0) 00000100:00100000:1.0:1788813262.741995:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dc945e0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:5830:x1875706583713792:12345-0@lo:101: Request processed in 248us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813262.742001:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788813262.742044:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002c092528 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583713792:0@lo:101: 00010000:00010000:1.0:1788813262.742057:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: 0000000034f6028e/0x6d74dbab2ddb1538 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb153f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.742065:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: 0000000034f6028e/0x6d74dbab2ddb1538 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb153f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813262.742115:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002c092528 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583713920:0@lo:501: 00000100:00100000:1.0:1788813262.742154:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813262.742167:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ca78d588 going to sleep for 11 seconds 00000100:00100000:1.0:1788813262.742181:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583713920 00000100:00100000:1.0:1788813262.742184:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583713920 00000100:00100000:1.0:1788813262.742200:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788813262.742205:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003b8f7b62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:5830:x1875706583713920:12345-0@lo:501: 00000100:00100000:1.0:1788813262.745039:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003b8f7b62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:5830:x1875706583713920:12345-0@lo:501: Request processed in 2819us (2869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813262.745054:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788813262.746696:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002c092528 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583713920:0@lo:501: 00000100:00100000:2.0:1788813262.746903:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba9a3b86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583714048:0@lo:503: 00000100:00100000:2.0:1788813262.746991:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813262.747079:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a58892ba going to sleep for 11 seconds 00000100:00100000:3.0:1788813262.747147:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583714048 00000100:00100000:3.0:1788813262.747154:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583714048 00000100:00100000:3.0:1788813262.747230:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788813262.747246:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c679366d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:5830:x1875706583714048:12345-0@lo:503: 00000100:00100000:2.0:1788813262.748240:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c679366d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:5830:x1875706583714048:12345-0@lo:503: Request processed in 991us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813262.748250:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788813262.748444:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba9a3b86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583714048:0@lo:503: 00000100:00100000:3.0:1788813262.753150:0:5877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b07e3899 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:5877:1875706583714176:0@lo:502: 00000100:00100000:3.0:1788813262.753266:0:5877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813262.753676:0:5877:0:(client.c:2716:ptlrpc_set_wait()) set 0000000062358260 going to sleep for 11 seconds 00000100:00100000:2.0:1788813262.753984:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583714176 00000100:00100000:2.0:1788813262.753993:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583714176 00000100:00100000:2.0:1788813262.754079:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788813262.754089:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004c070765 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:5877:x1875706583714176:12345-0@lo:502: 00000100:00100000:2.0:1788813262.754572:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004c070765 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:5877:x1875706583714176:12345-0@lo:502: Request processed in 483us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813262.754604:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788813262.754813:0:5877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b07e3899 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:5877:1875706583714176:0@lo:502: 00000020:01000004:3.0:1788813262.754880:0:5877:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788813262.754895:0:5877:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000007b8cc82d) 00000020:00000080:3.0:1788813262.754913:0:5877:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788813262.755009:0:5877:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001f40b836 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788813262.755013:0:5877:0:(tgt_mount.c:187:server_put_mount()) put mount 000000001f40b836 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788813262.755016:0:5877:0:(obd_mount.c:710:lustre_put_lsi()) put 000000001f40b836 4 00010000:00080000:3.0:1788813262.755043:0:5877:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009e4a0bd0@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.147@tcp at head 00010000:00010000:3.0:1788813262.756747:0:5877:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788813262.756931:0:5877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788813262.756981:0:5877:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788813262.756994:0:5877:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x6d74dbab2ddb154d 00000100:00080000:3.0:1788813262.757004:0:5877:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788813262.757013:0:5877:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009e4a0bd0 using connection 192.168.204.147@tcp/0@lo 00000100:00100000:3.0:1788813262.757052:0:5877:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b07e3899 x1875706583714304/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788813262.757086:0:5877:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788813262.763113:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b07e3899 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875706583714304:0@lo:38: 00000100:00100000:2.0:1788813262.763196:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813262.763423:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583714304 00000100:00100000:3.0:1788813262.763432:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583714304 00000100:00100000:3.0:1788813262.763482:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788813262.764133:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001a4d9516 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3317:x1875706583714304:12345-0@lo:38: 00000100:00100000:3.0:1788813262.764210:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001a4d9516 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3317:x1875706583714304:12345-0@lo:38: Request processed in 76us (1011us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788813262.764227:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788813262.764730:0:5877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006e1aaf4a pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:5877:1875706583714432:0@lo:502: 00000100:00100000:2.0:1788813262.765728:0:3317:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788813262.765737:0:3317:0:(import.c:65:import_set_state_nolock()) 000000009e4a0bd0 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788813262.765742:0:3317:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788813262.765892:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b07e3899 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875706583714304:0@lo:38: 00000100:00100000:0.0:1788813262.766059:0:5877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813262.766104:0:5877:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eb7e4254 going to sleep for 11 seconds 00000100:00100000:2.0:1788813262.766221:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583714432 00000100:00100000:2.0:1788813262.766228:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583714432 00000100:00100000:0.0:1788813262.766932:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788813262.766944:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007de5a53a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:5877:x1875706583714432:12345-0@lo:502: 00000100:00100000:0.0:1788813262.767196:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007de5a53a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:5877:x1875706583714432:12345-0@lo:502: Request processed in 255us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813262.767203:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788813262.767967:0:5877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006e1aaf4a pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:5877:1875706583714432:0@lo:502: 00000040:00080000:3.0:1788813262.768006:0:5877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788813262.768186:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788813262.768212:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788813262.768223:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: 0000000034f6028e/0x6d74dbab2ddb1538 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb153f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813262.768233:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: 0000000034f6028e/0x6d74dbab2ddb1538 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb153f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788813262.768288:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788813262.768291:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788813262.768292:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813262.768293:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813262.768294:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813262.768296:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813262.768297:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788813262.768298:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788813262.768299:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788813262.768300:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788813262.768302:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813262.768304:0:5830:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788813262.768307:0:5830:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788813262.768309:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788813262.768310:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788813262.768311:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813262.768312:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813262.768313:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813262.768314:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813262.768427:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788813262.768429:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788813262.768430:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788813262.768431:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788813262.768432:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813262.768433:0:5830:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788813262.768465:0:5830:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788813262.768480:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d59d2470 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583714560:0@lo:253: 00000100:00100000:2.0:1788813262.770932:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813262.771630:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b3509957 going to sleep for 11 seconds 00000100:00100000:3.0:1788813262.773924:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583714560 00000100:00100000:3.0:1788813262.773940:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583714560 00000100:00100000:2.0:1788813262.774130:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788813262.774140:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000acf27d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:5830:x1875706583714560:12345-0@lo:253: 20000000:01000000:2.0:1788813262.774192:0:5844:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788813262.774207:0:5844:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788813262.825191:0:5844:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788813262.825248:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788813262.829909:0:5865:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788813262.829921:0:5865:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788813262.829942:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000082f1fd7/0x6d74dbab2ddb1554 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813262.829975:0:5865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c061e141/0x6d74dbab2ddb1523 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb151c expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813262.829983:0:5865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000082f1fd7/0x6d74dbab2ddb1554 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813262.830026:0:5865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c061e141/0x6d74dbab2ddb1523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb151c expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813262.830042:0:5865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c061e141/0x6d74dbab2ddb1523 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb151c expref: 12 pid: 5844 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813262.830057:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f28f5074 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1875706583714688:0@lo:104: 00000100:00100000:0.0:1788813262.830125:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813262.830191:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set 0000000029b149cf going to sleep for 11 seconds 00000100:00100000:1.0:1788813262.830392:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583714688 00000100:00100000:1.0:1788813262.830402:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583714688 00000100:00100000:1.0:1788813262.830455:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813262.830463:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002e90bc7d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+3:5865:x1875706583714688:12345-0@lo:104: 00010000:00010000:1.0:1788813262.830477:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: 000000006d6f3676/0x6d74dbab2ddb151c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb1523 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.830549:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788813262.830554:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002e90bc7d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+3:5865:x1875706583714688:12345-0@lo:104: Request processed in 93us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813262.830561:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788813262.830603:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813262.830608:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: 000000006d6f3676/0x6d74dbab2ddb151c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb1523 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.830616:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006d6f3676 already unused, calling callback (00000000504c0d05) 10000000:00010000:1.0:1788813262.830619:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: 000000006d6f3676/0x6d74dbab2ddb151c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb1523 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.830642:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: 000000006d6f3676/0x6d74dbab2ddb151c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb1523 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813262.830649:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: 000000006d6f3676/0x6d74dbab2ddb151c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb1523 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813262.830654:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788813262.830685:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: 000000006d6f3676/0x6d74dbab2ddb151c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1523 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.830693:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813262.830711:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: 000000006d6f3676/0x6d74dbab2ddb151c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1523 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.830718:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: 000000006d6f3676/0x6d74dbab2ddb151c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1523 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813262.830734:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813262.830736:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813262.830737:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813262.830973:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f28f5074 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1875706583714688:0@lo:104: 00010000:00010000:2.0:1788813262.830992:0:5865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000082f1fd7/0x6d74dbab2ddb1554 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813262.832395:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bd403e82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd1fd158-af17-4a1b-8f0b-82e57114d008:3319:1875706583714816:0@lo:103: 00000100:00100000:3.0:1788813262.832461:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813262.832689:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583714816 00000100:00100000:0.0:1788813262.832697:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583714816 00010000:00010000:0.0:1788813262.832727:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c061e141/0x6d74dbab2ddb1523 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb151c expref: 13 pid: 5844 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813262.832775:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788813262.832791:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e86b25fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:3319:x1875706583714816:12345-0@lo:103: 00010000:00010000:0.0:1788813262.832805:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813262.832809:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c061e141/0x6d74dbab2ddb1523 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb151c expref: 13 pid: 5844 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813262.832821:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c061e141/0x6d74dbab2ddb1523 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb151c expref: 13 pid: 5844 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813262.832835:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c061e141/0x6d74dbab2ddb1523 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb151c expref: 13 pid: 5844 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813262.832849:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000082f1fd7/0x6d74dbab2ddb1554 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813262.832857:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000082f1fd7/0x6d74dbab2ddb1554 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788813262.832871:0:5834:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002952162s 00010000:00010000:0.0:1788813262.832875:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000082f1fd7/0x6d74dbab2ddb1554 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813262.832881:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000082f1fd7/0x6d74dbab2ddb1554 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813262.832898:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000082f1fd7/0x6d74dbab2ddb1554 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813262.832904:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000082f1fd7/0x6d74dbab2ddb1554 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813262.832909:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000082f1fd7 already unused, calling callback (000000004bef8063) 00010000:00010000:0.0:1788813262.832918:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000082f1fd7/0x6d74dbab2ddb1554 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813262.832925:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000082f1fd7/0x6d74dbab2ddb1554 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813262.832940:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000082f1fd7/0x6d74dbab2ddb1554 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813262.832949:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813262.833002:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e86b25fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:3319:x1875706583714816:12345-0@lo:103: Request processed in 213us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813262.833009:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788813262.833044:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bd403e82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd1fd158-af17-4a1b-8f0b-82e57114d008:3319:1875706583714816:0@lo:103: 00010000:00010000:3.0:1788813262.834200:0:5865:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000082f1fd7/0x6d74dbab2ddb1554 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813262.834213:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000082f1fd7/0x6d74dbab2ddb1554 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813262.834219:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000082f1fd7/0x6d74dbab2ddb1554 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813262.839636:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000acf27d83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:5830:x1875706583714560:12345-0@lo:253: Request processed in 65489us (68702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813262.839651:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788813262.840672:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d59d2470 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:5830:1875706583714560:0@lo:253: 10000000:01000000:3.0:1788813262.840689:0:5830:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788813262.840692:0:5830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788813262.840695:0:5830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788813262.840696:0:5830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813262.840697:0:5830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813262.840698:0:5830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813262.840700:0:5830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813262.840701:0:5830:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788813262.840702:0:5830:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788813262.840703:0:5830:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788813262.840705:0:5830:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788813262.840706:0:5830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813262.840707:0:5830:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788813262.840720:0:5830:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788813262.853412:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788813262.855378:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788813262.856630:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788813262.856850:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788813262.857447:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788813262.857708:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788813262.873321:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788813262.873554:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788813262.875114:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788813262.875328:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788813262.875553:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788813262.876200:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1788813262.978505:0:5830:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788813263.113385:0:5830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788813263.120126:0:5883:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:3.0:1788813263.125875:0:5882:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788813263.125882:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788813263.130842:0:5830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788813263.131159:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788813263.132095:0:5830:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788813263.132108:0:5830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788813263.132430:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788813263.149908:0:5830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788813263.152287:0:5830:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788813263.152370:0:5830:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788813263.152695:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788813263.152907:0:5830:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1788813263.154287:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788813263.154445:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788813263.154628:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788813263.154774:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788813263.154934:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788813263.167608:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788813263.167836:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788813263.168180:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788813263.168393:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788813263.168815:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788813263.169097:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788813263.169241:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788813263.170080:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788813263.175105:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788813263.176464:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788813263.176724:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788813263.183490:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788813263.183794:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788813263.183970:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788813263.184131:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788813263.184272:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788813263.184433:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788813263.184575:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788813263.184778:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788813263.184919:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788813263.185087:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788813263.185217:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788813263.185389:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788813263.185543:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788813263.185749:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788813263.185878:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788813263.186038:0:5830:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788813263.193279:0:5830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1788813263.264224:0:5883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1788813263.398450:0:5830:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788813263.398505:0:5830:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbb7941dd3988 00100000:10000000:1.0:1788813263.398514:0:5830:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788813263.408242:0:5830:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788813263.408273:0:5830:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.147@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788813263.408288:0:5830:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788813263.408315:0:5830:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1788813263.465775:0:5883:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788813263.465874:0:5883:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788813263.465879:0:5883:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788813263.562552:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813264.580194:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813265.599946:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813266.621194:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813267.644743:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788813268.165245:0:484:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788813268.165258:0:484:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788813268.165262:0:484:0:(import.c:65:import_set_state_nolock()) 000000009e4a0bd0 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813268.165283:0:484:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009e4a0bd0 using connection 192.168.204.147@tcp/0@lo 00000100:00100000:1.0:1788813268.165330:0:484:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000de541739 x1875706583715072/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788813268.165462:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000de541739 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875706583715072:0@lo:38: 00000100:00100000:1.0:1788813268.165538:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813268.166793:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e9e898af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583714944:0@lo:400: 00000100:00100000:1.0:1788813268.166864:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813268.166932:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583714944 00000100:00100000:1.0:1788813268.166940:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583714944 00000100:00100000:1.0:1788813268.166982:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788813268.166991:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000046191cf9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:3320:x1875706583714944:12345-0@lo:400: 00000100:00100000:1.0:1788813268.167040:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000046191cf9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:3320:x1875706583714944:12345-0@lo:400: Request processed in 51us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813268.167047:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788813268.167180:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e9e898af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583714944:0@lo:400: 00000100:00100000:3.0:1788813268.167276:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583715072 00000100:00100000:3.0:1788813268.167281:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583715072 00000100:00100000:3.0:1788813268.167317:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788813268.167323:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009038f224 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3317:x1875706583715072:12345-0@lo:38: 00010000:00080000:3.0:1788813268.167350:0:5851:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:2.0:1788813268.168689:0:5851:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x6d74dbab2ddb155b 00000004:00100000:2.0:1788813268.168751:0:5851:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788813268.168908:0:5851:0:(import.c:65:import_set_state_nolock()) 00000000bfa41db7 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788813268.168998:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009038f224 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875706583715072:12345-0@lo:38: Request processed in 1673us (3459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813268.169011:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788813268.169230:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000de541739 x1875706583715072/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788813268.169248:0:3317:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788813268.169257:0:3317:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788813268.169262:0:3317:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788813268.169264:0:3317:0:(import.c:65:import_set_state_nolock()) 000000009e4a0bd0 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788813268.169276:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000de541739 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875706583715072:0@lo:38: 00010000:00010000:1.0:1788813268.684400:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788813268.774440:0:6126:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg447-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788813269.693763:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813270.718328:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788813271.228760:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788813271.228772:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff908781c96000 from 3 10000000:01000000:3.0:1788813271.228779:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788813271.228861:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: 00000000d741d7a8/0x6d74dbab2ddb1562 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813271.228895:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: 00000000d741d7a8/0x6d74dbab2ddb1562 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813271.228909:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: 00000000d741d7a8/0x6d74dbab2ddb1562 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813271.228940:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004bfdc49a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583715200:0@lo:101: 00000100:00100000:3.0:1788813271.229037:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813271.229106:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set 000000006929b208 going to sleep for 11 seconds 00000100:00100000:2.0:1788813271.229389:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583715200 00000100:00100000:2.0:1788813271.229400:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583715200 00000100:00100000:2.0:1788813271.229466:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788813271.229476:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dd378ebf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:5846:x1875706583715200:12345-0@lo:101: 00010000:00010000:2.0:1788813271.229493:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813271.229509:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000050ea6a4a/0x6d74dbab2ddb1569 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb1562 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813271.229542:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000050ea6a4a/0x6d74dbab2ddb1569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1562 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813271.229565:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000050ea6a4a/0x6d74dbab2ddb1569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1562 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813271.229575:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000050ea6a4a, rc 0) 00000100:00100000:2.0:1788813271.229660:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dd378ebf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:5846:x1875706583715200:12345-0@lo:101: Request processed in 185us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813271.229667:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788813271.230092:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004bfdc49a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583715200:0@lo:101: 00010000:00010000:3.0:1788813271.230112:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: 00000000d741d7a8/0x6d74dbab2ddb1562 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1569 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813271.230122:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: 00000000d741d7a8/0x6d74dbab2ddb1562 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb1569 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813271.230192:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004bfdc49a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583715328:0@lo:256: 00000100:00100000:3.0:1788813271.230233:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813271.230275:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set 000000006929b208 going to sleep for 11 seconds 00000100:00100000:0.0:1788813271.230331:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583715328 00000100:00100000:0.0:1788813271.230346:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583715328 00000100:00100000:0.0:1788813271.230388:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788813271.230396:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003dd5aa64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:5846:x1875706583715328:12345-0@lo:256: 20000000:01000000:0.0:1788813271.230417:0:5841:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788813271.230439:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788813271.230448:0:5841:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788813271.230538:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003dd5aa64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:5846:x1875706583715328:12345-0@lo:256: Request processed in 143us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813271.230546:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788813271.230820:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004bfdc49a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583715328:0@lo:256: 10000000:01000000:3.0:1788813271.230868:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788813271.230881:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: 00000000d741d7a8/0x6d74dbab2ddb1562 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1569 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813271.230890:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: 00000000d741d7a8/0x6d74dbab2ddb1562 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1569 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813271.740940:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813272.766571:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813273.277888:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788813273.277925:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc6fd8b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875706583715584:0@lo:400: 00000100:00100000:0.0:1788813273.278031:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813273.278123:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583715584 00000100:00100000:0.0:1788813273.278133:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583715584 00000100:00100000:0.0:1788813273.278191:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788813273.278201:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002aeec607 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875706583715584:12345-0@lo:400: 00000100:00100000:0.0:1788813273.278264:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002aeec607 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875706583715584:12345-0@lo:400: Request processed in 65us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813273.278273:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788813273.278335:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000dc6fd8b7 x1875706583715584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813273.278353:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc6fd8b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875706583715584:0@lo:400: 00000100:00100000:1.0:1788813273.278466:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813273.278478:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005f0a1067 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583715456:0@lo:400: 00000100:00100000:1.0:1788813273.278524:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813273.278603:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583715456 00000100:00100000:1.0:1788813273.278609:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583715456 00000100:00100000:1.0:1788813273.278639:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788813273.278646:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d53ee257 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:3320:x1875706583715456:12345-0@lo:400: 00000100:00100000:1.0:1788813273.278683:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d53ee257 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:3320:x1875706583715456:12345-0@lo:400: Request processed in 38us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813273.278690:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788813273.278728:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005f0a1067 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583715456:0@lo:400: 00010000:00010000:3.0:1788813273.788965:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788813274.677479:0:6329:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe646db400 20000000:00000080:1.0:1788813274.677501:0:6329:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff908773ae4c00 uarg=0000000000000000 20000000:01000000:1.0:1788813274.677529:0:6329:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788813274.677536:0:6329:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788813274.677541:0:6329:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788813274.678087:0:6329:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788813274.678102:0:6329:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788813274.682276:0:6329:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788813274.682576:0:6329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788813274.683200:0:6329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788813274.683258:0:6329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788813274.683278:0:6329:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788813274.683297:0:6329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003e2f7e9e/0x6d74dbab2ddb1570 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813274.683323:0:6329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000078a86493/0x6d74dbab2ddb1531 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb152a expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813274.683332:0:6329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003e2f7e9e/0x6d74dbab2ddb1570 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813274.683370:0:6329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000078a86493/0x6d74dbab2ddb1531 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb152a expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813274.683384:0:6329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000078a86493/0x6d74dbab2ddb1531 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb152a expref: 11 pid: 5841 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813274.683399:0:6329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000de541739 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6329:1875706583715712:0@lo:104: 00000100:00100000:1.0:1788813274.683461:0:6329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813274.683514:0:6329:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f00f2550 going to sleep for 11 seconds 00000100:00100000:3.0:1788813274.683628:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583715712 00000100:00100000:3.0:1788813274.683636:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583715712 00000100:00100000:3.0:1788813274.683900:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788813274.683911:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e9e898af pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+3:6329:x1875706583715712:12345-0@lo:104: 00010000:00010000:3.0:1788813274.683924:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: 00000000dc3b4b05/0x6d74dbab2ddb152a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb1531 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813274.683993:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788813274.683998:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e9e898af pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+3:6329:x1875706583715712:12345-0@lo:104: Request processed in 90us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813274.684004:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788813274.684028:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813274.684033:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: 00000000dc3b4b05/0x6d74dbab2ddb152a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb1531 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813274.684040:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dc3b4b05 already unused, calling callback (00000000504c0d05) 10000000:00010000:3.0:1788813274.684042:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: 00000000dc3b4b05/0x6d74dbab2ddb152a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb1531 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813274.684050:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: 00000000dc3b4b05/0x6d74dbab2ddb152a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb1531 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813274.684055:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: 00000000dc3b4b05/0x6d74dbab2ddb152a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb1531 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813274.684060:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788813274.684095:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: 00000000dc3b4b05/0x6d74dbab2ddb152a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1531 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813274.684102:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813274.684119:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: 00000000dc3b4b05/0x6d74dbab2ddb152a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1531 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813274.684124:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: 00000000dc3b4b05/0x6d74dbab2ddb152a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1531 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813274.684140:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813274.684142:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813274.684143:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813274.684156:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813274.684165:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004bfdc49a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583715840:0@lo:103: 00000100:00100000:3.0:1788813274.684192:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813274.684286:0:6329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000de541739 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6329:1875706583715712:0@lo:104: 00010000:00010000:2.0:1788813274.684306:0:6329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003e2f7e9e/0x6d74dbab2ddb1570 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813274.685457:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583715840 00000100:00100000:0.0:1788813274.685469:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583715840 00010000:00010000:0.0:1788813274.685500:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000078a86493/0x6d74dbab2ddb1531 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb152a expref: 12 pid: 5841 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813274.685536:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788813274.685544:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cf73180c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:3318:x1875706583715840:12345-0@lo:103: 00010000:00010000:0.0:1788813274.685557:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813274.685562:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000078a86493/0x6d74dbab2ddb1531 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb152a expref: 12 pid: 5841 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813274.685616:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000078a86493/0x6d74dbab2ddb1531 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb152a expref: 12 pid: 5841 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813274.685630:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000078a86493/0x6d74dbab2ddb1531 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb152a expref: 12 pid: 5841 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813274.685643:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003e2f7e9e/0x6d74dbab2ddb1570 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813274.685650:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003e2f7e9e/0x6d74dbab2ddb1570 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813274.685666:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003e2f7e9e/0x6d74dbab2ddb1570 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813274.685672:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003e2f7e9e/0x6d74dbab2ddb1570 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813274.685678:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003e2f7e9e/0x6d74dbab2ddb1570 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813274.685702:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003e2f7e9e/0x6d74dbab2ddb1570 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813274.685708:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003e2f7e9e already unused, calling callback (000000004bef8063) 00010000:00010000:0.0:1788813274.685711:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003e2f7e9e/0x6d74dbab2ddb1570 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813274.685719:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003e2f7e9e/0x6d74dbab2ddb1570 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813274.685759:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003e2f7e9e/0x6d74dbab2ddb1570 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813274.685769:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813274.685838:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cf73180c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:3318:x1875706583715840:12345-0@lo:103: Request processed in 295us (1644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813274.685846:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788813274.685887:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004bfdc49a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583715840:0@lo:103: 00010000:00010000:1.0:1788813274.686145:0:6329:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003e2f7e9e/0x6d74dbab2ddb1570 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813274.686154:0:6329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003e2f7e9e/0x6d74dbab2ddb1570 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813274.686159:0:6329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003e2f7e9e/0x6d74dbab2ddb1570 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813274.815612:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813275.838848:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813276.860831:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813277.890811:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813278.401269:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b65c6b5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583715968:0@lo:400: 00000100:00100000:1.0:1788813278.401374:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813278.401443:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813278.401471:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000084af8e1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583716096:0@lo:400: 00000100:00100000:1.0:1788813278.401502:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813278.401503:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583715968 00000100:00100000:2.0:1788813278.401512:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583715968 00000100:00100000:1.0:1788813278.401545:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583716096 00000100:00100000:1.0:1788813278.401549:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583716096 00000100:00100000:2.0:1788813278.401558:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788813278.401565:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e99b56f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:3320:x1875706583715968:12345-0@lo:400: 00000100:00100000:1.0:1788813278.401575:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813278.401604:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ee012949 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583716096:12345-0@lo:400: 00000100:00100000:1.0:1788813278.401651:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ee012949 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583716096:12345-0@lo:400: Request processed in 49us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813278.401669:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813278.401712:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e99b56f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:3320:x1875706583715968:12345-0@lo:400: Request processed in 148us (339us total) trans 0 rc 0/0 00010000:00080000:1.0:1788813278.401712:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000084af8e1b x1875706583716096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813278.401719:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788813278.401726:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000084af8e1b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583716096:0@lo:400: 00000100:00100000:1.0:1788813278.401734:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b65c6b5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583715968:0@lo:400: 00010000:00010000:2.0:1788813278.922792:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788813279.425100:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788813279.425107:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff908781c96000 from 1 10000000:01000000:0.0:1788813279.425111:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788813279.425157:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: 000000006db76c5b/0x6d74dbab2ddb1577 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813279.425170:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: 000000006db76c5b/0x6d74dbab2ddb1577 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813279.425181:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: 000000006db76c5b/0x6d74dbab2ddb1577 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813279.425204:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc6fd8b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583716224:0@lo:101: 00000100:00100000:0.0:1788813279.425274:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813279.425324:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set 0000000003ceac73 going to sleep for 11 seconds 00000100:00100000:3.0:1788813279.425802:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583716224 00000100:00100000:3.0:1788813279.425812:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583716224 00000100:00100000:3.0:1788813279.425862:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788813279.425872:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000018b7c77a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:5846:x1875706583716224:12345-0@lo:101: 00010000:00010000:3.0:1788813279.425888:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813279.425902:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c33b0b37/0x6d74dbab2ddb157e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb1577 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813279.425927:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c33b0b37/0x6d74dbab2ddb157e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1577 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813279.425938:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c33b0b37/0x6d74dbab2ddb157e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1577 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813279.425946:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c33b0b37, rc 0) 00000100:00100000:3.0:1788813279.425999:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000018b7c77a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:5846:x1875706583716224:12345-0@lo:101: Request processed in 128us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813279.426006:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788813279.427473:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc6fd8b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583716224:0@lo:101: 00010000:00010000:0.0:1788813279.427497:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: 000000006db76c5b/0x6d74dbab2ddb1577 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb157e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813279.427510:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: 000000006db76c5b/0x6d74dbab2ddb1577 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb157e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813279.429295:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc6fd8b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583716352:0@lo:501: 00000100:00100000:0.0:1788813279.429369:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813279.429423:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set 0000000003ceac73 going to sleep for 11 seconds 00000100:00100000:3.0:1788813279.429508:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583716352 00000100:00100000:3.0:1788813279.429517:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583716352 00000100:00100000:3.0:1788813279.429575:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788813279.429606:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000463a082 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:5846:x1875706583716352:12345-0@lo:501: 00000100:00100000:3.0:1788813279.429907:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000463a082 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:5846:x1875706583716352:12345-0@lo:501: Request processed in 302us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813279.429915:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788813279.429947:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc6fd8b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583716352:0@lo:501: 00000100:00100000:0.0:1788813279.429999:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc6fd8b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583716480:0@lo:503: 00000100:00100000:0.0:1788813279.430038:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813279.430069:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set 0000000003ceac73 going to sleep for 11 seconds 00000100:00100000:3.0:1788813279.430175:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583716480 00000100:00100000:3.0:1788813279.430180:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583716480 00000100:00100000:3.0:1788813279.430211:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788813279.430218:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002f9c1af4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:5846:x1875706583716480:12345-0@lo:503: 00000100:00100000:3.0:1788813279.430375:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002f9c1af4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:5846:x1875706583716480:12345-0@lo:503: Request processed in 157us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813279.430382:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788813279.430441:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc6fd8b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583716480:0@lo:503: 00000100:00100000:3.0:1788813279.430765:0:6621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009f295d99 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:6621:1875706583716608:0@lo:502: 00000100:00100000:3.0:1788813279.430802:0:6621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813279.430827:0:6621:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aa44faed going to sleep for 11 seconds 00000100:00100000:0.0:1788813279.430893:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583716608 00000100:00100000:0.0:1788813279.430898:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583716608 00000100:00100000:0.0:1788813279.430928:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788813279.430934:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000040a38131 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:6621:x1875706583716608:12345-0@lo:502: 00000100:00100000:0.0:1788813279.431083:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000040a38131 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:6621:x1875706583716608:12345-0@lo:502: Request processed in 149us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813279.431090:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788813279.431126:0:6621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009f295d99 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:6621:1875706583716608:0@lo:502: 00000020:01000000:0.0:1788813279.431172:0:6621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813279.431182:0:6621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813279.431184:0:6621:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788813279.431191:0:6621:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff908781c96000 00000020:00000080:0.0:1788813279.431193:0:6621:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788813279.431232:0:6621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:6621:1875706583716736:0@lo:502: 00000100:00100000:0.0:1788813279.431265:0:6621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813279.431286:0:6621:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876016b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788813279.431555:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583716736 00000100:00100000:3.0:1788813279.431560:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583716736 00000100:00100000:3.0:1788813279.431604:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788813279.431611:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:6621:x1875706583716736:12345-0@lo:502: 00000100:00100000:3.0:1788813279.431747:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:6621:x1875706583716736:12345-0@lo:502: Request processed in 136us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813279.431753:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788813279.432089:0:6621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:6621:1875706583716736:0@lo:502: 00000020:01000000:0.0:1788813279.432111:0:6621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813279.432118:0:6621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813279.432120:0:6621:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788813279.432124:0:6621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788813279.432561:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788813279.432598:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788813279.432610:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740030a00/0x6d74dbab2ddb1577 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb157e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813279.432623:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908740030a00/0x6d74dbab2ddb1577 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb157e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813279.934235:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813280.957305:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788813281.701717:0:6702:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788813281.701721:0:6702:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788813281.701949:0:6702:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff908774402000 00000020:01000004:1.0:1788813281.701964:0:6702:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788813281.701976:0:6702:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788813281.701998:0:6702:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff90876fac0000) 00000020:00000080:1.0:1788813281.702014:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788813281.731365:0:6702:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788813281.732383:0:6702:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788813281.769225:0:6702:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788813281.779945:0:6702:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788813281.779983:0:6702:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788813281.780049:0:6702:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788813281.780078:0:6702:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788813281.780556:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788813281.780567:0:6702:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788813281.780616:0:6702:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6d74dbab2ddb158c 00000020:01000004:3.0:1788813281.780634:0:6702:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788813281.780657:0:6702:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.147@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788813281.780660:0:6702:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.147@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788813281.780666:0:6702:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788813281.780670:0:6702:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788813281.780681:0:6702:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90877c3f8000) 00000020:00000080:3.0:1788813281.780690:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788813281.785365:0:6702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813281.785566:0:6702:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788813281.785572:0:6702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788813281.787375:0:6702:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788813281.787386:0:6702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788813281.788080:0:6702:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788813281.788096:0:6702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788813281.792960:0:6702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813281.793172:0:6702:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788813281.793178:0:6702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788813281.808725:0:6702:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788813281.809402:0:6702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788813281.887645:0:6702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788813281.888095:0:6702:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788813281.888103:0:6702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788813281.889410:0:6702:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788813281.889421:0:6702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788813281.890948:0:6702:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788813281.890964:0:6702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788813281.893944:0:6702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813281.894532:0:6702:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788813281.894539:0:6702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788813281.900411:0:6702:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788813281.900430:0:6702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:1.0:1788813281.982283:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813281.996309:0:6702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813281.996635:0:6702:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788813281.996642:0:6702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788813282.000315:0:6702:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788813282.000331:0:6702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788813282.000977:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788813282.001003:0:6702:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788813282.001010:0:6702:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.147@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788813282.059395:0:6702:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.147@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788813282.059436:0:6702:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.147@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1788813282.059526:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788813282.059528:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788813282.059530:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788813282.059531:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788813282.059532:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788813282.059534:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788813282.059535:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788813282.059537:0:6702:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788813282.059539:0:6702:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788813282.059541:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788813282.059543:0:6702:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788813282.059552:0:6702:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1788813282.059555:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788813282.059556:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788813282.059557:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788813282.059558:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788813282.059559:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788813282.059560:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788813282.059561:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788813282.059562:0:6702:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788813282.059563:0:6702:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788813282.059564:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788813282.059564:0:6702:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788813282.059685:0:6702:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788813282.059706:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583716864:0@lo:253: 00000100:00100000:0.0:1788813282.060073:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813282.060241:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749c510c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813282.061858:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583716864 00000100:00100000:3.0:1788813282.061874:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583716864 00000100:00100000:3.0:1788813282.061976:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788813282.061988:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:6702:x1875706583716864:12345-0@lo:253: 20000000:01000000:3.0:1788813282.062059:0:5843:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788813282.062064:0:5843:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1788813282.062070:0:5843:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1788813282.062073:0:5843:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1788813282.063709:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788813282.064219:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788813282.064239:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1788813282.064286:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1788813282.064295:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1788813282.064329:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1788813282.064379:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1788813282.066068:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788813282.066182:0:5843:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.147@tcp 20000000:01000000:3.0:1788813282.066185:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.147@tcp (null) (null) (null) 00000040:00080000:3.0:1788813282.066228:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788813282.066236:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788813282.067362:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788813282.067379:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.147@tcp (null) (null) 00000040:00080000:3.0:1788813282.069874:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788813282.069901:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788813282.069960:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788813282.070064:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1788813282.076407:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788813282.076440:0:5843:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.147@tcp 20000000:01000000:3.0:1788813282.076453:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.147@tcp (null) (null) (null) 00000040:00080000:3.0:1788813282.076498:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788813282.076506:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788813282.076539:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788813282.076546:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.147@tcp (null) (null) 00000040:00080000:3.0:1788813282.076641:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788813282.076654:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788813282.076689:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1788813282.076727:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1788813282.076744:0:5843:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788813282.076747:0:5843:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788813282.076751:0:5843:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788813282.076765:0:5843:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788813282.076768:0:5843:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788813282.076805:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788813282.076808:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788813282.078802:0:6717:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1788813282.078891:0:6717:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1788813282.078961:0:6717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788813282.079433:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788813282.080051:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788813282.080389:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788813282.080409:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788813282.080412:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788813282.081986:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1788813282.082401:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1788813282.082462:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1788813282.082537:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1788813282.082552:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788813282.082555:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788813282.085090:0:6719:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788813282.085176:0:6719:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788813282.085232:0:6719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788813282.086098:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1788813282.086145:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1788813282.086180:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1788813282.086198:0:5843:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1788813282.086200:0:5843:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1788813282.086209:0:5843:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788813282.086229:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff908740030200/0x6d74dbab2ddb159a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813282.086248:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff908740031a00/0x6d74dbab2ddb14b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb14ac expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813282.086257:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff908750ad0000/0x6d74dbab2ddb14cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb14c8 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813282.086264:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90874148c600/0x6d74dbab2ddb153f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1538 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813282.086269:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff908740030200/0x6d74dbab2ddb159a lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813282.086318:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90874148c600/0x6d74dbab2ddb153f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb1538 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813282.086334:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90874148c600/0x6d74dbab2ddb153f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1538 expref: 12 pid: 5841 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813282.086349:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1875706583716992:0@lo:104: 00000100:00100000:0.0:1788813282.086416:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788813282.086499:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff908750ad0000/0x6d74dbab2ddb14cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb14c8 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813282.086508:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff908750ad0000/0x6d74dbab2ddb14cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb14c8 expref: 12 pid: 5844 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813282.086517:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1875706583717120:0@lo:104: 00000100:00100000:0.0:1788813282.086558:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813282.086733:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583716992 00000100:00100000:1.0:1788813282.086740:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583716992 00000100:00100000:1.0:1788813282.086777:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583717120 00000100:00100000:1.0:1788813282.086780:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583717120 00000100:00100000:1.0:1788813282.086794:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813282.086802:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+4:5843:x1875706583716992:12345-0@lo:104: 00010000:00010000:1.0:1788813282.086822:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff90874148ce00/0x6d74dbab2ddb1538 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb153f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.086880:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788813282.086887:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+4:5843:x1875706583716992:12345-0@lo:104: Request processed in 85us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813282.086893:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813282.086913:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813282.086920:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+3:5843:x1875706583717120:12345-0@lo:104: 00010000:00010000:1.0:1788813282.086927:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff9087413a0200/0x6d74dbab2ddb14c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb14cf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.086962:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788813282.086967:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+3:5843:x1875706583717120:12345-0@lo:104: Request processed in 48us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813282.086972:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788813282.086988:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813282.086994:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff90874148ce00/0x6d74dbab2ddb1538 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb153f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.087000:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148ce00 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:1.0:1788813282.087004:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff90874148ce00/0x6d74dbab2ddb1538 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb153f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.087013:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff90874148ce00/0x6d74dbab2ddb1538 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb153f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813282.087020:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff90874148ce00/0x6d74dbab2ddb1538 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb153f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813282.087033:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788813282.087061:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff90874148ce00/0x6d74dbab2ddb1538 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb153f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.087068:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813282.087087:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff90874148ce00/0x6d74dbab2ddb1538 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb153f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.087094:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff90874148ce00/0x6d74dbab2ddb1538 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb153f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.087106:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813282.087109:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff9087413a0200/0x6d74dbab2ddb14c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb14cf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.087115:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a0200 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:1.0:1788813282.087118:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff9087413a0200/0x6d74dbab2ddb14c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb14cf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.087124:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff9087413a0200/0x6d74dbab2ddb14c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb14cf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813282.087130:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff9087413a0200/0x6d74dbab2ddb14c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb14cf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813282.087134:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788813282.087146:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff9087413a0200/0x6d74dbab2ddb14c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb14cf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.087150:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813282.087161:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff9087413a0200/0x6d74dbab2ddb14c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb14cf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.087167:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff9087413a0200/0x6d74dbab2ddb14c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb14cf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.087177:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813282.087179:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813282.087180:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813282.087201:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583717248:0@lo:103: 00000100:00100000:1.0:1788813282.087229:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813282.087258:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788813282.087264:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583717376:0@lo:103: 00000100:00100000:1.0:1788813282.087283:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813282.087313:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583717248 00000100:00100000:1.0:1788813282.087317:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583717248 00010000:00010000:1.0:1788813282.087333:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90874148c600/0x6d74dbab2ddb153f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1538 expref: 13 pid: 5841 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813282.087351:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583717376 00000100:00100000:1.0:1788813282.087354:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583717376 00010000:00010000:1.0:1788813282.087363:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff908750ad0000/0x6d74dbab2ddb14cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb14c8 expref: 14 pid: 5844 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813282.087376:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813282.087381:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:3318:x1875706583717248:12345-0@lo:103: 00010000:00010000:1.0:1788813282.087390:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813282.087394:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90874148c600/0x6d74dbab2ddb153f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1538 expref: 14 pid: 5841 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.087415:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90874148c600/0x6d74dbab2ddb153f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1538 expref: 14 pid: 5841 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.087431:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813282.087458:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:3318:x1875706583717248:12345-0@lo:103: Request processed in 77us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813282.087465:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813282.087478:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813282.087484:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:3318:x1875706583717376:12345-0@lo:103: 00010000:00010000:1.0:1788813282.087492:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813282.087496:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff908750ad0000/0x6d74dbab2ddb14cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb14c8 expref: 13 pid: 5844 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.087505:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff908750ad0000/0x6d74dbab2ddb14cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb14c8 expref: 13 pid: 5844 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.087514:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813282.087535:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:3318:x1875706583717376:12345-0@lo:103: Request processed in 52us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813282.087541:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813282.087574:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583717376:0@lo:103: 00000100:00100000:1.0:1788813282.087624:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583717248:0@lo:103: 00010000:00010000:2.0:1788813282.087695:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813282.087949:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff908740031a00/0x6d74dbab2ddb14b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb14ac expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813282.087961:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff908740031a00/0x6d74dbab2ddb14b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb14ac expref: 12 pid: 5843 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813282.087970:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1875706583717504:0@lo:104: 00000100:00100000:0.0:1788813282.088000:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813282.088035:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749c51f00 going to sleep for 11 seconds 00010000:00010000:0.0:1788813282.088050:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90874148c600/0x6d74dbab2ddb153f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb1538 expref: 12 pid: 5841 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813282.088060:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1875706583716992:0@lo:104: 00010000:00010000:0.0:1788813282.088080:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908750ad0000/0x6d74dbab2ddb14cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb14c8 expref: 11 pid: 5844 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813282.088090:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1875706583717120:0@lo:104: 00000100:00100000:1.0:1788813282.088735:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583717504 00000100:00100000:1.0:1788813282.088743:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583717504 00000100:00100000:1.0:1788813282.088807:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813282.088817:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+3:5843:x1875706583717504:12345-0@lo:104: 00010000:00010000:1.0:1788813282.088842:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff90874148de00/0x6d74dbab2ddb14ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb14b3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.088915:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788813282.088921:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+3:5843:x1875706583717504:12345-0@lo:104: Request processed in 107us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813282.088928:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788813282.088951:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813282.088955:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff90874148de00/0x6d74dbab2ddb14ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb14b3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.088962:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148de00 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:1.0:1788813282.088965:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff90874148de00/0x6d74dbab2ddb14ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb14b3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.088973:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff90874148de00/0x6d74dbab2ddb14ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb14b3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813282.088980:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff90874148de00/0x6d74dbab2ddb14ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb14b3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813282.088986:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788813282.089014:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff90874148de00/0x6d74dbab2ddb14ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb14b3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.089020:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813282.089037:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff90874148de00/0x6d74dbab2ddb14ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb14b3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.089043:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff90874148de00/0x6d74dbab2ddb14ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb14b3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.089067:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813282.089069:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813282.089070:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813282.089268:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583717632:0@lo:103: 00000100:00100000:1.0:1788813282.089303:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813282.089390:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583717632 00000100:00100000:3.0:1788813282.089395:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583717632 00010000:00010000:3.0:1788813282.089415:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff908740031a00/0x6d74dbab2ddb14b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb14ac expref: 11 pid: 5843 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813282.089473:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788813282.089480:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:3320:x1875706583717632:12345-0@lo:103: 00010000:00010000:3.0:1788813282.089491:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813282.089496:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff908740031a00/0x6d74dbab2ddb14b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb14ac expref: 11 pid: 5843 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813282.089505:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff908740031a00/0x6d74dbab2ddb14b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb14ac expref: 11 pid: 5843 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813282.089519:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff908740030200/0x6d74dbab2ddb159a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813282.089527:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908740030200/0x6d74dbab2ddb159a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813282.089543:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff908740030200/0x6d74dbab2ddb159a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813282.089550:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff908740030200/0x6d74dbab2ddb159a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813282.089555:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff908740030200/0x6d74dbab2ddb159a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813282.089561:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff908740030200/0x6d74dbab2ddb159a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813282.089566:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740030200 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:3.0:1788813282.089570:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff908740030200/0x6d74dbab2ddb159a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813282.089616:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff908740030200/0x6d74dbab2ddb159a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813282.089635:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff908740030200/0x6d74dbab2ddb159a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813282.089646:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813282.089679:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:3320:x1875706583717632:12345-0@lo:103: Request processed in 200us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813282.089686:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788813282.090102:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908740031a00/0x6d74dbab2ddb14b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb14ac expref: 10 pid: 5843 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813282.090116:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5843:1875706583717504:0@lo:104: 00010000:00010000:0.0:1788813282.090139:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff908740030200/0x6d74dbab2ddb159a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813282.090147:0:5843:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff908740030200/0x6d74dbab2ddb159a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813282.090153:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff908740030200/0x6d74dbab2ddb159a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813282.090160:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908740030200/0x6d74dbab2ddb159a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788813282.090174:0:5843:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788813282.090343:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583717632:0@lo:103: 00000100:00100000:2.0:1788813282.148042:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+9:6702:x1875706583716864:12345-0@lo:253: Request processed in 86045us (88248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813282.148056:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788813282.148295:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583716864:0@lo:253: 10000000:01000000:0.0:1788813282.148312:0:6702:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788813282.148315:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788813282.148317:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788813282.148319:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788813282.148321:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788813282.148322:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788813282.148323:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788813282.148325:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788813282.148326:0:6702:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788813282.148344:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788813282.148346:0:6702:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788813282.148365:0:6702:0:(tgt_mount.c:101:server_register_mount()) register mount ffff908774402000 from lustre-OST0000 10000000:01000000:0.0:1788813282.148392:0:6702:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788813282.148395:0:6702:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788813282.148403:0:6702:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff908749b5cd40 local copy 10000000:01000000:0.0:1788813282.148406:0:6702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788813282.148523:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb15a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813282.148880:0:6702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb15a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813282.148892:0:6702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb15a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813282.148913:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583717760:0@lo:101: 00000100:00100000:0.0:1788813282.148956:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813282.149053:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749c51000 going to sleep for 11 seconds 00000100:00100000:3.0:1788813282.149263:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583717760 00000100:00100000:3.0:1788813282.149271:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583717760 00000100:00100000:3.0:1788813282.149368:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788813282.149380:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+9:6702:x1875706583717760:12345-0@lo:101: 00010000:00010000:3.0:1788813282.149398:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813282.149417:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908750ad1000/0x6d74dbab2ddb15a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb15a1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813282.149525:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908750ad1000/0x6d74dbab2ddb15a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb15a1 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813282.149540:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908750ad1000/0x6d74dbab2ddb15a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb15a1 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813282.149551:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad1000, rc 0) 00000100:00100000:3.0:1788813282.149633:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+10:6702:x1875706583717760:12345-0@lo:101: Request processed in 256us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813282.149639:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788813282.149732:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583717760:0@lo:101: 00010000:00010000:0.0:1788813282.149747:0:6702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb15a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x6d74dbab2ddb15a8 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813282.149757:0:6702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb15a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6d74dbab2ddb15a8 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813282.149884:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583717888:0@lo:501: 00000100:00100000:0.0:1788813282.149911:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813282.150333:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749c51000 going to sleep for 11 seconds 00000100:00100000:1.0:1788813282.150413:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583717888 00000100:00100000:1.0:1788813282.150419:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583717888 00000100:00100000:1.0:1788813282.150464:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788813282.150472:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+10:6702:x1875706583717888:12345-0@lo:501: 00000100:00100000:1.0:1788813282.150770:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+10:6702:x1875706583717888:12345-0@lo:501: Request processed in 285us (844us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788813282.150778:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788813282.151095:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583717888:0@lo:501: 10000000:01000000:0.0:1788813282.151136:0:6702:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.147@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788813282.151173:0:6702:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.147@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788813282.151182:0:6702:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb15a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6d74dbab2ddb15a8 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813282.151192:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb15a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6d74dbab2ddb15a8 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813282.151201:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb15a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6d74dbab2ddb15a8 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813282.151227:0:6702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788813282.151250:0:6702:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff908774402000 10000000:01000000:0.0:1788813282.151256:0:6702:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788813282.151264:0:6702:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff908749b5cd40 10000000:01000000:0.0:1788813282.151267:0:6702:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788813282.151270:0:6702:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff908749b5cd40 from 1 10000000:01000000:0.0:1788813282.151273:0:6702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788813282.151301:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031a00/0x6d74dbab2ddb15af lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813282.151308:0:6702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908740031a00/0x6d74dbab2ddb15af lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813282.151317:0:6702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908740031a00/0x6d74dbab2ddb15af lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813282.151333:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583718016:0@lo:101: 00000100:00100000:0.0:1788813282.151367:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813282.151396:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749c51c00 going to sleep for 11 seconds 00010000:00010000:1.0:1788813282.151658:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813282.151667:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb15a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x6d74dbab2ddb15a8 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.151675:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740030200 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:1.0:1788813282.151679:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb15a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x6d74dbab2ddb15a8 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.151687:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb15a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x6d74dbab2ddb15a8 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813282.151695:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb15a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x6d74dbab2ddb15a8 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813282.151712:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788813282.151732:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb15a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x6d74dbab2ddb15a8 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.151738:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813282.151768:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb15a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x6d74dbab2ddb15a8 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.151775:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb15a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x6d74dbab2ddb15a8 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.151791:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813282.151793:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813282.151796:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813282.151804:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813282.151817:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583718144:0@lo:103: 00000100:00100000:1.0:1788813282.151853:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813282.151892:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583718144 00000100:00100000:1.0:1788813282.151898:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583718144 00000100:00100000:1.0:1788813282.151939:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813282.151946:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd1fd158-af17-4a1b-8f0b-82e57114d008+10:3320:x1875706583718144:12345-0@lo:103: 00010000:00010000:1.0:1788813282.151957:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813282.151968:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908750ad1000/0x6d74dbab2ddb15a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d74dbab2ddb15a1 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.151981:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813282.152008:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd1fd158-af17-4a1b-8f0b-82e57114d008+9:3320:x1875706583718144:12345-0@lo:103: Request processed in 62us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813282.152025:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813282.152054:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583718144:0@lo:103: 00000100:00100000:1.0:1788813282.152070:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583718016 00000100:00100000:1.0:1788813282.152086:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583718016 00000100:00100000:1.0:1788813282.152102:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788813282.152116:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+9:6702:x1875706583718016:12345-0@lo:101: 00010000:00010000:1.0:1788813282.152126:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813282.152137:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90874148de00/0x6d74dbab2ddb15b6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb15af expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.152154:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90874148de00/0x6d74dbab2ddb15b6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb15af expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.152165:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90874148de00/0x6d74dbab2ddb15b6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb15af expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.152171:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148de00, rc 0) 00000100:00100000:1.0:1788813282.152198:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+10:6702:x1875706583718016:12345-0@lo:101: Request processed in 83us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813282.152204:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788813282.152525:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583718016:0@lo:101: 00010000:00010000:0.0:1788813282.152540:0:6702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908740031a00/0x6d74dbab2ddb15af lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb15b6 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813282.152549:0:6702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908740031a00/0x6d74dbab2ddb15af lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb15b6 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813282.152566:0:6702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788813282.152617:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031a00/0x6d74dbab2ddb15af lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb15b6 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813282.152625:0:6702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908740031a00/0x6d74dbab2ddb15af lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb15b6 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813282.152633:0:6702:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788813282.152638:0:6702:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788813282.152644:0:6702:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788813282.152646:0:6702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788813282.152663:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb15bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813282.152670:0:6702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb15bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813282.152679:0:6702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb15bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813282.152692:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583718272:0@lo:101: 00000100:00100000:0.0:1788813282.152720:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813282.152742:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749c51c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813282.152827:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583718272 00000100:00100000:1.0:1788813282.152832:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583718272 00000100:00100000:1.0:1788813282.152851:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788813282.152858:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+10:6702:x1875706583718272:12345-0@lo:101: 00010000:00010000:1.0:1788813282.152866:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813282.152875:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb15c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb15bd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.152902:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb15c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb15bd expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.152910:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb15c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb15bd expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.152917:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148ce00, rc 0) 00000100:00100000:1.0:1788813282.152946:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:6702:x1875706583718272:12345-0@lo:101: Request processed in 88us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813282.152951:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788813282.153031:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583718272:0@lo:101: 00010000:00010000:0.0:1788813282.153041:0:6702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb15bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb15c4 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813282.153049:0:6702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb15bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb15c4 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813282.153283:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583718400:0@lo:501: 00000100:00100000:0.0:1788813282.153309:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813282.153341:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749c51c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813282.153406:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583718400 00000100:00100000:1.0:1788813282.153411:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583718400 00000100:00100000:1.0:1788813282.153430:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788813282.153525:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:6702:x1875706583718400:12345-0@lo:501: 00000100:00100000:1.0:1788813282.153798:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:6702:x1875706583718400:12345-0@lo:501: Request processed in 359us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813282.153806:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788813282.153961:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583718400:0@lo:501: 00000100:00100000:0.0:1788813282.153989:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583718528:0@lo:503: 00000100:00100000:0.0:1788813282.154031:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813282.154060:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749c51c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813282.154252:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583718528 00000100:00100000:1.0:1788813282.154257:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583718528 00000100:00100000:1.0:1788813282.154291:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788813282.154298:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:6702:x1875706583718528:12345-0@lo:503: 00000100:00100000:1.0:1788813282.154631:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:6702:x1875706583718528:12345-0@lo:503: Request processed in 331us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813282.154638:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788813282.154765:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583718528:0@lo:503: 00000040:00080000:0.0:1788813282.155064:0:6702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788813282.155308:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583718656:0@lo:502: 00000100:00100000:0.0:1788813282.155355:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813282.155452:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749c51c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813282.155618:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583718656 00000100:00100000:2.0:1788813282.155625:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583718656 00000100:00100000:2.0:1788813282.156059:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788813282.156070:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:6702:x1875706583718656:12345-0@lo:502: 00000100:00100000:2.0:1788813282.156307:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:6702:x1875706583718656:12345-0@lo:502: Request processed in 238us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813282.156314:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788813282.156390:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583718656:0@lo:502: 00000040:00080000:0.0:1788813282.156725:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788813282.156780:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788813282.156817:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788813282.156867:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788813282.156904:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788813282.156937:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788813282.156978:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583718784:0@lo:502: 00000100:00100000:0.0:1788813282.157021:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813282.157792:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749c51c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813282.157911:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583718784 00000100:00100000:1.0:1788813282.157919:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583718784 00000100:00100000:1.0:1788813282.157963:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788813282.157985:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:6702:x1875706583718784:12345-0@lo:502: 00000100:00100000:1.0:1788813282.158375:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:6702:x1875706583718784:12345-0@lo:502: Request processed in 390us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813282.158384:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788813282.158629:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583718784:0@lo:502: 00000040:00080000:0.0:1788813282.158778:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788813282.158795:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1788813282.159726:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788813282.159736:0:6720:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788813282.159744:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813282.159746:0:6720:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788813282.159752:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788813282.159771:0:6720:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff90876f9ccd40) 00000020:00000080:0.0:1788813282.159810:0:6720:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788813282.159819:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788813282.161374:0:6720:0:(tgt_mount.c:153:server_get_mount()) get mount ffff908774402000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788813282.161389:0:6720:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788813282.161399:0:6720:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6d74dbab2ddb15d2 00010000:00010000:1.0:1788813282.167751:0:6720:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1788813282.168073:0:6720:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788813282.175490:0:6720:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788813282.175904:0:6720:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788813282.186559:0:6720:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788813282.188119:0:6720:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788813282.189717:0:6720:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788813282.189729:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813282.189735:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813282.189737:0:6720:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788813282.189740:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813282.189744:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813282.189746:0:6720:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788813282.189749:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788813282.189751:0:6720:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788813282.191258:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813282.191268:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813282.191270:0:6720:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788813282.191274:0:6720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788813282.201530:0:6702:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788813282.201608:0:6702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788813282.201633:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb15bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb15c4 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813282.201648:0:6702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb15bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb15c4 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813282.201658:0:6702:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff908774402000 from 1 10000000:01000000:2.0:1788813282.201661:0:6702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788813282.201707:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff9087413a0200/0x6d74dbab2ddb15d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813282.201716:0:6702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff9087413a0200/0x6d74dbab2ddb15d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813282.201728:0:6702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff9087413a0200/0x6d74dbab2ddb15d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813282.201754:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583718912:0@lo:101: 00000100:00100000:2.0:1788813282.201824:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813282.201874:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff908781d12000 going to sleep for 11 seconds 00000100:00100000:1.0:1788813282.203461:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583718912 00000100:00100000:1.0:1788813282.203477:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583718912 00000100:00100000:1.0:1788813282.203534:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788813282.203544:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:6702:x1875706583718912:12345-0@lo:101: 00010000:00010000:1.0:1788813282.203563:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813282.203615:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90874148d600/0x6d74dbab2ddb15e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb15d9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.203644:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90874148d600/0x6d74dbab2ddb15e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb15d9 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.203655:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90874148d600/0x6d74dbab2ddb15e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb15d9 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.203663:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148d600, rc 0) 00000100:00100000:1.0:1788813282.203754:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:6702:x1875706583718912:12345-0@lo:101: Request processed in 211us (1930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813282.203760:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788813282.203958:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583718912:0@lo:101: 00010000:00010000:3.0:1788813282.203979:0:6702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff9087413a0200/0x6d74dbab2ddb15d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb15e0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813282.203989:0:6702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff9087413a0200/0x6d74dbab2ddb15d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb15e0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813282.204224:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583719040:0@lo:501: 00000100:00100000:3.0:1788813282.204279:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813282.204367:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c234000 going to sleep for 11 seconds 00000100:00100000:2.0:1788813282.206898:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583719040 00000100:00100000:2.0:1788813282.206913:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583719040 00000100:00100000:2.0:1788813282.206997:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788813282.207019:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:6702:x1875706583719040:12345-0@lo:501: 00000100:00100000:2.0:1788813282.207437:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:6702:x1875706583719040:12345-0@lo:501: Request processed in 419us (3155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813282.207446:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788813282.207564:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583719040:0@lo:501: 00000100:00100000:3.0:1788813282.207661:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583719168:0@lo:503: 00000100:00100000:3.0:1788813282.207708:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813282.208005:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c234000 going to sleep for 11 seconds 00000100:00100000:1.0:1788813282.208066:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583719168 00000100:00100000:1.0:1788813282.208079:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583719168 00000100:00100000:0.0:1788813282.208320:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788813282.208337:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:6702:x1875706583719168:12345-0@lo:503: 00000100:00100000:0.0:1788813282.208727:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:6702:x1875706583719168:12345-0@lo:503: Request processed in 392us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813282.208734:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788813282.208828:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583719168:0@lo:503: 00000040:00080000:3.0:1788813282.209132:0:6702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788813282.209210:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583719296:0@lo:502: 00000100:00100000:3.0:1788813282.209255:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813282.209562:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c234000 going to sleep for 11 seconds 00000100:00100000:1.0:1788813282.209681:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583719296 00000100:00100000:1.0:1788813282.209687:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583719296 00000100:00100000:1.0:1788813282.209718:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788813282.209727:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90875243bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:6702:x1875706583719296:12345-0@lo:502: 00000100:00100000:1.0:1788813282.209918:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90875243bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:6702:x1875706583719296:12345-0@lo:502: Request processed in 191us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813282.209926:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788813282.210017:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583719296:0@lo:502: 00000040:00080000:3.0:1788813282.210288:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788813282.210343:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788813282.210370:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583719424:0@lo:502: 00000100:00100000:3.0:1788813282.210414:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813282.210446:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c234000 going to sleep for 11 seconds 00000100:00100000:1.0:1788813282.210566:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583719424 00000100:00100000:1.0:1788813282.210572:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583719424 00000100:00100000:1.0:1788813282.210635:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788813282.210642:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:6702:x1875706583719424:12345-0@lo:502: 00000100:00100000:1.0:1788813282.210782:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:6702:x1875706583719424:12345-0@lo:502: Request processed in 140us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813282.210791:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788813282.210904:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583719424:0@lo:502: 00000040:00080000:3.0:1788813282.210989:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788813282.210999:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788813282.211668:0:6724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813282.211678:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813282.211681:0:6724:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788813282.211687:0:6724:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff908774402000 00000020:00000080:2.0:1788813282.211689:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788813282.211706:0:6724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813282.211709:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813282.211710:0:6724:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788813282.211713:0:6724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788813282.211886:0:6702:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788813282.211906:0:6702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788813282.211965:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff9087413a0200/0x6d74dbab2ddb15d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb15e0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813282.211978:0:6702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff9087413a0200/0x6d74dbab2ddb15d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb15e0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813282.212021:0:6702:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788813282.212024:0:6702:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff908774402000 10000000:01000000:3.0:1788813282.212028:0:6702:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff908774402000 10000000:01000000:3.0:1788813282.212031:0:6702:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788813282.212037:0:6702:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff908774402000 from 1 10000000:01000000:3.0:1788813282.212039:0:6702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788813282.212070:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908750ad1c00/0x6d74dbab2ddb15e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813282.212079:0:6702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908750ad1c00/0x6d74dbab2ddb15e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813282.212090:0:6702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908750ad1c00/0x6d74dbab2ddb15e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813282.212194:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583719552:0@lo:101: 00000100:00100000:3.0:1788813282.212247:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813282.212286:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c2343c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813282.212360:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583719552 00000100:00100000:0.0:1788813282.212368:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583719552 00000100:00100000:0.0:1788813282.212414:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788813282.212423:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:6702:x1875706583719552:12345-0@lo:101: 00010000:00010000:0.0:1788813282.212435:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813282.212449:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908740031200/0x6d74dbab2ddb15ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb15e7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813282.212476:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908740031200/0x6d74dbab2ddb15ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb15e7 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813282.212488:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908740031200/0x6d74dbab2ddb15ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb15e7 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813282.212498:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740031200, rc 0) 00000100:00100000:0.0:1788813282.212540:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:6702:x1875706583719552:12345-0@lo:101: Request processed in 118us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813282.212547:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788813282.212699:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583719552:0@lo:101: 00010000:00010000:3.0:1788813282.212714:0:6702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908750ad1c00/0x6d74dbab2ddb15e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb15ee expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813282.212735:0:6702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908750ad1c00/0x6d74dbab2ddb15e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb15ee expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813282.212823:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583719680:0@lo:501: 00000100:00100000:3.0:1788813282.212850:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813282.212871:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c2343c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813282.212888:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583719680 00000100:00100000:3.0:1788813282.212892:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583719680 00000100:00100000:3.0:1788813282.212912:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788813282.212919:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:6702:x1875706583719680:12345-0@lo:501: 00000100:00100000:3.0:1788813282.213222:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:6702:x1875706583719680:12345-0@lo:501: Request processed in 302us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813282.213228:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788813282.213260:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583719680:0@lo:501: 00000100:00100000:3.0:1788813282.213286:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583719808:0@lo:503: 00000100:00100000:3.0:1788813282.213322:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813282.213336:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c2343c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813282.213348:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583719808 00000100:00100000:3.0:1788813282.213351:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583719808 00000100:00100000:3.0:1788813282.213368:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788813282.213373:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:6702:x1875706583719808:12345-0@lo:503: 00000100:00100000:3.0:1788813282.213511:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:6702:x1875706583719808:12345-0@lo:503: Request processed in 137us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813282.213518:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788813282.213555:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583719808:0@lo:503: 00000040:00080000:3.0:1788813282.213846:0:6702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788813282.213909:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583719936:0@lo:502: 00000100:00100000:3.0:1788813282.213946:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813282.213972:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c2343c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813282.213987:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583719936 00000100:00100000:3.0:1788813282.213991:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583719936 00000100:00100000:3.0:1788813282.214011:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788813282.214017:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:6702:x1875706583719936:12345-0@lo:502: 00000100:00100000:3.0:1788813282.214559:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:6702:x1875706583719936:12345-0@lo:502: Request processed in 539us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813282.214568:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788813282.215054:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583719936:0@lo:502: 00000040:00080000:0.0:1788813282.215346:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788813282.215406:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788813282.215441:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788813282.215492:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788813282.215533:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788813282.215646:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788813282.215686:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788813282.215721:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788813282.215782:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788813282.215833:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788813282.215868:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788813282.215915:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788813282.215950:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788813282.215981:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788813282.216032:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788813282.216066:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788813282.216097:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788813282.216151:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788813282.216188:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788813282.216215:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788813282.216255:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788813282.216286:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788813282.216313:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788813282.216353:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788813282.216384:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788813282.216430:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788813282.216478:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788813282.216508:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1788813282.216554:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583720064:0@lo:502: 00000100:00100000:0.0:1788813282.216679:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813282.216721:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749c51c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813282.216912:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583720064 00000100:00100000:2.0:1788813282.216921:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583720064 00000100:00100000:2.0:1788813282.216973:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788813282.216982:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:6702:x1875706583720064:12345-0@lo:502: 00000100:00100000:2.0:1788813282.217237:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:6702:x1875706583720064:12345-0@lo:502: Request processed in 256us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813282.217244:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788813282.217411:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583720064:0@lo:502: 00000040:00080000:1.0:1788813282.217494:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788813282.217505:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788813282.218123:0:6725:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788813282.218140:0:6725:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff90876fac19c0) 00000020:00000080:1.0:1788813282.218161:0:6725:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1788813282.218229:0:6725:0:(tgt_mount.c:153:server_get_mount()) get mount ffff908774402000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788813282.218233:0:6725:0:(tgt_mount.c:187:server_put_mount()) put mount ffff908774402000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788813282.218236:0:6725:0:(obd_mount.c:710:lustre_put_lsi()) put ffff908774402000 3 00010000:00080000:1.0:1788813282.218924:0:6725:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9086413fc800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.147@tcp at head 00010000:00010000:1.0:1788813282.220508:0:6725:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1788813282.220773:0:6725:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788813282.220814:0:6725:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788813282.225767:0:6725:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x6d74dbab2ddb15fc 00000100:00080000:1.0:1788813282.225791:0:6725:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788813282.225808:0:6725:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9086413fc800 using connection 192.168.204.147@tcp/0@lo 00000100:00100000:1.0:1788813282.225850:0:6725:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90877c3e9880 x1875706583720192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813282.225916:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3317:1875706583720192:0@lo:38: 00000100:00100000:2.0:1788813282.225987:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788813282.226052:0:6725:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788813282.226805:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583720192 00000100:00100000:3.0:1788813282.226814:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583720192 00000100:00100000:3.0:1788813282.226851:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788813282.226858:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3317:x1875706583720192:12345-0@lo:38: 00010000:00080000:3.0:1788813282.226885:0:5849:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:3.0:1788813282.226920:0:5849:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x6d74dbab2ddb1603 00000004:00100000:3.0:1788813282.226937:0:5849:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788813282.226968:0:5849:0:(import.c:65:import_set_state_nolock()) ffff908641113800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788813282.228571:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875706583720192:12345-0@lo:38: Request processed in 1706us (2577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813282.228645:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813282.228801:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875706583720320:0@lo:400: 00000100:00100000:1.0:1788813282.228857:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813282.228922:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583720320 00000100:00100000:3.0:1788813282.228930:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583720320 00000100:00100000:3.0:1788813282.228971:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788813282.228979:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875706583720320:12345-0@lo:400: 00010000:00080000:2.0:1788813282.229214:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90877c3e9880 x1875706583720192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813282.229226:0:3317:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788813282.229236:0:3317:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788813282.229243:0:3317:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788813282.229248:0:3317:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788813282.229266:0:3317:0:(import.c:65:import_set_state_nolock()) ffff9086413fc800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788813282.229274:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3317:1875706583720192:0@lo:38: 00000100:00100000:3.0:1788813282.229474:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875706583720320:12345-0@lo:400: Request processed in 495us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813282.229488:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788813282.229565:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90877c3f1880 x1875706583720320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813282.229576:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875706583720320:0@lo:400: 00000040:00080000:3.0:1788813282.230058:0:6725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1788813282.230276:0:6702:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788813282.230307:0:6702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788813282.230331:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908750ad1c00/0x6d74dbab2ddb15e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb15ee expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813282.230343:0:6702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908750ad1c00/0x6d74dbab2ddb15e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb15ee expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788813282.230393:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788813282.230396:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788813282.230397:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813282.230399:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813282.230400:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813282.230401:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813282.230402:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813282.230404:0:6702:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788813282.230405:0:6702:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788813282.230407:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813282.230408:0:6702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788813282.230412:0:6702:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788813282.230415:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788813282.230416:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788813282.230417:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813282.230418:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813282.230419:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813282.230420:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813282.230421:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813282.230422:0:6702:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788813282.230423:0:6702:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788813282.230424:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813282.230425:0:6702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788813282.230459:0:6702:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788813282.230477:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583720448:0@lo:253: 00000100:00100000:2.0:1788813282.230541:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813282.230576:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087464cd300 going to sleep for 11 seconds 00000100:00100000:3.0:1788813282.230669:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583720448 00000100:00100000:3.0:1788813282.230675:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583720448 00000100:00100000:3.0:1788813282.230717:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788813282.230725:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:6702:x1875706583720448:12345-0@lo:253: 20000000:01000000:3.0:1788813282.230748:0:5844:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788813282.230773:0:5844:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788813282.255860:0:5844:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788813282.255884:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788813282.255944:0:5865:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788813282.255949:0:5865:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788813282.255974:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb160a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813282.255994:0:5865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9087413a1c00/0x6d74dbab2ddb1569 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1562 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813282.256004:0:5865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb160a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813282.256047:0:5865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9087413a1c00/0x6d74dbab2ddb1569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb1562 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813282.256061:0:5865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9087413a1c00/0x6d74dbab2ddb1569 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1562 expref: 13 pid: 5844 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813282.256076:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1875706583720576:0@lo:104: 00000100:00100000:2.0:1788813282.256150:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813282.256203:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749cde3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813282.257133:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583720576 00000100:00100000:3.0:1788813282.257147:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583720576 00000100:00100000:3.0:1788813282.257200:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788813282.257211:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+3:5865:x1875706583720576:12345-0@lo:104: 00010000:00010000:3.0:1788813282.257229:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff908750ad1a00/0x6d74dbab2ddb1562 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb1569 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813282.257315:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788813282.257321:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+3:5865:x1875706583720576:12345-0@lo:104: Request processed in 112us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813282.257327:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788813282.257371:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1875706583720576:0@lo:104: 00010000:00010000:3.0:1788813282.257395:0:5865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb160a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.257441:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813282.257449:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908750ad1a00/0x6d74dbab2ddb1562 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb1569 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.257456:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1a00 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:1.0:1788813282.257459:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908750ad1a00/0x6d74dbab2ddb1562 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb1569 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.257467:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908750ad1a00/0x6d74dbab2ddb1562 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb1569 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813282.257473:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908750ad1a00/0x6d74dbab2ddb1562 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb1569 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813282.257478:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788813282.257518:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff908750ad1a00/0x6d74dbab2ddb1562 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1569 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.257542:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813282.257562:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908750ad1a00/0x6d74dbab2ddb1562 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1569 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.257568:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908750ad1a00/0x6d74dbab2ddb1562 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1569 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.257617:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813282.257619:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813282.257621:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813282.257633:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd1fd158-af17-4a1b-8f0b-82e57114d008:3319:1875706583720704:0@lo:103: 00000100:00100000:1.0:1788813282.257679:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813282.257720:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583720704 00000100:00100000:1.0:1788813282.257723:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583720704 00010000:00010000:1.0:1788813282.257741:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9087413a1c00/0x6d74dbab2ddb1569 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1562 expref: 14 pid: 5844 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813282.257761:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813282.257772:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:3319:x1875706583720704:12345-0@lo:103: 00010000:00010000:1.0:1788813282.257783:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813282.257787:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9087413a1c00/0x6d74dbab2ddb1569 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1562 expref: 14 pid: 5844 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.257797:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9087413a1c00/0x6d74dbab2ddb1569 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1562 expref: 14 pid: 5844 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.257809:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9087413a1c00/0x6d74dbab2ddb1569 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb1562 expref: 14 pid: 5844 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.257831:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb160a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.257838:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb160a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788813282.257851:0:5835:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002952162s 00010000:00010000:1.0:1788813282.257855:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb160a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.257862:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb160a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.257868:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb160a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.257874:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb160a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.257878:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a0400 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813282.257882:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb160a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.257888:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb160a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.257900:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb160a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.257909:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813282.257942:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:3319:x1875706583720704:12345-0@lo:103: Request processed in 170us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813282.257949:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813282.258141:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd1fd158-af17-4a1b-8f0b-82e57114d008:3319:1875706583720704:0@lo:103: 00010000:00010000:1.0:1788813282.258183:0:5865:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb160a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.258191:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb160a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813282.258197:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb160a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813282.262837:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:6702:x1875706583720448:12345-0@lo:253: Request processed in 32100us (32283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813282.262854:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788813282.263178:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:6702:1875706583720448:0@lo:253: 10000000:01000000:2.0:1788813282.263196:0:6702:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788813282.263200:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788813282.263201:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788813282.263203:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813282.263204:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813282.263205:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813282.263206:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813282.263208:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813282.263209:0:6702:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788813282.263217:0:6702:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788813282.263218:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813282.263220:0:6702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788813282.263235:0:6702:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788813282.268857:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788813282.269050:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788813282.269553:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788813282.270266:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788813282.270671:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788813282.270873:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788813282.272033:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788813282.497817:0:6702:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788813282.497825:0:6702:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788813282.497867:0:6702:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788813282.497936:0:6702:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.147@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788813282.497952:0:6702:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788813282.497983:0:6702:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788813283.007963:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813284.031046:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813285.054189:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813286.077069:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813287.112446:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813287.618844:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583720960:0@lo:400: 00000100:00100000:3.0:1788813287.618924:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813287.618986:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788813287.618992:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583720832:0@lo:400: 00000100:00100000:1.0:1788813287.619140:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583721088:0@lo:400: 00000100:00100000:1.0:1788813287.619173:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813287.619219:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583720960 00000100:00100000:1.0:1788813287.619226:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583720960 00000100:00100000:1.0:1788813287.619279:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583721088 00000100:00100000:1.0:1788813287.619283:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583721088 00000100:00100000:1.0:1788813287.619310:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813287.619318:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583720960:12345-0@lo:400: 00000100:00100000:1.0:1788813287.619367:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583720960:12345-0@lo:400: Request processed in 49us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813287.619374:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813287.619391:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813287.619397:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583721088:12345-0@lo:400: 00000100:00100000:1.0:1788813287.619441:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583721088:12345-0@lo:400: Request processed in 44us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813287.619447:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788813287.619499:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff908749ac3b80 x1875706583721088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813287.619514:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583721088:0@lo:400: 00000100:00100000:3.0:1788813287.620869:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788813287.620937:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff908749ac1880 x1875706583720960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813287.620953:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583720960:0@lo:400: 00000100:00100000:3.0:1788813287.620997:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583720832 00000100:00100000:3.0:1788813287.621003:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583720832 00000100:00100000:3.0:1788813287.621057:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788813287.621066:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:3321:x1875706583720832:12345-0@lo:400: 00000100:00100000:3.0:1788813287.621112:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:3321:x1875706583720832:12345-0@lo:400: Request processed in 47us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813287.621119:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788813287.621160:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583720832:0@lo:400: 00000100:00080000:2.0:1788813287.621757:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788813288.126615:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813289.149230:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788813289.506575:0:7069:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg447-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:3.0:1788813289.660755:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788813289.660763:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff908781c96000 from 21 10000000:01000000:3.0:1788813289.660769:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788813289.660819:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908750ad1a00/0x6d74dbab2ddb1611 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813289.660830:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908750ad1a00/0x6d74dbab2ddb1611 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813289.660841:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908750ad1a00/0x6d74dbab2ddb1611 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813289.660882:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583721216:0@lo:101: 00000100:00100000:3.0:1788813289.660952:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813289.661006:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c1c7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788813289.666279:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583721216 00000100:00100000:2.0:1788813289.666293:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583721216 00000100:00100000:2.0:1788813289.666356:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788813289.666378:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:5846:x1875706583721216:12345-0@lo:101: 00010000:00010000:2.0:1788813289.666396:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813289.666415:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9087413a1600/0x6d74dbab2ddb1618 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb1611 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813289.666453:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9087413a1600/0x6d74dbab2ddb1618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1611 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813289.666465:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9087413a1600/0x6d74dbab2ddb1618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1611 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813289.666474:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9087413a1600, rc 0) 00000100:00100000:2.0:1788813289.666546:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:5846:x1875706583721216:12345-0@lo:101: Request processed in 181us (5594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813289.666561:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788813289.666643:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583721216:0@lo:101: 00010000:00010000:2.0:1788813289.666661:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908750ad1a00/0x6d74dbab2ddb1611 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1618 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813289.666670:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908750ad1a00/0x6d74dbab2ddb1611 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb1618 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813289.666730:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583721344:0@lo:501: 00000100:00100000:2.0:1788813289.666758:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813289.666791:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087454510c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813289.667167:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583721344 00000100:00100000:0.0:1788813289.667173:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583721344 00000100:00100000:0.0:1788813289.667208:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788813289.667215:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:5846:x1875706583721344:12345-0@lo:501: 00000100:00100000:0.0:1788813289.667637:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:5846:x1875706583721344:12345-0@lo:501: Request processed in 422us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813289.667643:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788813289.669193:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583721344:0@lo:501: 00000100:00100000:2.0:1788813289.669246:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583721472:0@lo:503: 00000100:00100000:2.0:1788813289.669311:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813289.669346:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087454510c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813289.670006:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583721472 00000100:00100000:0.0:1788813289.670016:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583721472 00000100:00100000:0.0:1788813289.670109:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788813289.670121:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:5846:x1875706583721472:12345-0@lo:503: 00000100:00100000:0.0:1788813289.670536:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:5846:x1875706583721472:12345-0@lo:503: Request processed in 416us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813289.670544:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788813289.670637:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583721472:0@lo:503: 00000100:00100000:1.0:1788813289.671421:0:7076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:7076:1875706583721600:0@lo:502: 00000100:00100000:1.0:1788813289.671489:0:7076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813289.671560:0:7076:0:(client.c:2716:ptlrpc_set_wait()) set ffff908641365a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813289.671698:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583721600 00000100:00100000:0.0:1788813289.671703:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583721600 00000100:00100000:0.0:1788813289.679080:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788813289.679107:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:7076:x1875706583721600:12345-0@lo:502: 00000100:00100000:0.0:1788813289.679500:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:7076:x1875706583721600:12345-0@lo:502: Request processed in 407us (8010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813289.679509:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788813289.679734:0:7076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:7076:1875706583721600:0@lo:502: 00000100:00100000:1.0:1788813289.679805:0:7076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:7076:1875706583721728:0@lo:502: 00000100:00100000:1.0:1788813289.679865:0:7076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813289.680218:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583721728 00000100:00100000:0.0:1788813289.680226:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583721728 00000100:00100000:0.0:1788813289.680267:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788813289.680275:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:7076:x1875706583721728:12345-0@lo:502: 00000100:00100000:0.0:1788813289.680456:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:7076:x1875706583721728:12345-0@lo:502: Request processed in 181us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813289.680469:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788813289.683687:0:7076:0:(client.c:2716:ptlrpc_set_wait()) set ffff908641365a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813289.683730:0:7076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:7076:1875706583721728:0@lo:502: 00000040:00080000:1.0:1788813289.683774:0:7076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788813289.683914:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788813289.683935:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788813289.683949:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908750ad1a00/0x6d74dbab2ddb1611 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1618 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813289.683962:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908750ad1a00/0x6d74dbab2ddb1611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1618 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813289.683972:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788813289.683974:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff908781c96000 from 4 10000000:01000000:0.0:1788813289.683977:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788813289.684012:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb161f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813289.684020:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb161f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813289.684030:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb161f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813289.684050:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583721856:0@lo:101: 00000100:00100000:0.0:1788813289.684124:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813289.684163:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c3db780 going to sleep for 11 seconds 00000100:00100000:1.0:1788813289.684277:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583721856 00000100:00100000:1.0:1788813289.684285:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583721856 00000100:00100000:1.0:1788813289.684338:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788813289.684347:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:5846:x1875706583721856:12345-0@lo:101: 00010000:00010000:1.0:1788813289.684360:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813289.684375:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90874148ca00/0x6d74dbab2ddb1626 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb161f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813289.684397:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90874148ca00/0x6d74dbab2ddb1626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb161f expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813289.684423:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90874148ca00/0x6d74dbab2ddb1626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb161f expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813289.684432:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148ca00, rc 0) 00000100:00100000:1.0:1788813289.684487:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:5846:x1875706583721856:12345-0@lo:101: Request processed in 141us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813289.684494:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788813289.684533:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583721856:0@lo:101: 00010000:00010000:1.0:1788813289.684546:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb161f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1626 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813289.684555:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb161f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb1626 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813289.684631:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583721984:0@lo:256: 00000100:00100000:1.0:1788813289.684662:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813289.684673:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff908641365300 going to sleep for 11 seconds 00000100:00100000:0.0:1788813289.684728:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583721984 00000100:00100000:0.0:1788813289.684732:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583721984 00000100:00100000:0.0:1788813289.684763:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788813289.684770:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:5846:x1875706583721984:12345-0@lo:256: 20000000:01000000:0.0:1788813289.684784:0:5841:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788813289.684805:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788813289.684809:0:5841:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788813289.684882:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:5846:x1875706583721984:12345-0@lo:256: Request processed in 112us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813289.684889:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788813289.684956:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583721984:0@lo:256: 10000000:01000000:1.0:1788813289.685001:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788813289.685007:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb161f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1626 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813289.685015:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb161f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1626 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813289.685022:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788813289.685030:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788813289.685032:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788813289.685060:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb162d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813289.685067:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb162d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813289.685074:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb162d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813289.685086:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583722112:0@lo:101: 00000100:00100000:1.0:1788813289.685109:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813289.685129:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff908641365300 going to sleep for 11 seconds 00000100:00100000:1.0:1788813289.685141:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583722112 00000100:00100000:1.0:1788813289.685145:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583722112 00000100:00100000:1.0:1788813289.685164:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788813289.685169:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:5846:x1875706583722112:12345-0@lo:101: 00010000:00010000:1.0:1788813289.685177:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813289.685185:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90874148c600/0x6d74dbab2ddb1634 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb162d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813289.685199:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90874148c600/0x6d74dbab2ddb1634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb162d expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813289.685207:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90874148c600/0x6d74dbab2ddb1634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb162d expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813289.685213:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148c600, rc 0) 00000100:00100000:1.0:1788813289.685240:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:5846:x1875706583722112:12345-0@lo:101: Request processed in 70us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813289.685252:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788813289.685282:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583722112:0@lo:101: 00010000:00010000:1.0:1788813289.685294:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb162d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1634 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813289.685301:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb162d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb1634 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813289.685345:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583722240:0@lo:501: 00000100:00100000:1.0:1788813289.685367:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813289.685380:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff908641365300 going to sleep for 11 seconds 00000100:00100000:1.0:1788813289.685389:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583722240 00000100:00100000:1.0:1788813289.685393:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583722240 00000100:00100000:1.0:1788813289.685409:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788813289.685414:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908760094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:5846:x1875706583722240:12345-0@lo:501: 00000100:00100000:1.0:1788813289.685695:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908760094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:5846:x1875706583722240:12345-0@lo:501: Request processed in 279us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813289.685702:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788813289.685730:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583722240:0@lo:501: 00000100:00100000:1.0:1788813289.685756:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583722368:0@lo:503: 00000100:00100000:1.0:1788813289.685791:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813289.685804:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff908641365300 going to sleep for 11 seconds 00000100:00100000:1.0:1788813289.685814:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583722368 00000100:00100000:1.0:1788813289.685818:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583722368 00000100:00100000:1.0:1788813289.685835:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788813289.685839:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908760094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:5846:x1875706583722368:12345-0@lo:503: 00000100:00100000:1.0:1788813289.686122:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908760094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:5846:x1875706583722368:12345-0@lo:503: Request processed in 280us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813289.686129:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788813289.686168:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583722368:0@lo:503: 00000100:00100000:1.0:1788813289.686336:0:7079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:7079:1875706583722496:0@lo:502: 00000100:00100000:1.0:1788813289.686371:0:7079:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813289.686389:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583722496 00000100:00100000:1.0:1788813289.686394:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583722496 00000100:00100000:1.0:1788813289.686412:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788813289.686418:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908760095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:7079:x1875706583722496:12345-0@lo:502: 00000100:00100000:1.0:1788813289.686632:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908760095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:7079:x1875706583722496:12345-0@lo:502: Request processed in 212us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813289.686639:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788813289.686668:0:7079:0:(client.c:2716:ptlrpc_set_wait()) set ffff908641365600 going to sleep for 11 seconds 00000100:00100000:1.0:1788813289.686679:0:7079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:7079:1875706583722496:0@lo:502: 00000020:01000000:1.0:1788813289.686699:0:7079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788813289.686706:0:7079:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788813289.686712:0:7079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813289.686715:0:7079:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788813289.686719:0:7079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788813289.686723:0:7079:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.147@tcp to nid 0x20000c0a8cc93 (192.168.204.147@tcp) 00000020:01000000:1.0:1788813289.686743:0:7079:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788813289.686746:0:7079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788813289.686760:0:7079:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90876fac4d40) 00000020:00000080:1.0:1788813289.686780:0:7079:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788813289.686786:0:7079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788813289.686862:0:7079:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788813289.686872:0:7079:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788813289.686878:0:7079:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d74dbab2ddb1642 00010000:00080000:1.0:1788813289.686906:0:7079:0:(ldlm_lib.c:102:import_set_conn()) imp ffff908749b83000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.147@tcp at head 00010000:00010000:1.0:1788813289.687122:0:7079:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788813289.774638:0:7079:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788813289.774662:0:7079:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788813289.775198:0:7079:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813289.775930:0:7079:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813289.776050:0:7079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788813289.776113:0:7079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788813289.780702:0:7087:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788813289.780710:0:7087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788813289.791837:0:7079:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788813289.793609:0:7079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788813289.793674:0:7079:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788813289.793703:0:7079:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d74dbab2ddb1649 00000100:00080000:0.0:1788813289.793716:0:7079:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788813289.793728:0:7079:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff908749b83000 using connection 192.168.204.147@tcp/0@lo 00000100:00100000:0.0:1788813289.793769:0:7079:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90877c3f0700 x1875706583722624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788813289.793848:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1875706583722624:0@lo:8: 00000100:00100000:3.0:1788813289.793918:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788813289.793986:0:7079:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788813289.794059:0:7079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813289.794063:0:7079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813289.794065:0:7079:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788813289.794068:0:7079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813289.794072:0:7079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813289.794074:0:7079:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788813289.794076:0:7079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788813289.794078:0:7079:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788813289.794105:0:7079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:7079:1875706583722752:0@lo:502: 00000100:00100000:0.0:1788813289.794157:0:7079:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813289.794175:0:7079:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749fe2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813289.794242:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583722752 00000100:00100000:0.0:1788813289.794248:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583722752 00000100:00100000:0.0:1788813289.794282:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788813289.794290:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908760097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:7079:x1875706583722752:12345-0@lo:502: 00000100:00100000:0.0:1788813289.794550:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908760097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:7079:x1875706583722752:12345-0@lo:502: Request processed in 259us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813289.794557:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788813289.794626:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875706583722880:0@lo:400: 00000100:00100000:0.0:1788813289.794654:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813289.794696:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583723008:0@lo:400: 00000100:00100000:0.0:1788813289.794718:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813289.794760:0:7079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:7079:1875706583722752:0@lo:502: 00000020:01000000:0.0:1788813289.794786:0:7079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813289.794792:0:7079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813289.794793:0:7079:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788813289.794797:0:7079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:0.0:1788813289.794922:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583722880 00000100:00100000:0.0:1788813289.794927:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583722880 00000100:00100000:0.0:1788813289.794954:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583723008 00000100:00100000:0.0:1788813289.794957:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583723008 00000100:00100000:0.0:1788813289.794982:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788813289.794989:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875706583722880:12345-0@lo:400: 00000100:00100000:0.0:1788813289.795028:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875706583722880:12345-0@lo:400: Request processed in 39us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813289.795034:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788813289.795054:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788813289.795061:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583723008:12345-0@lo:400: 00000100:00100000:0.0:1788813289.795091:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583723008:12345-0@lo:400: Request processed in 31us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813289.795096:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000020:01000000:0.0:1788813289.795116:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1788813289.795133:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788813289.795142:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb162d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1634 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813289.795154:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb162d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1634 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813289.795164:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788813289.795167:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff908749b5cd40 from 1 10000000:01000000:0.0:1788813289.795169:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788813289.795193:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031400/0x6d74dbab2ddb1650 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813289.795202:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908740031400/0x6d74dbab2ddb1650 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813289.795210:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908740031400/0x6d74dbab2ddb1650 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813289.795222:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583723136:0@lo:101: 00000100:00100000:0.0:1788813289.795250:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813289.795264:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff908748f54600 going to sleep for 11 seconds 00000100:00080000:0.0:1788813289.795275:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788813289.795295:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90877c3f0a80 x1875706583722880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813289.795313:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875706583722880:0@lo:400: 00010000:00080000:0.0:1788813289.795337:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90877c3f1f80 x1875706583723008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813289.795345:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583723008:0@lo:400: 00000100:00100000:0.0:1788813289.795361:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583723136 00000100:00100000:0.0:1788813289.795364:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583723136 00000100:00100000:0.0:1788813289.795385:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788813289.795391:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:5846:x1875706583723136:12345-0@lo:101: 00010000:00010000:0.0:1788813289.795400:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813289.795412:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908740031e00/0x6d74dbab2ddb1657 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb1650 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813289.795447:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908740031e00/0x6d74dbab2ddb1657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1650 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813289.795459:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908740031e00/0x6d74dbab2ddb1657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1650 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813289.795469:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740031e00, rc 0) 00000100:00100000:0.0:1788813289.795497:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:5846:x1875706583723136:12345-0@lo:101: Request processed in 107us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813289.795503:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788813289.795533:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583723136:0@lo:101: 00010000:00010000:0.0:1788813289.795545:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908740031400/0x6d74dbab2ddb1650 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1657 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813289.795563:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908740031400/0x6d74dbab2ddb1650 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb1657 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813289.795630:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583723264:0@lo:501: 00000100:00100000:0.0:1788813289.795664:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813289.795678:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff908748f54600 going to sleep for 11 seconds 00000100:00100000:0.0:1788813289.795691:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583723264 00000100:00100000:0.0:1788813289.795694:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583723264 00000100:00100000:0.0:1788813289.795714:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788813289.795719:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:5846:x1875706583723264:12345-0@lo:501: 00000100:00100000:0.0:1788813289.795931:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:5846:x1875706583723264:12345-0@lo:501: Request processed in 210us (265us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788813289.795938:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788813289.795969:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583723264:0@lo:501: 10000000:01000000:0.0:1788813289.795986:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788813289.795992:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031400/0x6d74dbab2ddb1650 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1657 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813289.796000:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908740031400/0x6d74dbab2ddb1650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1657 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813289.801917:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583722624 00000100:00100000:3.0:1788813289.801934:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583722624 00000100:00100000:3.0:1788813289.801987:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788813289.801996:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3317:x1875706583722624:12345-0@lo:8: 00010000:00080000:3.0:1788813289.802028:0:6704:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:3.0:1788813289.802058:0:6704:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d74dbab2ddb165e 00002000:00100000:3.0:1788813289.802098:0:6704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff908641115800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788813289.802103:0:6704:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1788813289.802107:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788813289.802234:0:6704:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788813289.802500:0:6704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788813289.802532:0:6704:0:(import.c:65:import_set_state_nolock()) ffff908641113000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788813289.802727:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3317:x1875706583722624:12345-0@lo:8: Request processed in 730us (8807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813289.802735:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788813289.811028:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90877c3f0700 x1875706583722624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788813299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813289.811044:0:3317:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788813289.811054:0:3317:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788813289.811063:0:3317:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788813289.811078:0:3317:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788813289.811082:0:3317:0:(import.c:65:import_set_state_nolock()) ffff908749b83000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788813289.811101:0:3317:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788813289.811108:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1875706583722624:0@lo:8: 00000004:00080000:0.0:1788813289.814666:0:7087:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788813289.814858:0:7087:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 232057276913ns, next at 0ns, rc = 0 00000004:00080000:0.0:1788813289.919506:0:7089:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788813289.919540:0:7089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7089:1875706583723520:0@lo:7: 00000100:00100000:0.0:1788813289.919648:0:7089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813289.919692:0:7089:0:(client.c:2716:ptlrpc_set_wait()) set ffff908748f54840 going to sleep for 11 seconds 00000100:00100000:0.0:1788813289.919709:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583723392:0@lo:13: 00000100:00100000:0.0:1788813289.919733:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813289.919776:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583723520 00000100:00100000:0.0:1788813289.919786:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583723520 00000100:00100000:0.0:1788813289.919843:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788813289.919853:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7089:x1875706583723520:12345-0@lo:7: 00000100:00100000:0.0:1788813289.921770:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583723392 00000100:00100000:0.0:1788813289.921785:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583723392 00000100:00100000:0.0:1788813289.921845:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788813289.921856:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1875706583723392:12345-0@lo:13: 00002000:00000024:0.0:1788813289.921889:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788813289.921981:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1875706583723392:12345-0@lo:13: Request processed in 126us (2246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813289.921988:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788813289.922011:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788813289.922181:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90877c3f0380 x1875706583723392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813289.922202:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583723392:0@lo:13: 00002000:00080000:1.0:1788813289.930137:0:6706:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788813289.930147:0:6706:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788813289.930247:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7089:x1875706583723520:12345-0@lo:7: Request processed in 10389us (10593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813289.930260:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788813289.930312:0:7089:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90877c3f1f80 x1875706583723520/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788813305 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813289.930328:0:7089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7089:1875706583723520:0@lo:7: 00000004:00080000:1.0:1788813289.930343:0:7089:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788813289.930387:0:7089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7089:1875706583723648:0@lo:5: 00000100:00100000:1.0:1788813289.930423:0:7089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813289.930469:0:7089:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749c513c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813289.930486:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583723648 00000100:00100000:1.0:1788813289.930492:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583723648 00000100:00100000:1.0:1788813289.930538:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813289.930547:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7089:x1875706583723648:12345-0@lo:5: 00002000:00080000:1.0:1788813289.930572:0:6704:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788813289.930575:0:6704:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788813289.930804:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7089:x1875706583723648:12345-0@lo:5: Request processed in 257us (379us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788813289.930821:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788813289.931087:0:7089:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90877c3e8380 x1875706583723648/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788813305 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813289.931102:0:7089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7089:1875706583723648:0@lo:5: 00000004:00080000:0.0:1788813289.931111:0:7089:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788813289.931138:0:7089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7089:1875706583723776:0@lo:700: 00000100:00100000:0.0:1788813289.931166:0:7089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813289.931184:0:7089:0:(client.c:2716:ptlrpc_set_wait()) set ffff908748f54480 going to sleep for 11 seconds 00000100:00100000:0.0:1788813289.931204:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583723776 00000100:00100000:0.0:1788813289.931209:0:6713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583723776 00000100:00100000:0.0:1788813289.931256:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788813289.931263:0:6713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7089:x1875706583723776:12345-0@lo:700: 00000100:00100000:0.0:1788813289.931292:0:6713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6713:1875706583723904:0@lo:700: 00000100:00100000:0.0:1788813289.931319:0:6713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813289.931336:0:6713:0:(client.c:2716:ptlrpc_set_wait()) set ffff908748f54cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813289.931771:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583723904 00000100:00100000:0.0:1788813289.931777:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583723904 00000100:00100000:0.0:1788813289.931807:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788813289.931813:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6713:x1875706583723904:12345-0@lo:700: 00000004:00080000:3.0:1788813289.981403:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:0.0:1788813290.001449:0:5856:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1788813290.006916:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6713:x1875706583723904:12345-0@lo:700: Request processed in 75092us (75585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813290.006931:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788813290.007093:0:6713:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90877c3f0700 x1875706583723904/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788813305 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813290.007110:0:6713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6713:1875706583723904:0@lo:700: 40000000:02000000:2.0:1788813290.007124:0:6713:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1788813290.111456:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1788813290.111488:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788813290.111801:0:6713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7089:x1875706583723776:12345-0@lo:700: Request processed in 180532us (180627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813290.111821:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788813290.111941:0:7089:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90877c3f1f80 x1875706583723776/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788813305 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813290.112027:0:7089:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788813290.112049:0:7089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7089:1875706583723776:0@lo:700: 00000004:02000040:0.0:1788813290.162894:0:7089:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1788813290.169696:0:7089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7089:1875706583724032:0@lo:5: 00000100:00100000:0.0:1788813290.169760:0:7089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813290.169848:0:7089:0:(client.c:2716:ptlrpc_set_wait()) set ffff908748f54f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813290.169893:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583724032 00000100:00100000:2.0:1788813290.169902:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583724032 00000100:00100000:2.0:1788813290.170135:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788813290.170146:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7089:x1875706583724032:12345-0@lo:5: 00010000:00010000:0.0:1788813290.173527:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788813290.177319:0:6706:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788813290.177346:0:6706:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1788813290.185900:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7089:x1875706583724032:12345-0@lo:5: Request processed in 15748us (16131us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788813290.185914:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788813290.185930:0:7089:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90877c3f1f80 x1875706583724032/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788813306 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813290.185949:0:7089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7089:1875706583724032:0@lo:5: 00000004:00080000:0.0:1788813290.185980:0:7089:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1788813291.196925:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813292.221167:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813293.246214:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813294.269482:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788813294.934645:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:1.0:1788813295.293080:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583724160:0@lo:400: 00000100:00100000:1.0:1788813295.293177:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813295.293606:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583724160 00000100:00100000:2.0:1788813295.293614:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583724160 00000100:00100000:2.0:1788813295.293660:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788813295.293669:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:3318:x1875706583724160:12345-0@lo:400: 00000100:00100000:2.0:1788813295.293721:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:3318:x1875706583724160:12345-0@lo:400: Request processed in 53us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813295.293727:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788813295.293845:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583724160:0@lo:400: 00000100:00100000:1.0:1788813295.294091:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583724672:0@lo:13: 00000100:00100000:1.0:1788813295.294125:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813295.294156:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788813295.294163:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875706583724288:0@lo:400: 00000100:00100000:1.0:1788813295.294952:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813295.295321:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583724288 00000100:00100000:0.0:1788813295.295343:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583724288 00000100:00100000:0.0:1788813295.295386:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788813295.295395:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875706583724288:12345-0@lo:400: 00000100:00100000:0.0:1788813295.295452:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875706583724288:12345-0@lo:400: Request processed in 58us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813295.295459:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1788813295.295805:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813295.296016:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583724672 00000100:00100000:3.0:1788813295.296023:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583724672 00000100:00100000:3.0:1788813295.296077:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788813295.296086:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583724672:12345-0@lo:13: 00002000:00000024:3.0:1788813295.296121:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813295.296177:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583724672:12345-0@lo:13: Request processed in 93us (2051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813295.296196:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813295.296773:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583724416:0@lo:400: 00000100:00100000:1.0:1788813295.296824:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813295.296868:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813295.296876:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583724544:0@lo:400: 00000100:00100000:1.0:1788813295.296902:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813295.296936:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583724544 00000100:00100000:1.0:1788813295.296942:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583724544 00000100:00100000:1.0:1788813295.296987:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813295.296993:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583724544:12345-0@lo:400: 00000100:00100000:1.0:1788813295.297033:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583724544:12345-0@lo:400: Request processed in 40us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813295.297040:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788813295.297078:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90877c3e9c00 x1875706583724544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813295.297089:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788813295.297104:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583724544:0@lo:400: 00010000:00080000:1.0:1788813295.297138:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90877c3e9f80 x1875706583724288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813295.297149:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875706583724288:0@lo:400: 00010000:00080000:1.0:1788813295.297160:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90877c3ec380 x1875706583724672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813295.297172:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583724672:0@lo:13: 00000100:00100000:3.0:1788813295.298075:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583724416 00000100:00100000:3.0:1788813295.298086:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583724416 00000100:00100000:3.0:1788813295.298135:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788813295.298144:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583724416:12345-0@lo:400: 00000100:00100000:3.0:1788813295.298218:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583724416:12345-0@lo:400: Request processed in 75us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813295.298224:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788813295.298689:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90877c3e8000 x1875706583724416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813295.298707:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583724416:0@lo:400: 00000100:00080000:0.0:1788813295.310205:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788813295.310217:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788813296.318279:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813297.344681:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813298.374312:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813299.398937:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813300.413934:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583725184:0@lo:400: 00000100:00100000:3.0:1788813300.414015:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813300.414074:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813300.414081:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583724800:0@lo:400: 00000100:00100000:3.0:1788813300.414123:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813300.414156:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583724928:0@lo:400: 00000100:00100000:3.0:1788813300.414181:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813300.414201:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813300.414207:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583725056:0@lo:400: 00000100:00100000:3.0:1788813300.414246:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788813300.414275:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813300.414289:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583725184 00000100:00100000:3.0:1788813300.414297:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583725184 00000100:00100000:3.0:1788813300.414354:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788813300.414363:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583725184:12345-0@lo:400: 00000100:00100000:3.0:1788813300.414414:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583725184:12345-0@lo:400: Request processed in 52us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813300.414421:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788813300.414444:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583724800 00000100:00100000:3.0:1788813300.414447:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583724800 00000100:00100000:3.0:1788813300.414465:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788813300.414470:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:3318:x1875706583724800:12345-0@lo:400: 00000100:00100000:3.0:1788813300.414494:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:3318:x1875706583724800:12345-0@lo:400: Request processed in 24us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813300.414499:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788813300.414523:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583724928 00000100:00100000:3.0:1788813300.414526:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583724928 00000100:00100000:3.0:1788813300.414546:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583725056 00000100:00100000:3.0:1788813300.414548:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583725056 00000100:00100000:3.0:1788813300.414564:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788813300.414570:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583724928:12345-0@lo:400: 00000100:00100000:3.0:1788813300.414638:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583724928:12345-0@lo:400: Request processed in 68us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813300.414652:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788813300.414665:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788813300.414670:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583725056:12345-0@lo:400: 00000100:00100000:3.0:1788813300.414696:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583725056:12345-0@lo:400: Request processed in 26us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813300.414701:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788813300.414718:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788813300.414723:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788813300.414752:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff908749ac0e00 x1875706583725056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813300.414766:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583725056:0@lo:400: 00010000:00080000:3.0:1788813300.414775:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff908749ac1f80 x1875706583724928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813300.414783:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583724928:0@lo:400: 00000100:00100000:3.0:1788813300.414807:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583724800:0@lo:400: 00010000:00080000:3.0:1788813300.414815:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff908749ac2d80 x1875706583725184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813300.414822:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583725184:0@lo:400: 00000100:00100000:1.0:1788813300.415129:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583725312:0@lo:13: 00000100:00100000:1.0:1788813300.415166:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813300.415347:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583725312 00000100:00100000:2.0:1788813300.415352:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583725312 00000100:00100000:2.0:1788813300.415388:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788813300.415395:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583725312:12345-0@lo:13: 00002000:00000024:2.0:1788813300.415422:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813300.415464:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583725312:12345-0@lo:13: Request processed in 69us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813300.415469:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788813300.415499:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90877c3ece00 x1875706583725312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813300.415512:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583725312:0@lo:13: 00010000:00010000:2.0:1788813301.436742:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788813302.054879:0:7652:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788813302.054883:0:7652:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788813302.055001:0:7652:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff908641187800 00000020:01000004:0.0:1788813302.055017:0:7652:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788813302.055030:0:7652:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788813302.055045:0:7652:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff90876f9cb380) 00000020:00000080:0.0:1788813302.055065:0:7652:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788813302.069364:0:7652:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788813302.070560:0:7652:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788813302.092127:0:7652:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788813302.102473:0:7652:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788813302.102510:0:7652:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788813302.106058:0:7652:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788813302.106120:0:7652:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788813302.106523:0:7652:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788813302.106538:0:7652:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788813302.106550:0:7652:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6d74dbab2ddb166c 00000020:01000004:1.0:1788813302.106558:0:7652:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788813302.106611:0:7652:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.147@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788813302.106616:0:7652:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.147@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788813302.106623:0:7652:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788813302.106648:0:7652:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1788813302.106653:0:7652:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.147@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788813302.138143:0:7652:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.147@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788813302.138186:0:7652:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.147@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788813302.138191:0:7652:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788813302.138203:0:7652:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788813302.138209:0:7652:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813302.138210:0:7652:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813302.138211:0:7652:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813302.138212:0:7652:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813302.138213:0:7652:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813302.138214:0:7652:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788813302.138216:0:7652:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788813302.138217:0:7652:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813302.138218:0:7652:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788813302.138222:0:7652:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788813302.138225:0:7652:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788813302.138226:0:7652:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788813302.138227:0:7652:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813302.138228:0:7652:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813302.138228:0:7652:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813302.138229:0:7652:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813302.138230:0:7652:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813302.138231:0:7652:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788813302.138232:0:7652:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788813302.138233:0:7652:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813302.138233:0:7652:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788813302.138271:0:7652:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788813302.138295:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583725440:0@lo:253: 00000100:00100000:2.0:1788813302.138388:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813302.138509:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff908745451000 going to sleep for 11 seconds 00000100:00100000:0.0:1788813302.138921:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583725440 00000100:00100000:0.0:1788813302.138931:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583725440 00000100:00100000:0.0:1788813302.139045:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788813302.139056:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:7652:x1875706583725440:12345-0@lo:253: 20000000:01000000:0.0:1788813302.139086:0:5841:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788813302.139091:0:5841:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788813302.139095:0:5841:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788813302.139099:0:5841:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788813302.140320:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813302.140534:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788813302.140548:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788813302.142987:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788813302.143021:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788813302.143101:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788813302.143184:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788813302.144345:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788813302.144373:0:5841:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.147@tcp 20000000:01000000:0.0:1788813302.144375:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.147@tcp (null) (null) (null) 00000040:00080000:0.0:1788813302.144410:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788813302.144418:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788813302.144468:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788813302.144477:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.147@tcp (null) (null) 00000040:00080000:0.0:1788813302.144506:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788813302.144514:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788813302.145181:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788813302.145264:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788813302.147419:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1788813302.147453:0:5841:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.147@tcp 20000000:01000000:1.0:1788813302.147455:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.147@tcp (null) (null) (null) 00000040:00080000:1.0:1788813302.147493:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1788813302.147500:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788813302.151471:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1788813302.151504:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.147@tcp (null) (null) 00000040:00080000:1.0:1788813302.151908:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1788813302.151922:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788813302.151997:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1788813302.152057:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1788813302.152081:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788813302.152084:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788813302.152088:0:5841:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788813302.152106:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788813302.152108:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788813302.152154:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788813302.152157:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788813302.153186:0:7654:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788813302.153322:0:7654:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788813302.153380:0:7654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788813302.154167:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788813302.154226:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788813302.154294:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788813302.154308:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788813302.154310:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788813302.155145:0:7655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788813302.155456:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788813302.155500:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788813302.156168:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788813302.156187:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788813302.156189:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788813302.157322:0:7656:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1788813302.157406:0:7656:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1788813302.157457:0:7656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1788813302.158150:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1788813302.158214:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1788813302.158278:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1788813302.158292:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788813302.158294:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788813302.159177:0:7657:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1788813302.159243:0:7657:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1788813302.159305:0:7657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788813302.160138:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1788813302.160184:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1788813302.160234:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1788813302.160252:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1788813302.160254:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1788813302.160263:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788813302.160283:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90874148d400/0x6d74dbab2ddb1673 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.160302:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb15c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb15bd expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.160310:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff908740031200/0x6d74dbab2ddb15ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb15e7 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.160334:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9087413a1600/0x6d74dbab2ddb1618 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1611 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.160341:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90874148c600/0x6d74dbab2ddb1634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb162d expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.160348:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff908740031e00/0x6d74dbab2ddb1657 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1650 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.160355:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90874148d400/0x6d74dbab2ddb1673 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.160395:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff908740031e00/0x6d74dbab2ddb1657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb1650 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.160409:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff908740031e00/0x6d74dbab2ddb1657 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1650 expref: 16 pid: 5843 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813302.160424:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1875706583725568:0@lo:104: 00000100:00100000:1.0:1788813302.160505:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788813302.160949:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90874148c600/0x6d74dbab2ddb1634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb162d expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.160960:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90874148c600/0x6d74dbab2ddb1634 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb162d expref: 16 pid: 5844 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813302.160970:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1875706583725696:0@lo:104: 00010000:00010000:1.0:1788813302.161001:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9087413a1600/0x6d74dbab2ddb1618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb1611 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.161022:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9087413a1600/0x6d74dbab2ddb1618 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1611 expref: 16 pid: 5844 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813302.161031:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eb100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1875706583725824:0@lo:104: 00010000:00010000:1.0:1788813302.161059:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff908740031200/0x6d74dbab2ddb15ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb15e7 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.161067:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff908740031200/0x6d74dbab2ddb15ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb15e7 expref: 16 pid: 5841 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813302.161074:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eb800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1875706583725952:0@lo:104: 00010000:00010000:1.0:1788813302.161096:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb15c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb15bd expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.161104:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb15c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb15bd expref: 16 pid: 5841 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813302.161112:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1875706583726080:0@lo:104: 00000100:00100000:1.0:1788813302.161126:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749cf3000 going to sleep for 11 seconds 00000100:00100000:2.0:1788813302.161188:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788813302.161219:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813302.161282:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813302.161340:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813302.161361:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583725568 00000100:00100000:1.0:1788813302.161368:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583725568 00000100:00100000:1.0:1788813302.161404:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583725696 00000100:00100000:1.0:1788813302.161406:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583725696 00000100:00100000:1.0:1788813302.161416:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583725824 00000100:00100000:1.0:1788813302.161418:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583725824 00000100:00100000:1.0:1788813302.161430:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788813302.161437:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908758732050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+5:5841:x1875706583725568:12345-0@lo:104: 00010000:00010000:1.0:1788813302.161450:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff908740031400/0x6d74dbab2ddb1650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb1657 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.161534:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788813302.161541:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908758732050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+5:5841:x1875706583725568:12345-0@lo:104: Request processed in 104us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813302.161556:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788813302.161625:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788813302.161632:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+4:5841:x1875706583725696:12345-0@lo:104: 00010000:00010000:1.0:1788813302.161640:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb162d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb1634 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.161676:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788813302.161681:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+4:5841:x1875706583725696:12345-0@lo:104: Request processed in 51us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813302.161688:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788813302.161700:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788813302.161706:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+3:5841:x1875706583725824:12345-0@lo:104: 00010000:00010000:1.0:1788813302.161713:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff908750ad1a00/0x6d74dbab2ddb1611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb1618 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813302.161857:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1875706583725568:0@lo:104: 00000100:00100000:0.0:1788813302.161867:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1875706583725696:0@lo:104: 00010000:00010000:3.0:1788813302.162006:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788813302.162014:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908740031400/0x6d74dbab2ddb1650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb1657 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.162022:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031400 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:3.0:1788813302.162025:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908740031400/0x6d74dbab2ddb1650 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb1657 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.162034:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908740031400/0x6d74dbab2ddb1650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb1657 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813302.162040:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908740031400/0x6d74dbab2ddb1650 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb1657 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813302.162046:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813302.162072:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff908740031400/0x6d74dbab2ddb1650 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1657 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.162078:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813302.162095:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908740031400/0x6d74dbab2ddb1650 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1657 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.162102:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908740031400/0x6d74dbab2ddb1650 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1657 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.162114:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813302.162117:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb162d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb1634 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.162131:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148c000 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:3.0:1788813302.162134:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb162d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb1634 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.162140:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb162d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb1634 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813302.162146:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb162d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb1634 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813302.162150:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813302.162164:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb162d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1634 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.162170:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813302.162176:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb162d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1634 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.162182:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb162d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1634 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.162203:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813302.162205:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813302.162207:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813302.162221:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583726208:0@lo:103: 00000100:00100000:3.0:1788813302.162255:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813302.162288:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813302.162294:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583726336:0@lo:103: 00000100:00100000:3.0:1788813302.162323:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813302.162354:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583726208 00000100:00100000:3.0:1788813302.162358:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583726208 00010000:00010000:3.0:1788813302.162375:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff908740031e00/0x6d74dbab2ddb1657 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1650 expref: 17 pid: 5843 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813302.162395:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583726336 00000100:00100000:3.0:1788813302.162398:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583726336 00010000:00010000:3.0:1788813302.162408:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90874148c600/0x6d74dbab2ddb1634 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb162d expref: 18 pid: 5844 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813302.162420:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788813302.162425:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:3320:x1875706583726208:12345-0@lo:103: 00010000:00010000:3.0:1788813302.162435:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813302.162441:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff908740031e00/0x6d74dbab2ddb1657 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1650 expref: 18 pid: 5843 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.162451:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff908740031e00/0x6d74dbab2ddb1657 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1650 expref: 18 pid: 5843 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.162463:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908740031e00/0x6d74dbab2ddb1657 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb1650 expref: 18 pid: 5843 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.162474:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813302.162500:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:3320:x1875706583726208:12345-0@lo:103: Request processed in 74us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813302.162506:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788813302.162519:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788813302.162524:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:3320:x1875706583726336:12345-0@lo:103: 00010000:00010000:3.0:1788813302.162531:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813302.162540:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90874148c600/0x6d74dbab2ddb1634 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb162d expref: 16 pid: 5844 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.162548:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90874148c600/0x6d74dbab2ddb1634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb162d expref: 16 pid: 5844 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.162559:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90874148c600/0x6d74dbab2ddb1634 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb162d expref: 16 pid: 5844 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.162568:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813302.162611:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:3320:x1875706583726336:12345-0@lo:103: Request processed in 84us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813302.162617:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788813302.162648:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583726336:0@lo:103: 00000100:00100000:3.0:1788813302.162655:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583726208:0@lo:103: 00010000:00010000:1.0:1788813302.163022:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788813302.163029:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+3:5841:x1875706583725824:12345-0@lo:104: Request processed in 1324us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813302.163036:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788813302.163057:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813302.163061:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908750ad1a00/0x6d74dbab2ddb1611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb1618 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.163068:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1a00 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:1.0:1788813302.163081:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908750ad1a00/0x6d74dbab2ddb1611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb1618 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.163090:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908750ad1a00/0x6d74dbab2ddb1611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb1618 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813302.163097:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908750ad1a00/0x6d74dbab2ddb1611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb1618 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813302.163103:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788813302.163123:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff908750ad1a00/0x6d74dbab2ddb1611 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1618 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.163129:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813302.163147:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908750ad1a00/0x6d74dbab2ddb1611 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1618 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.163154:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908750ad1a00/0x6d74dbab2ddb1611 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1618 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.163165:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813302.163167:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813302.163168:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813302.163175:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813302.163185:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd1fd158-af17-4a1b-8f0b-82e57114d008:3319:1875706583726464:0@lo:103: 00000100:00100000:1.0:1788813302.163226:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813302.163384:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eb100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1875706583725824:0@lo:104: 00010000:00010000:3.0:1788813302.163425:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813302.163432:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583726464 00000100:00100000:3.0:1788813302.163436:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583726464 00010000:00010000:3.0:1788813302.163453:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9087413a1600/0x6d74dbab2ddb1618 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1611 expref: 15 pid: 5844 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813302.163478:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788813302.163484:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:3319:x1875706583726464:12345-0@lo:103: 00010000:00010000:3.0:1788813302.163491:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813302.163496:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9087413a1600/0x6d74dbab2ddb1618 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1611 expref: 15 pid: 5844 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.163504:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9087413a1600/0x6d74dbab2ddb1618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1611 expref: 15 pid: 5844 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.163534:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9087413a1600/0x6d74dbab2ddb1618 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb1611 expref: 15 pid: 5844 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.163545:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813302.163608:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:3319:x1875706583726464:12345-0@lo:103: Request processed in 124us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813302.163615:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788813302.163687:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd1fd158-af17-4a1b-8f0b-82e57114d008:3319:1875706583726464:0@lo:103: 00000100:00100000:2.0:1788813302.164280:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813302.164335:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583725952 00000100:00100000:1.0:1788813302.164340:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583725952 00000100:00100000:1.0:1788813302.164359:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583726080 00000100:00100000:1.0:1788813302.164361:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583726080 00000100:00100000:1.0:1788813302.164371:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788813302.164383:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+4:5841:x1875706583725952:12345-0@lo:104: 00010000:00010000:1.0:1788813302.164393:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff908750ad1c00/0x6d74dbab2ddb15e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb15ee expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.164488:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788813302.164493:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+4:5841:x1875706583725952:12345-0@lo:104: Request processed in 111us (3153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813302.164499:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788813302.164512:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788813302.164525:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+3:5841:x1875706583726080:12345-0@lo:104: 00010000:00010000:1.0:1788813302.164532:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb15bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb15c4 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.164566:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788813302.164571:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+3:5841:x1875706583726080:12345-0@lo:104: Request processed in 55us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813302.164600:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788813302.164751:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788813302.164757:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908750ad1c00/0x6d74dbab2ddb15e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb15ee expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.164765:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1c00 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:3.0:1788813302.164769:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908750ad1c00/0x6d74dbab2ddb15e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb15ee expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.164777:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908750ad1c00/0x6d74dbab2ddb15e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb15ee expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813302.164784:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908750ad1c00/0x6d74dbab2ddb15e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb15ee expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813302.164790:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788813302.164977:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813302.165129:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813302.165135:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb15bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb15c4 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.165142:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740030600 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:2.0:1788813302.165145:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb15bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb15c4 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.165156:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb15bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb15c4 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813302.165162:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb15bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb15c4 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813302.165167:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813302.165219:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff908750ad1c00/0x6d74dbab2ddb15e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb15ee expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.165226:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813302.165242:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908750ad1c00/0x6d74dbab2ddb15e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb15ee expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.165249:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908750ad1c00/0x6d74dbab2ddb15e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb15ee expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.165266:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813302.165268:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813302.165269:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813302.165275:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813302.165287:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583726592:0@lo:103: 00000100:00100000:3.0:1788813302.165321:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813302.165358:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583726592 00000100:00100000:3.0:1788813302.165363:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583726592 00010000:00010000:3.0:1788813302.165379:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff908740031200/0x6d74dbab2ddb15ee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb15e7 expref: 14 pid: 5841 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813302.165396:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788813302.165402:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:3318:x1875706583726592:12345-0@lo:103: 00010000:00010000:3.0:1788813302.165410:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813302.165415:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff908740031200/0x6d74dbab2ddb15ee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb15e7 expref: 14 pid: 5841 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.165425:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff908740031200/0x6d74dbab2ddb15ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb15e7 expref: 14 pid: 5841 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.165438:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813302.165461:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:3318:x1875706583726592:12345-0@lo:103: Request processed in 59us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813302.165466:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788813302.165494:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583726592:0@lo:103: 00010000:00010000:3.0:1788813302.165643:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813302.165646:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813302.165767:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908740031200/0x6d74dbab2ddb15ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb15e7 expref: 13 pid: 5841 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813302.165780:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eb800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1875706583725952:0@lo:104: 00000100:00100000:0.0:1788813302.165788:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1875706583726080:0@lo:104: 00010000:00010000:0.0:1788813302.165932:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90874148d400/0x6d74dbab2ddb1673 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.166082:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb15bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb15c4 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.166089:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813302.166108:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb15bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb15c4 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.166115:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb15bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb15c4 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.166129:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813302.166130:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813302.166132:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813302.166164:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788813302.166176:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583726720:0@lo:103: 00000100:00100000:3.0:1788813302.166218:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813302.166329:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583726720 00000100:00100000:2.0:1788813302.166335:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583726720 00010000:00010000:2.0:1788813302.166354:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb15c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb15bd expref: 13 pid: 5841 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813302.166385:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788813302.166391:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:3321:x1875706583726720:12345-0@lo:103: 00010000:00010000:2.0:1788813302.166400:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813302.166405:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb15c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb15bd expref: 13 pid: 5841 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.166421:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb15c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb15bd expref: 13 pid: 5841 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.166431:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb15c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb15bd expref: 13 pid: 5841 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.166445:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90874148d400/0x6d74dbab2ddb1673 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.166453:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90874148d400/0x6d74dbab2ddb1673 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.166467:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90874148d400/0x6d74dbab2ddb1673 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.166473:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90874148d400/0x6d74dbab2ddb1673 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.166479:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90874148d400/0x6d74dbab2ddb1673 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.166486:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90874148d400/0x6d74dbab2ddb1673 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.166491:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148d400 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:2.0:1788813302.166494:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90874148d400/0x6d74dbab2ddb1673 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.166502:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90874148d400/0x6d74dbab2ddb1673 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.166535:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90874148d400/0x6d74dbab2ddb1673 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.166544:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813302.166613:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:3321:x1875706583726720:12345-0@lo:103: Request processed in 221us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813302.166619:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788813302.166945:0:5841:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90874148d400/0x6d74dbab2ddb1673 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813302.166965:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90874148d400/0x6d74dbab2ddb1673 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813302.166972:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90874148d400/0x6d74dbab2ddb1673 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788813302.166986:0:5841:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788813302.168705:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583726720:0@lo:103: 00000100:00100000:1.0:1788813302.232794:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:7652:x1875706583725440:12345-0@lo:253: Request processed in 93728us (94394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813302.232929:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788813302.233023:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583725440:0@lo:253: 10000000:01000000:2.0:1788813302.233039:0:7652:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788813302.233042:0:7652:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788813302.233044:0:7652:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788813302.233046:0:7652:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813302.233047:0:7652:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788813302.233049:0:7652:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813302.233050:0:7652:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813302.233051:0:7652:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813302.233053:0:7652:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788813302.233055:0:7652:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813302.233056:0:7652:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788813302.233077:0:7652:0:(tgt_mount.c:101:server_register_mount()) register mount ffff908641187800 from lustre-OST0001 10000000:01000000:2.0:1788813302.233101:0:7652:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788813302.233104:0:7652:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788813302.233111:0:7652:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff908749b5cd40 local copy 10000000:01000000:2.0:1788813302.233115:0:7652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788813302.233153:0:7652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff9087413a1c00/0x6d74dbab2ddb167a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.233165:0:7652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.147@tcp lock: ffff9087413a1c00/0x6d74dbab2ddb167a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.233174:0:7652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff9087413a1c00/0x6d74dbab2ddb167a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813302.233218:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583726848:0@lo:101: 00000100:00100000:2.0:1788813302.233256:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813302.233343:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087454519c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813302.233389:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583726848 00000100:00100000:0.0:1788813302.233396:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583726848 00000100:00100000:0.0:1788813302.233483:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788813302.233494:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+11:7652:x1875706583726848:12345-0@lo:101: 00010000:00010000:0.0:1788813302.233509:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813302.233536:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908740031200/0x6d74dbab2ddb1681 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb167a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813302.233675:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908740031200/0x6d74dbab2ddb1681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb167a expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813302.233688:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908740031200/0x6d74dbab2ddb1681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb167a expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813302.233698:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740031200, rc 0) 00000100:00100000:1.0:1788813302.234142:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:7652:x1875706583726848:12345-0@lo:101: Request processed in 648us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813302.234150:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788813302.234242:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583726848:0@lo:101: 00010000:00010000:2.0:1788813302.234258:0:7652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff9087413a1c00/0x6d74dbab2ddb167a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x6d74dbab2ddb1681 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.234268:0:7652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff9087413a1c00/0x6d74dbab2ddb167a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6d74dbab2ddb1681 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813302.234396:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583726976:0@lo:501: 00000100:00100000:2.0:1788813302.234425:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813302.234620:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087454519c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813302.234765:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583726976 00000100:00100000:3.0:1788813302.234772:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583726976 00000100:00100000:3.0:1788813302.234809:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788813302.234819:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:7652:x1875706583726976:12345-0@lo:501: 00000100:00100000:3.0:1788813302.235026:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:7652:x1875706583726976:12345-0@lo:501: Request processed in 208us (599us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788813302.235033:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788813302.235260:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583726976:0@lo:501: 10000000:01000000:2.0:1788813302.235278:0:7652:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.147@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788813302.235307:0:7652:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.147@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788813302.235313:0:7652:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff9087413a1c00/0x6d74dbab2ddb167a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6d74dbab2ddb1681 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.235324:0:7652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff9087413a1c00/0x6d74dbab2ddb167a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6d74dbab2ddb1681 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.235332:0:7652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.147@tcp lock: ffff9087413a1c00/0x6d74dbab2ddb167a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6d74dbab2ddb1681 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.235355:0:7652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788813302.235387:0:7652:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff908641187800 10000000:01000000:2.0:1788813302.235392:0:7652:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788813302.235398:0:7652:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788813302.235401:0:7652:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788813302.235405:0:7652:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788813302.235408:0:7652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788813302.235432:0:7652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff9087413a1600/0x6d74dbab2ddb1688 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.235440:0:7652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff9087413a1600/0x6d74dbab2ddb1688 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.235451:0:7652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff9087413a1600/0x6d74dbab2ddb1688 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813302.235466:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583727104:0@lo:101: 00000100:00100000:2.0:1788813302.235494:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813302.235527:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff908745451540 going to sleep for 11 seconds 00010000:00010000:3.0:1788813302.235705:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813302.235712:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff9087413a1c00/0x6d74dbab2ddb167a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6d74dbab2ddb1681 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.235774:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a1c00 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:3.0:1788813302.235778:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff9087413a1c00/0x6d74dbab2ddb167a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6d74dbab2ddb1681 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.235787:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff9087413a1c00/0x6d74dbab2ddb167a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x6d74dbab2ddb1681 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813302.235795:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff9087413a1c00/0x6d74dbab2ddb167a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x6d74dbab2ddb1681 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813302.235856:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788813302.235876:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff9087413a1c00/0x6d74dbab2ddb167a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6d74dbab2ddb1681 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.235882:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788813302.235934:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583727232:0@lo:103: 00000100:00100000:2.0:1788813302.235964:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788813302.236013:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff9087413a1c00/0x6d74dbab2ddb167a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6d74dbab2ddb1681 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.236028:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff9087413a1c00/0x6d74dbab2ddb167a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6d74dbab2ddb1681 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.236041:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813302.236043:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813302.236045:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813302.236055:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583727104 00000100:00100000:3.0:1788813302.236059:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583727104 00000100:00100000:3.0:1788813302.236084:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788813302.236090:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:7652:x1875706583727104:12345-0@lo:101: 00010000:00010000:3.0:1788813302.236099:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813302.236113:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908750ad1c00/0x6d74dbab2ddb168f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb1688 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.236131:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908750ad1c00/0x6d74dbab2ddb168f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1688 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.236140:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908750ad1c00/0x6d74dbab2ddb168f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1688 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.236148:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad1c00, rc 0) 00000100:00100000:3.0:1788813302.236183:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:7652:x1875706583727104:12345-0@lo:101: Request processed in 92us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813302.236188:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788813302.236351:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583727232 00000100:00100000:3.0:1788813302.236355:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583727232 00000100:00100000:3.0:1788813302.236381:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788813302.236386:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:3321:x1875706583727232:12345-0@lo:103: 00010000:00010000:3.0:1788813302.236402:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813302.236415:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908740031200/0x6d74dbab2ddb1681 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d74dbab2ddb167a expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.236424:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813302.236939:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:3321:x1875706583727232:12345-0@lo:103: Request processed in 551us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813302.236947:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813302.237057:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583727232:0@lo:103: 00000100:00100000:2.0:1788813302.237098:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583727104:0@lo:101: 00010000:00010000:2.0:1788813302.237113:0:7652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff9087413a1600/0x6d74dbab2ddb1688 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb168f expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.237123:0:7652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff9087413a1600/0x6d74dbab2ddb1688 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb168f expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813302.237240:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583727360:0@lo:501: 00000100:00100000:2.0:1788813302.237286:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813302.237355:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff908745451540 going to sleep for 11 seconds 00000100:00100000:3.0:1788813302.237398:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583727360 00000100:00100000:3.0:1788813302.237403:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583727360 00000100:00100000:3.0:1788813302.237486:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788813302.237494:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:7652:x1875706583727360:12345-0@lo:501: 00000100:00100000:3.0:1788813302.238139:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:7652:x1875706583727360:12345-0@lo:501: Request processed in 644us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813302.238148:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788813302.238270:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583727360:0@lo:501: 00000100:00100000:2.0:1788813302.238312:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583727488:0@lo:503: 00000100:00100000:2.0:1788813302.238372:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813302.238400:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff908745451540 going to sleep for 11 seconds 00000100:00100000:0.0:1788813302.238488:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583727488 00000100:00100000:0.0:1788813302.238494:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583727488 00000100:00100000:0.0:1788813302.238540:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788813302.238831:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:7652:x1875706583727488:12345-0@lo:503: 00000100:00100000:0.0:1788813302.239013:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:7652:x1875706583727488:12345-0@lo:503: Request processed in 465us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813302.239027:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788813302.239134:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583727488:0@lo:503: 00000040:00080000:1.0:1788813302.239433:0:7652:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788813302.239494:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583727616:0@lo:502: 00000100:00100000:1.0:1788813302.239561:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813302.239622:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c1c7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813302.239952:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583727616 00000100:00100000:0.0:1788813302.239958:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583727616 00000100:00100000:0.0:1788813302.239999:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788813302.240007:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:7652:x1875706583727616:12345-0@lo:502: 00000100:00100000:0.0:1788813302.240163:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:7652:x1875706583727616:12345-0@lo:502: Request processed in 155us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813302.240169:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788813302.240489:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583727616:0@lo:502: 00000040:00080000:1.0:1788813302.241071:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788813302.241130:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788813302.241167:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788813302.241232:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788813302.241271:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788813302.241305:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788813302.241339:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583727744:0@lo:502: 00000100:00100000:1.0:1788813302.241394:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813302.241705:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c1c7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813302.242652:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583727744 00000100:00100000:3.0:1788813302.242661:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583727744 00000100:00100000:3.0:1788813302.242709:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788813302.242719:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:7652:x1875706583727744:12345-0@lo:502: 00000100:00100000:3.0:1788813302.242941:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:7652:x1875706583727744:12345-0@lo:502: Request processed in 223us (1546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813302.242950:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788813302.242973:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583727744:0@lo:502: 00000040:00080000:1.0:1788813302.243098:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788813302.243112:0:7652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788813302.244079:0:7660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788813302.244089:0:7660:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788813302.244322:0:7660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813302.244325:0:7660:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788813302.244332:0:7660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788813302.244346:0:7660:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90876fac3380) 00000020:00000080:1.0:1788813302.244371:0:7660:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788813302.244377:0:7660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788813302.244436:0:7660:0:(tgt_mount.c:153:server_get_mount()) get mount ffff908641187800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788813302.244444:0:7660:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788813302.244450:0:7660:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6d74dbab2ddb169d 00010000:00010000:1.0:1788813302.249127:0:7660:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1788813302.249471:0:7660:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788813302.253033:0:7660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788813302.253325:0:7660:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788813302.259030:0:7660:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788813302.259665:0:7660:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788813302.261466:0:7660:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788813302.261477:0:7660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813302.261483:0:7660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813302.261485:0:7660:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788813302.261489:0:7660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813302.261492:0:7660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813302.261493:0:7660:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788813302.261496:0:7660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788813302.261498:0:7660:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788813302.262910:0:7660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813302.262919:0:7660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813302.262921:0:7660:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788813302.262926:0:7660:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788813302.263114:0:7652:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788813302.263141:0:7652:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788813302.263164:0:7652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff9087413a1600/0x6d74dbab2ddb1688 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb168f expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.263187:0:7652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff9087413a1600/0x6d74dbab2ddb1688 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb168f expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813302.263206:0:7652:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff908641187800 from 1 10000000:01000000:1.0:1788813302.263209:0:7652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788813302.263242:0:7652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148c400/0x6d74dbab2ddb16a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.263250:0:7652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff90874148c400/0x6d74dbab2ddb16a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.263262:0:7652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff90874148c400/0x6d74dbab2ddb16a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813302.263283:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583727872:0@lo:101: 00000100:00100000:1.0:1788813302.263345:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813302.263380:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff908759e3f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788813302.265676:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583727872 00000100:00100000:0.0:1788813302.265688:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583727872 00000100:00100000:0.0:1788813302.265761:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788813302.265772:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:7652:x1875706583727872:12345-0@lo:101: 00010000:00010000:0.0:1788813302.265789:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813302.265819:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908740030000/0x6d74dbab2ddb16ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb16a4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813302.265848:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908740030000/0x6d74dbab2ddb16ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb16a4 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813302.265860:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908740030000/0x6d74dbab2ddb16ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb16a4 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813302.265869:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740030000, rc 0) 00000100:00100000:0.0:1788813302.265947:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:7652:x1875706583727872:12345-0@lo:101: Request processed in 177us (2601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813302.265955:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788813302.266221:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583727872:0@lo:101: 00010000:00010000:2.0:1788813302.266242:0:7652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff90874148c400/0x6d74dbab2ddb16a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb16ab expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.266252:0:7652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff90874148c400/0x6d74dbab2ddb16a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb16ab expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813302.266388:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583728000:0@lo:501: 00000100:00100000:2.0:1788813302.266427:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813302.266469:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff908745451240 going to sleep for 11 seconds 00000100:00100000:1.0:1788813302.266747:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583728000 00000100:00100000:1.0:1788813302.266754:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583728000 00000100:00100000:1.0:1788813302.266787:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788813302.266795:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:7652:x1875706583728000:12345-0@lo:501: 00000100:00100000:1.0:1788813302.267146:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:7652:x1875706583728000:12345-0@lo:501: Request processed in 351us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813302.267154:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788813302.267294:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583728000:0@lo:501: 00000100:00100000:2.0:1788813302.267326:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583728128:0@lo:503: 00000100:00100000:2.0:1788813302.267362:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813302.267392:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff908745451240 going to sleep for 11 seconds 00000100:00100000:2.0:1788813302.267411:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583728128 00000100:00100000:2.0:1788813302.267415:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583728128 00000100:00100000:2.0:1788813302.267448:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788813302.267456:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:7652:x1875706583728128:12345-0@lo:503: 00000100:00100000:2.0:1788813302.268023:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:7652:x1875706583728128:12345-0@lo:503: Request processed in 566us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813302.268031:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788813302.268078:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583728128:0@lo:503: 00000040:00080000:2.0:1788813302.268361:0:7652:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788813302.268429:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583728256:0@lo:502: 00000100:00100000:2.0:1788813302.268465:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813302.268485:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff908745451240 going to sleep for 11 seconds 00000100:00100000:2.0:1788813302.268503:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583728256 00000100:00100000:2.0:1788813302.268507:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583728256 00000100:00100000:2.0:1788813302.268547:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788813302.268555:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:7652:x1875706583728256:12345-0@lo:502: 00000100:00100000:2.0:1788813302.269211:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:7652:x1875706583728256:12345-0@lo:502: Request processed in 655us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813302.269226:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788813302.269277:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583728256:0@lo:502: 00000040:00080000:2.0:1788813302.270954:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788813302.271043:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788813302.271088:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583728384:0@lo:502: 00000100:00100000:2.0:1788813302.271171:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813302.271276:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff908745451240 going to sleep for 11 seconds 00000100:00100000:0.0:1788813302.276022:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583728384 00000100:00100000:0.0:1788813302.276039:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583728384 00000100:00100000:1.0:1788813302.277962:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788813302.277979:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:7652:x1875706583728384:12345-0@lo:502: 00000100:00100000:1.0:1788813302.278276:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:7652:x1875706583728384:12345-0@lo:502: Request processed in 301us (7105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813302.278291:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788813302.278396:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583728384:0@lo:502: 00000040:00080000:2.0:1788813302.278634:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788813302.278653:0:7652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788813302.279302:0:7664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813302.279311:0:7664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813302.279314:0:7664:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788813302.279319:0:7664:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff908641187800 00000020:00000080:2.0:1788813302.279322:0:7664:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788813302.279339:0:7664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813302.279341:0:7664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813302.279343:0:7664:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788813302.279345:0:7664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788813302.279458:0:7652:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788813302.279492:0:7652:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788813302.279514:0:7652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148c400/0x6d74dbab2ddb16a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb16ab expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.279527:0:7652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff90874148c400/0x6d74dbab2ddb16a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb16ab expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813302.279612:0:7652:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788813302.279615:0:7652:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff908641187800 10000000:01000000:3.0:1788813302.279619:0:7652:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff908641187800 10000000:01000000:3.0:1788813302.279623:0:7652:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788813302.279629:0:7652:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff908641187800 from 1 10000000:01000000:3.0:1788813302.279632:0:7652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788813302.279665:0:7652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908750ad1000/0x6d74dbab2ddb16b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.279673:0:7652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908750ad1000/0x6d74dbab2ddb16b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.279685:0:7652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908750ad1000/0x6d74dbab2ddb16b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813302.279710:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583728512:0@lo:101: 00000100:00100000:3.0:1788813302.279791:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813302.280308:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c1c9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813302.280380:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583728512 00000100:00100000:0.0:1788813302.280389:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583728512 00000100:00100000:0.0:1788813302.280432:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788813302.280442:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:7652:x1875706583728512:12345-0@lo:101: 00010000:00010000:0.0:1788813302.280455:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813302.280469:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908740031800/0x6d74dbab2ddb16b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb16b2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813302.280495:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908740031800/0x6d74dbab2ddb16b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb16b2 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813302.280508:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908740031800/0x6d74dbab2ddb16b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb16b2 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813302.280529:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740031800, rc 0) 00000100:00100000:0.0:1788813302.280608:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:7652:x1875706583728512:12345-0@lo:101: Request processed in 167us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813302.280614:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788813302.280961:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583728512:0@lo:101: 00010000:00010000:3.0:1788813302.280979:0:7652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908750ad1000/0x6d74dbab2ddb16b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb16b9 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.280989:0:7652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908750ad1000/0x6d74dbab2ddb16b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb16b9 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813302.281100:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583728640:0@lo:501: 00000100:00100000:3.0:1788813302.281139:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813302.281175:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c1c9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813302.281238:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583728640 00000100:00100000:1.0:1788813302.281243:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583728640 00000100:00100000:1.0:1788813302.281271:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788813302.281279:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:7652:x1875706583728640:12345-0@lo:501: 00000100:00100000:1.0:1788813302.281792:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:7652:x1875706583728640:12345-0@lo:501: Request processed in 511us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813302.281811:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788813302.282311:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583728640:0@lo:501: 00000100:00100000:3.0:1788813302.282357:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583728768:0@lo:503: 00000100:00100000:3.0:1788813302.282425:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813302.282491:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c1c9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813302.282889:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583728768 00000100:00100000:0.0:1788813302.282895:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583728768 00000100:00100000:0.0:1788813302.282982:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788813302.282993:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:7652:x1875706583728768:12345-0@lo:503: 00000100:00100000:0.0:1788813302.283177:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:7652:x1875706583728768:12345-0@lo:503: Request processed in 186us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813302.283184:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788813302.283265:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583728768:0@lo:503: 00000040:00080000:3.0:1788813302.283653:0:7652:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788813302.283752:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583728896:0@lo:502: 00000100:00100000:3.0:1788813302.283810:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813302.284337:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c1c9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813302.284396:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583728896 00000100:00100000:1.0:1788813302.284402:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583728896 00000100:00100000:1.0:1788813302.284435:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788813302.284443:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:7652:x1875706583728896:12345-0@lo:502: 00000100:00100000:1.0:1788813302.285087:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:7652:x1875706583728896:12345-0@lo:502: Request processed in 641us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813302.285095:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788813302.285241:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583728896:0@lo:502: 00000040:00080000:3.0:1788813302.285487:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788813302.285909:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788813302.285946:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788813302.286014:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788813302.286044:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788813302.286088:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788813302.286123:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788813302.286155:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788813302.286219:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788813302.286260:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788813302.286297:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788813302.286363:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788813302.286402:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788813302.286437:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788813302.286498:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788813302.287012:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788813302.287047:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788813302.287093:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788813302.287140:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788813302.287202:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788813302.287257:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788813302.287292:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788813302.287320:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788813302.287364:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788813302.287396:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788813302.287428:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788813302.287477:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788813302.287872:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1788813302.288014:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788813302.288074:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1788813302.288113:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1788813302.288148:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1788813302.288182:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1788813302.288248:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1788813302.288309:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1788813302.288362:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1788813302.288399:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1788813302.288456:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583729024:0@lo:502: 00000100:00100000:2.0:1788813302.291105:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813302.291291:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff908745451b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788813302.291330:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583729024 00000100:00100000:3.0:1788813302.291339:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583729024 00000100:00100000:3.0:1788813302.291439:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788813302.291449:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:7652:x1875706583729024:12345-0@lo:502: 00000100:00100000:3.0:1788813302.292408:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:7652:x1875706583729024:12345-0@lo:502: Request processed in 957us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813302.292419:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788813302.292527:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583729024:0@lo:502: 00000040:00080000:2.0:1788813302.292690:0:7652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1788813302.292707:0:7652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788813302.293705:0:7665:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788813302.293989:0:7665:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9087601a8000) 00000020:00000080:2.0:1788813302.294011:0:7665:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1788813302.294106:0:7665:0:(tgt_mount.c:153:server_get_mount()) get mount ffff908641187800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788813302.294110:0:7665:0:(tgt_mount.c:187:server_put_mount()) put mount ffff908641187800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788813302.294112:0:7665:0:(obd_mount.c:710:lustre_put_lsi()) put ffff908641187800 3 00010000:00080000:2.0:1788813302.294150:0:7665:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90876e4d2800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.147@tcp at head 00010000:00010000:2.0:1788813302.297418:0:7665:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788813302.297752:0:7665:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788813302.297793:0:7665:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788813302.297818:0:7665:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x6d74dbab2ddb16c7 00000100:00080000:2.0:1788813302.297829:0:7665:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788813302.297841:0:7665:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90876e4d2800 using connection 192.168.204.147@tcp/0@lo 00000100:00100000:2.0:1788813302.297893:0:7665:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90877c3ece00 x1875706583729152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788813302.297916:0:7665:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788813302.298316:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875706583729408:0@lo:400: 00000100:00100000:1.0:1788813302.298385:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813302.298422:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813302.298428:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875706583729280:0@lo:400: 00000100:00100000:1.0:1788813302.298451:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813302.298476:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583729536:0@lo:400: 00000100:00100000:1.0:1788813302.298500:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813302.298534:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583729408 00000100:00100000:1.0:1788813302.298540:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583729408 00000100:00100000:1.0:1788813302.298615:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583729280 00000100:00100000:1.0:1788813302.298618:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583729280 00000100:00100000:1.0:1788813302.298646:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788813302.298653:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875706583729408:12345-0@lo:400: 00000100:00100000:1.0:1788813302.298703:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875706583729408:12345-0@lo:400: Request processed in 50us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813302.298710:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788813302.298740:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788813302.298746:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875706583729280:12345-0@lo:400: 00000100:00100000:1.0:1788813302.298773:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875706583729280:12345-0@lo:400: Request processed in 28us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813302.298779:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788813302.298813:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583729536 00000100:00100000:1.0:1788813302.298817:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583729536 00000100:00100000:1.0:1788813302.298843:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813302.298850:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583729536:12345-0@lo:400: 00000100:00100000:1.0:1788813302.298883:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583729536:12345-0@lo:400: Request processed in 34us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813302.298890:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788813302.298904:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788813302.298909:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788813302.298939:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90877c3eb800 x1875706583729536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813302.298952:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583729536:0@lo:400: 00010000:00080000:1.0:1788813302.298977:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90877c3eb480 x1875706583729280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813302.298985:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875706583729280:0@lo:400: 00010000:00080000:1.0:1788813302.298994:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90877c3e9180 x1875706583729408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813302.299008:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875706583729408:0@lo:400: 00000100:00100000:3.0:1788813302.299237:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3317:1875706583729152:0@lo:38: 00000100:00100000:3.0:1788813302.299275:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788813302.299973:0:7665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:2.0:1788813302.300146:0:7666:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff90877c3ef480 x1875706583729664/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813302.300157:0:7666:0:(client.c:2716:ptlrpc_set_wait()) set ffff908745451240 going to sleep for 0 seconds 00000020:01000000:3.0:1788813302.300214:0:7652:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788813302.300245:0:7652:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788813302.300266:0:7652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908750ad1000/0x6d74dbab2ddb16b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb16b9 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.300277:0:7652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908750ad1000/0x6d74dbab2ddb16b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb16b9 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788813302.300327:0:7652:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788813302.300329:0:7652:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788813302.300331:0:7652:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813302.300336:0:7652:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813302.300337:0:7652:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813302.300339:0:7652:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813302.300340:0:7652:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788813302.300341:0:7652:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788813302.300343:0:7652:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788813302.300344:0:7652:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813302.300345:0:7652:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788813302.300349:0:7652:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788813302.300351:0:7652:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788813302.300353:0:7652:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788813302.300354:0:7652:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813302.300354:0:7652:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813302.300355:0:7652:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813302.300356:0:7652:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813302.300357:0:7652:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788813302.300358:0:7652:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788813302.300359:0:7652:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788813302.300360:0:7652:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813302.300361:0:7652:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788813302.300375:0:7652:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788813302.300383:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583729792:0@lo:253: 00000100:00100000:3.0:1788813302.300441:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813302.300467:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c1c9600 going to sleep for 11 seconds 00000100:00100000:1.0:1788813302.300555:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583729152 00000100:00100000:1.0:1788813302.300564:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583729152 00000100:00100000:1.0:1788813302.300624:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813302.300630:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3317:x1875706583729152:12345-0@lo:38: 00010000:00080000:1.0:1788813302.300655:0:5851:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:1.0:1788813302.300687:0:5851:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x6d74dbab2ddb16ce 00000004:00100000:1.0:1788813302.300702:0:5851:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788813302.300937:0:5851:0:(import.c:65:import_set_state_nolock()) ffff908749b85000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813302.300995:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875706583729152:12345-0@lo:38: Request processed in 362us (1718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813302.301002:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788813302.301047:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90877c3ece00 x1875706583729152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813302.301057:0:3317:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788813302.301065:0:3317:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788813302.301072:0:3317:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788813302.301076:0:3317:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788813302.301078:0:3317:0:(import.c:65:import_set_state_nolock()) ffff90876e4d2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788813302.301084:0:3317:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000c5b5db5d): req@ffff90877c3ef480 x1875706583729664/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813302.301097:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3317:1875706583729152:0@lo:38: 00000100:00100000:2.0:1788813302.301270:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583729792 00000100:00100000:2.0:1788813302.301275:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583729792 00000100:00100000:2.0:1788813302.301303:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788813302.301322:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:7652:x1875706583729792:12345-0@lo:253: 20000000:01000000:2.0:1788813302.301343:0:5844:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788813302.301356:0:5844:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788813302.301687:0:7666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813302.301730:0:7666:0:(client.c:2716:ptlrpc_set_wait()) set ffff908745451240 going to sleep for 11 seconds 00000100:00100000:1.0:1788813302.303023:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583729664 00000100:00100000:1.0:1788813302.303035:0:5860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583729664 00000100:00100000:1.0:1788813302.303101:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813302.303121:0:5860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7666:x1875706583729664:12345-0@lo:901: 00000100:00100000:1.0:1788813302.303505:0:5860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7666:x1875706583729664:12345-0@lo:901: Request processed in 386us (1818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813302.303526:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788813302.303605:0:7666:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90877c3ef480 x1875706583729664/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788813318 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813302.303622:0:7666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ef480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7666:1875706583729664:0@lo:901: 00000100:00080000:3.0:1788813302.304009:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:0.0:1788813302.358886:0:5844:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788813302.358940:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788813302.361927:0:5865:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788813302.361940:0:5865:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788813302.361991:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb16d5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.362010:0:5865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90874148ca00/0x6d74dbab2ddb1626 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb161f expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.362018:0:5865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb16d5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.362061:0:5865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90874148ca00/0x6d74dbab2ddb1626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb161f expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.362076:0:5865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90874148ca00/0x6d74dbab2ddb1626 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb161f expref: 14 pid: 5844 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813302.362090:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1875706583729920:0@lo:104: 00000100:00100000:1.0:1788813302.362157:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813302.362230:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c1c9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813302.362407:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583729920 00000100:00100000:3.0:1788813302.362415:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583729920 00000100:00100000:3.0:1788813302.362480:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788813302.362490:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+3:5865:x1875706583729920:12345-0@lo:104: 00010000:00010000:3.0:1788813302.362503:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb161f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb1626 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.362911:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788813302.362919:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+3:5865:x1875706583729920:12345-0@lo:104: Request processed in 431us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813302.362940:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788813302.363059:0:7658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813302.363066:0:7658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb161f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb1626 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.363074:0:7658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740030200 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:2.0:1788813302.363078:0:7658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb161f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb1626 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.363086:0:7658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb161f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb1626 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813302.363093:0:7658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb161f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb1626 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813302.363099:0:7658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788813302.363138:0:7658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb161f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1626 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.363145:0:7658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813302.363160:0:7658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb161f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1626 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.363167:0:7658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb161f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1626 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813302.363182:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813302.363183:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813302.363185:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813302.363299:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583730048:0@lo:103: 00000100:00100000:1.0:1788813302.363341:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813302.363418:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5865:1875706583729920:0@lo:104: 00010000:00010000:1.0:1788813302.363439:0:5865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb16d5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813302.364132:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583730048 00000100:00100000:3.0:1788813302.364140:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583730048 00010000:00010000:3.0:1788813302.364172:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90874148ca00/0x6d74dbab2ddb1626 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb161f expref: 15 pid: 5844 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813302.364216:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788813302.364224:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:3321:x1875706583730048:12345-0@lo:103: 00010000:00010000:3.0:1788813302.364236:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813302.364242:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90874148ca00/0x6d74dbab2ddb1626 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb161f expref: 15 pid: 5844 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.364253:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90874148ca00/0x6d74dbab2ddb1626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb161f expref: 15 pid: 5844 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.364267:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90874148ca00/0x6d74dbab2ddb1626 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb161f expref: 15 pid: 5844 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.364282:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb16d5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.364290:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb16d5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788813302.364303:0:5834:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002952162s 00010000:00010000:3.0:1788813302.364308:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb16d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.364315:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb16d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.364334:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb16d5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.364341:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb16d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.364346:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148ce00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:3.0:1788813302.364350:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb16d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.364357:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb16d5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.364369:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb16d5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813302.364377:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813302.364425:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:3321:x1875706583730048:12345-0@lo:103: Request processed in 202us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813302.364432:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788813302.364884:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583730048:0@lo:103: 00010000:00010000:1.0:1788813302.364922:0:5865:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb16d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.364931:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb16d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813302.364937:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb16d5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813302.373359:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:7652:x1875706583729792:12345-0@lo:253: Request processed in 72030us (72908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813302.373374:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788813302.373537:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd1fd158-af17-4a1b-8f0b-82e57114d008:7652:1875706583729792:0@lo:253: 10000000:01000000:3.0:1788813302.373791:0:7652:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788813302.373795:0:7652:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788813302.373869:0:7652:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788813302.373871:0:7652:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813302.373872:0:7652:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813302.373873:0:7652:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813302.373875:0:7652:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813302.373876:0:7652:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788813302.373877:0:7652:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788813302.373879:0:7652:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788813302.373896:0:7652:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813302.373898:0:7652:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788813302.373917:0:7652:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788813302.380411:0:7652:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788813302.380677:0:7652:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788813302.380883:0:7652:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788813302.383116:0:7652:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788813302.384069:0:7652:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788813302.384415:0:7652:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788813302.387272:0:7652:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1788813302.469448:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788813302.716924:0:7652:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788813302.716933:0:7652:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788813302.716976:0:7652:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788813302.717044:0:7652:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.147@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788813302.717061:0:7652:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788813302.717087:0:7652:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788813303.486864:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813304.509978:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813305.532820:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813305.533752:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813305.533776:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583730176:0@lo:13: 00000100:00100000:1.0:1788813305.533848:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813305.533958:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583730176 00000100:00100000:2.0:1788813305.533967:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583730176 00000100:00100000:2.0:1788813305.534038:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788813305.534049:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583730176:12345-0@lo:13: 00002000:00000024:2.0:1788813305.534086:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813305.534150:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583730176:12345-0@lo:13: Request processed in 103us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813305.534157:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788813305.534203:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3ec380 x1875706583730176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813305.534222:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583730176:0@lo:13: 00000100:00080000:1.0:1788813305.534330:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788813306.570877:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813307.583386:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583730432:0@lo:400: 00000100:00100000:1.0:1788813307.583462:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813307.583531:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813307.583539:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583730560:0@lo:400: 00000100:00100000:1.0:1788813307.583561:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813307.583628:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583730432 00000100:00100000:1.0:1788813307.583639:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583730432 00000100:00100000:1.0:1788813307.583695:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583730560 00000100:00100000:1.0:1788813307.583707:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583730560 00000100:00100000:1.0:1788813307.583743:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788813307.583752:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583730432:12345-0@lo:400: 00000100:00100000:1.0:1788813307.583825:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583730432:12345-0@lo:400: Request processed in 58us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813307.583833:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788813307.583857:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788813307.583864:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583730560:12345-0@lo:400: 00000100:00100000:1.0:1788813307.583894:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583730560:12345-0@lo:400: Request processed in 30us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813307.583899:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788813307.583922:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813307.584096:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd1fd158-af17-4a1b-8f0b-82e57114d008:3319:1875706583730304:0@lo:400: 00000100:00100000:2.0:1788813307.584150:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813307.584176:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875706583730816:0@lo:400: 00000100:00100000:2.0:1788813307.584206:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813307.584230:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813307.584237:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e4a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583730688:0@lo:400: 00000100:00100000:2.0:1788813307.584261:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813307.584291:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583730688 00000100:00100000:2.0:1788813307.584295:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583730688 00000100:00100000:2.0:1788813307.584337:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788813307.584345:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583730688:12345-0@lo:400: 00000100:00100000:2.0:1788813307.584385:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583730688:12345-0@lo:400: Request processed in 40us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813307.584391:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788813307.584422:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788813307.584445:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e4a3b80 x1875706583730688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813307.584460:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e4a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583730688:0@lo:400: 00000100:00100000:2.0:1788813307.584482:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583730816 00000100:00100000:2.0:1788813307.584485:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583730816 00000100:00100000:2.0:1788813307.584509:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788813307.584515:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875706583730816:12345-0@lo:400: 00000100:00100000:2.0:1788813307.584544:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875706583730816:12345-0@lo:400: Request processed in 30us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813307.584549:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788813307.584562:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788813307.584574:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e4a0380 x1875706583730816/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813307.584613:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875706583730816:0@lo:400: 00000100:00100000:2.0:1788813307.584668:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583730304 00000100:00100000:2.0:1788813307.584671:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583730304 00000100:00100000:2.0:1788813307.584694:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788813307.584701:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:3319:x1875706583730304:12345-0@lo:400: 00000100:00100000:2.0:1788813307.584733:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:3319:x1875706583730304:12345-0@lo:400: Request processed in 32us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813307.584739:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788813307.584786:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd1fd158-af17-4a1b-8f0b-82e57114d008:3319:1875706583730304:0@lo:400: 00010000:00080000:1.0:1788813307.584861:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3e9500 x1875706583730560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813307.584872:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583730560:0@lo:400: 00010000:00080000:1.0:1788813307.584886:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3e8700 x1875706583730432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813307.584893:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583730432:0@lo:400: 00010000:00010000:3.0:1788813307.591100:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813308.611406:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813309.628712:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788813309.990119:0:8009:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg447-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788813310.652893:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813310.653762:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583730944:0@lo:13: 00000100:00100000:3.0:1788813310.653840:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813310.653969:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583730944 00000100:00100000:2.0:1788813310.653978:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583730944 00000100:00100000:2.0:1788813310.654057:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788813310.654075:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583730944:12345-0@lo:13: 00002000:00000024:2.0:1788813310.654112:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813310.654161:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583730944:12345-0@lo:13: Request processed in 89us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813310.654168:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788813310.654299:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788813310.654338:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3ed880 x1875706583730944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813310.654358:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583730944:0@lo:13: 00010000:00010000:0.0:1788813311.676749:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788813312.188971:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788813312.188979:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff908774402000 from 30 10000000:01000000:3.0:1788813312.188984:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788813312.189046:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908750ad0600/0x6d74dbab2ddb16dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813312.189070:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908750ad0600/0x6d74dbab2ddb16dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813312.189103:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908750ad0600/0x6d74dbab2ddb16dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813312.189126:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583731072:0@lo:101: 00000100:00100000:3.0:1788813312.189199:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813312.189246:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876e623cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813312.189629:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583731072 00000100:00100000:1.0:1788813312.189639:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583731072 00000100:00100000:1.0:1788813312.189698:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788813312.189708:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:5846:x1875706583731072:12345-0@lo:101: 00010000:00010000:1.0:1788813312.189722:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813312.189735:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb16e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb16dc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813312.189773:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb16e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb16dc expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813312.189785:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb16e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb16dc expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813312.189795:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148ce00, rc 0) 00000100:00100000:1.0:1788813312.189896:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:5846:x1875706583731072:12345-0@lo:101: Request processed in 189us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813312.189903:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788813312.196343:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583731072:0@lo:101: 00010000:00010000:0.0:1788813312.196376:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908750ad0600/0x6d74dbab2ddb16dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb16e3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813312.196389:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908750ad0600/0x6d74dbab2ddb16dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb16e3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813312.196485:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583731200:0@lo:501: 00000100:00100000:0.0:1788813312.196551:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813312.196632:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876e5a2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788813312.198771:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583731200 00000100:00100000:1.0:1788813312.198788:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583731200 00000100:00100000:1.0:1788813312.198869:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788813312.198879:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:5846:x1875706583731200:12345-0@lo:501: 00000100:00100000:1.0:1788813312.199746:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:5846:x1875706583731200:12345-0@lo:501: Request processed in 866us (3192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813312.199756:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788813312.208772:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583731200:0@lo:501: 00000100:00100000:3.0:1788813312.208843:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583731328:0@lo:503: 00000100:00100000:3.0:1788813312.208923:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813312.209064:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876e6236c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813312.224394:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583731328 00000100:00100000:2.0:1788813312.224411:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583731328 00000100:00100000:2.0:1788813312.224489:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788813312.224501:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:5846:x1875706583731328:12345-0@lo:503: 00000100:00100000:2.0:1788813312.224943:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:5846:x1875706583731328:12345-0@lo:503: Request processed in 443us (16018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813312.224958:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788813312.225045:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583731328:0@lo:503: 00000100:00100000:2.0:1788813312.225260:0:8113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8113:1875706583731456:0@lo:502: 00000100:00100000:2.0:1788813312.225303:0:8113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813312.225331:0:8113:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876ea79180 going to sleep for 11 seconds 00000100:00100000:1.0:1788813312.225711:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583731456 00000100:00100000:1.0:1788813312.225718:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583731456 00000100:00100000:1.0:1788813312.225759:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788813312.225767:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:8113:x1875706583731456:12345-0@lo:502: 00000100:00100000:1.0:1788813312.226026:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:8113:x1875706583731456:12345-0@lo:502: Request processed in 259us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813312.226033:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788813312.226354:0:8113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8113:1875706583731456:0@lo:502: 00000100:00100000:2.0:1788813312.226405:0:8113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8113:1875706583731584:0@lo:502: 00000100:00100000:2.0:1788813312.226444:0:8113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813312.226476:0:8113:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876ea79180 going to sleep for 11 seconds 00000100:00100000:1.0:1788813312.227099:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583731584 00000100:00100000:1.0:1788813312.227106:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583731584 00000100:00100000:1.0:1788813312.227148:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788813312.227166:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:8113:x1875706583731584:12345-0@lo:502: 00000100:00100000:1.0:1788813312.227355:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:8113:x1875706583731584:12345-0@lo:502: Request processed in 189us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813312.227362:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788813312.227528:0:8113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8113:1875706583731584:0@lo:502: 00000040:00080000:2.0:1788813312.227555:0:8113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788813312.230355:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788813312.230391:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788813312.230402:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908750ad0600/0x6d74dbab2ddb16dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb16e3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813312.230414:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908750ad0600/0x6d74dbab2ddb16dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb16e3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813312.230425:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788813312.230428:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788813312.230431:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788813312.230475:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb16ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813312.230483:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb16ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813312.230493:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb16ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813312.230517:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583731712:0@lo:101: 00000100:00100000:1.0:1788813312.230628:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813312.230669:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff908745451b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788813312.231259:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583731712 00000100:00100000:2.0:1788813312.231271:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583731712 00000100:00100000:2.0:1788813312.231319:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788813312.231329:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:5846:x1875706583731712:12345-0@lo:101: 00010000:00010000:2.0:1788813312.231357:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813312.231373:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb16f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb16ea expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813312.231402:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb16f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb16ea expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813312.231413:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb16f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb16ea expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813312.231421:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9087413a0400, rc 0) 00000100:00100000:2.0:1788813312.232479:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:5846:x1875706583731712:12345-0@lo:101: Request processed in 1144us (1843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813312.232490:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788813312.239752:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e4a0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583731712:0@lo:101: 00010000:00010000:3.0:1788813312.239783:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb16ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb16f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813312.239797:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb16ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb16f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813312.239884:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583731840:0@lo:501: 00000100:00100000:3.0:1788813312.239944:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813312.239989:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876e6236c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813312.240187:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583731840 00000100:00100000:2.0:1788813312.240194:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583731840 00000100:00100000:2.0:1788813312.240245:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788813312.240255:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:5846:x1875706583731840:12345-0@lo:501: 00000100:00100000:2.0:1788813312.240520:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:5846:x1875706583731840:12345-0@lo:501: Request processed in 266us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813312.240527:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788813312.240616:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583731840:0@lo:501: 00000100:00100000:0.0:1788813312.240647:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583731968:0@lo:503: 00000100:00100000:0.0:1788813312.240684:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813312.240709:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876e5a2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788813312.240776:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583731968 00000100:00100000:2.0:1788813312.240781:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583731968 00000100:00100000:2.0:1788813312.240813:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788813312.240820:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:5846:x1875706583731968:12345-0@lo:503: 00000100:00100000:2.0:1788813312.241117:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:5846:x1875706583731968:12345-0@lo:503: Request processed in 296us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813312.241123:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788813312.241167:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583731968:0@lo:503: 00000100:00100000:2.0:1788813312.241335:0:8114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8114:1875706583732096:0@lo:502: 00000100:00100000:2.0:1788813312.241369:0:8114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813312.241388:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583732096 00000100:00100000:2.0:1788813312.241392:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583732096 00000100:00100000:2.0:1788813312.241409:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788813312.241415:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:8114:x1875706583732096:12345-0@lo:502: 00000100:00100000:2.0:1788813312.241568:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:8114:x1875706583732096:12345-0@lo:502: Request processed in 153us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813312.241576:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788813312.241635:0:8114:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876ea79600 going to sleep for 11 seconds 00000100:00100000:2.0:1788813312.241646:0:8114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8114:1875706583732096:0@lo:502: 00000020:01000000:2.0:1788813312.241665:0:8114:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813312.241673:0:8114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813312.241675:0:8114:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788813312.241679:0:8114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788813312.241681:0:8114:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788813312.241695:0:8114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8114:1875706583732224:0@lo:502: 00000100:00100000:2.0:1788813312.241722:0:8114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813312.241740:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583732224 00000100:00100000:2.0:1788813312.241743:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583732224 00000100:00100000:2.0:1788813312.241758:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788813312.241763:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:8114:x1875706583732224:12345-0@lo:502: 00000100:00100000:2.0:1788813312.241858:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:8114:x1875706583732224:12345-0@lo:502: Request processed in 94us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813312.241864:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788813312.241889:0:8114:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876ea79600 going to sleep for 11 seconds 00000100:00100000:2.0:1788813312.241903:0:8114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8114:1875706583732224:0@lo:502: 00000020:01000000:2.0:1788813312.241917:0:8114:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813312.241920:0:8114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813312.241922:0:8114:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788813312.241925:0:8114:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788813312.241967:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788813312.241985:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788813312.241993:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb16ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb16f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813312.242015:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb16ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb16f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813312.242025:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788813312.242027:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff908781c96000 from 30 10000000:01000000:2.0:1788813312.242030:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788813312.242053:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff9087413a0800/0x6d74dbab2ddb16f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813312.242062:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff9087413a0800/0x6d74dbab2ddb16f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813312.242071:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff9087413a0800/0x6d74dbab2ddb16f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813312.242082:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583732352:0@lo:101: 00000100:00100000:2.0:1788813312.242105:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813312.242118:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876ea79600 going to sleep for 11 seconds 00000100:00100000:2.0:1788813312.242128:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583732352 00000100:00100000:2.0:1788813312.242131:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583732352 00000100:00100000:2.0:1788813312.242152:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788813312.242157:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:5846:x1875706583732352:12345-0@lo:101: 00010000:00010000:2.0:1788813312.242165:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813312.242175:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9087413a1c00/0x6d74dbab2ddb16ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb16f8 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813312.242195:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9087413a1c00/0x6d74dbab2ddb16ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb16f8 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813312.242206:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9087413a1c00/0x6d74dbab2ddb16ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb16f8 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813312.242215:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9087413a1c00, rc 0) 00000100:00100000:2.0:1788813312.242242:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:5846:x1875706583732352:12345-0@lo:101: Request processed in 85us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813312.242248:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788813312.242272:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583732352:0@lo:101: 00010000:00010000:2.0:1788813312.242282:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff9087413a0800/0x6d74dbab2ddb16f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb16ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813312.242291:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff9087413a0800/0x6d74dbab2ddb16f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb16ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813312.242322:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583732480:0@lo:501: 00000100:00100000:2.0:1788813312.242343:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813312.242355:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876ea79600 going to sleep for 11 seconds 00000100:00100000:2.0:1788813312.242365:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583732480 00000100:00100000:2.0:1788813312.242368:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583732480 00000100:00100000:2.0:1788813312.242391:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788813312.242406:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:5846:x1875706583732480:12345-0@lo:501: 00000100:00100000:2.0:1788813312.242621:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:5846:x1875706583732480:12345-0@lo:501: Request processed in 215us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813312.242627:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788813312.242653:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583732480:0@lo:501: 00000100:00100000:2.0:1788813312.242674:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583732608:0@lo:503: 00000100:00100000:2.0:1788813312.242708:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813312.242725:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876ea79600 going to sleep for 11 seconds 00000100:00100000:2.0:1788813312.242735:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583732608 00000100:00100000:2.0:1788813312.242738:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583732608 00000100:00100000:2.0:1788813312.242753:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788813312.242758:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:5846:x1875706583732608:12345-0@lo:503: 00000100:00100000:2.0:1788813312.242879:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:5846:x1875706583732608:12345-0@lo:503: Request processed in 119us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813312.242886:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788813312.242918:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583732608:0@lo:503: 00000100:00100000:3.0:1788813312.244421:0:8115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8115:1875706583732736:0@lo:502: 00000100:00100000:3.0:1788813312.244492:0:8115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813312.244535:0:8115:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876e6236c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813312.244621:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583732736 00000100:00100000:0.0:1788813312.244628:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583732736 00000100:00100000:0.0:1788813312.244665:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788813312.244675:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:8115:x1875706583732736:12345-0@lo:502: 00000100:00100000:0.0:1788813312.244897:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:8115:x1875706583732736:12345-0@lo:502: Request processed in 224us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813312.244905:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788813312.245341:0:8115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8115:1875706583732736:0@lo:502: 00000100:00100000:3.0:1788813312.245399:0:8115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8115:1875706583732864:0@lo:502: 00000100:00100000:3.0:1788813312.245444:0:8115:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813312.245480:0:8115:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876f9be540 going to sleep for 11 seconds 00000100:00100000:0.0:1788813312.246231:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583732864 00000100:00100000:0.0:1788813312.246240:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583732864 00000100:00100000:0.0:1788813312.246294:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788813312.246303:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:8115:x1875706583732864:12345-0@lo:502: 00000100:00100000:0.0:1788813312.246540:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:8115:x1875706583732864:12345-0@lo:502: Request processed in 237us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813312.246547:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788813312.246686:0:8115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8115:1875706583732864:0@lo:502: 00000040:00080000:3.0:1788813312.246716:0:8115:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788813312.246880:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788813312.246901:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788813312.246909:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff9087413a0800/0x6d74dbab2ddb16f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb16ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813312.246920:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff9087413a0800/0x6d74dbab2ddb16f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb16ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813312.246929:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788813312.246932:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff908781c96000 from 5 10000000:01000000:0.0:1788813312.246934:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788813312.246963:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031600/0x6d74dbab2ddb1706 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813312.246971:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908740031600/0x6d74dbab2ddb1706 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813312.246980:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908740031600/0x6d74dbab2ddb1706 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813312.247007:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583732992:0@lo:101: 00000100:00100000:0.0:1788813312.247041:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813312.248241:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876e5a2900 going to sleep for 11 seconds 00000100:00100000:3.0:1788813312.248342:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583732992 00000100:00100000:3.0:1788813312.248350:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583732992 00000100:00100000:3.0:1788813312.248400:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788813312.248409:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:5846:x1875706583732992:12345-0@lo:101: 00010000:00010000:3.0:1788813312.248422:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813312.248439:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908750ad0a00/0x6d74dbab2ddb170d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb1706 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813312.248464:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908750ad0a00/0x6d74dbab2ddb170d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1706 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813312.248474:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908750ad0a00/0x6d74dbab2ddb170d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1706 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813312.248483:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad0a00, rc 0) 00000100:00100000:3.0:1788813312.248544:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:5846:x1875706583732992:12345-0@lo:101: Request processed in 135us (1502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813312.248550:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788813312.252393:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583732992:0@lo:101: 00010000:00010000:2.0:1788813312.252422:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908740031600/0x6d74dbab2ddb1706 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb170d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813312.252434:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908740031600/0x6d74dbab2ddb1706 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb170d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813312.252508:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583733120:0@lo:256: 00000100:00100000:2.0:1788813312.252569:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813312.252642:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876ea79cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813312.252735:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583733120 00000100:00100000:3.0:1788813312.252743:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583733120 00000100:00100000:3.0:1788813312.252795:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788813312.252805:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:5846:x1875706583733120:12345-0@lo:256: 20000000:01000000:3.0:1788813312.252823:0:5844:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788813312.252838:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788813312.252844:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788813312.252937:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:5846:x1875706583733120:12345-0@lo:256: Request processed in 132us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813312.252944:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788813312.253316:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583733120:0@lo:256: 10000000:01000000:2.0:1788813312.253366:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788813312.253375:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031600/0x6d74dbab2ddb1706 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb170d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813312.253385:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908740031600/0x6d74dbab2ddb1706 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb170d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813312.253395:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788813312.253397:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788813312.253400:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788813312.253440:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908774368600/0x6d74dbab2ddb1714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813312.253447:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908774368600/0x6d74dbab2ddb1714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813312.253457:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908774368600/0x6d74dbab2ddb1714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813312.253472:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583733248:0@lo:101: 00000100:00100000:2.0:1788813312.253502:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813312.253527:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876ea79cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813312.253609:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583733248 00000100:00100000:0.0:1788813312.253615:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583733248 00000100:00100000:0.0:1788813312.253647:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788813312.253654:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:5846:x1875706583733248:12345-0@lo:101: 00010000:00010000:0.0:1788813312.253664:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813312.253677:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908740030e00/0x6d74dbab2ddb171b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb1714 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813312.253698:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908740030e00/0x6d74dbab2ddb171b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1714 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813312.253708:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908740030e00/0x6d74dbab2ddb171b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1714 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813312.253717:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740030e00, rc 0) 00000100:00100000:0.0:1788813312.253748:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583733248:12345-0@lo:101: Request processed in 95us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813312.253754:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788813312.253882:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583733248:0@lo:101: 00010000:00010000:2.0:1788813312.253893:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908774368600/0x6d74dbab2ddb1714 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb171b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813312.253901:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908774368600/0x6d74dbab2ddb1714 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb171b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813312.253948:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583733376:0@lo:501: 00000100:00100000:2.0:1788813312.253971:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813312.253988:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876ea79cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813312.254041:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583733376 00000100:00100000:0.0:1788813312.254045:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583733376 00000100:00100000:0.0:1788813312.254085:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788813312.254092:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583733376:12345-0@lo:501: 00000100:00100000:0.0:1788813312.254330:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583733376:12345-0@lo:501: Request processed in 237us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813312.254336:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788813312.254482:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583733376:0@lo:501: 00000100:00100000:2.0:1788813312.254508:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583733504:0@lo:503: 00000100:00100000:2.0:1788813312.254544:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813312.254564:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876ea79cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813312.254644:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583733504 00000100:00100000:3.0:1788813312.254648:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583733504 00000100:00100000:3.0:1788813312.254669:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788813312.254676:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90875243bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583733504:12345-0@lo:503: 00000100:00100000:3.0:1788813312.254965:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90875243bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583733504:12345-0@lo:503: Request processed in 289us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813312.254971:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788813312.255063:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583733504:0@lo:503: 00000100:00100000:2.0:1788813312.255552:0:8116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8116:1875706583733632:0@lo:502: 00000100:00100000:2.0:1788813312.255631:0:8116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813312.255655:0:8116:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876ea79f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788813312.255703:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583733632 00000100:00100000:3.0:1788813312.255708:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583733632 00000100:00100000:3.0:1788813312.255741:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788813312.255748:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:8116:x1875706583733632:12345-0@lo:502: 00000100:00100000:3.0:1788813312.255971:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:8116:x1875706583733632:12345-0@lo:502: Request processed in 222us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813312.255978:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788813312.256114:0:8116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8116:1875706583733632:0@lo:502: 00000020:01000000:1.0:1788813312.256140:0:8116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788813312.256153:0:8116:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788813312.256159:0:8116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813312.256162:0:8116:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788813312.256167:0:8116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788813312.256171:0:8116:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.147@tcp to nid 0x20000c0a8cc93 (192.168.204.147@tcp) 00000020:01000000:1.0:1788813312.256198:0:8116:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788813312.256201:0:8116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788813312.256224:0:8116:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90877fba3380) 00000020:00000080:1.0:1788813312.256247:0:8116:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788813312.256253:0:8116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788813312.256319:0:8116:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788813312.256325:0:8116:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788813312.256331:0:8116:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d74dbab2ddb1729 00010000:00080000:1.0:1788813312.256359:0:8116:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9087466de000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.147@tcp at head 00010000:00010000:1.0:1788813312.256574:0:8116:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788813312.256871:0:8116:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788813312.256883:0:8116:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788813312.257407:0:8116:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788813312.257640:0:8116:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788813312.257690:0:8116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788813312.257745:0:8116:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788813312.260772:0:8117:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788813312.260779:0:8117:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788813312.262680:0:8116:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788813312.262696:0:8116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788813312.262734:0:8116:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788813312.262759:0:8116:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d74dbab2ddb1730 00000100:00080000:3.0:1788813312.262772:0:8116:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788813312.262782:0:8116:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9087466de000 using connection 192.168.204.147@tcp/0@lo 00000100:00100000:3.0:1788813312.262820:0:8116:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff908749ac2d80 x1875706583733760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788813312.262840:0:8116:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788813312.262889:0:8116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813312.262906:0:8116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813312.262908:0:8116:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788813312.262912:0:8116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813312.262915:0:8116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813312.262917:0:8116:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788813312.262919:0:8116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788813312.262921:0:8116:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788813312.262948:0:8116:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8116:1875706583733888:0@lo:502: 00000100:00100000:2.0:1788813312.263144:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875706583734400:0@lo:400: 00000100:00100000:2.0:1788813312.263209:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813312.263246:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813312.263252:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583734016:0@lo:400: 00000100:00100000:2.0:1788813312.263275:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813312.263300:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583734144:0@lo:400: 00000100:00100000:2.0:1788813312.264145:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813312.264176:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813312.264184:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583734272:0@lo:400: 00000100:00100000:2.0:1788813312.264217:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813312.264260:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583734400 00000100:00100000:2.0:1788813312.264266:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583734400 00000100:00100000:2.0:1788813312.264311:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583734016 00000100:00100000:2.0:1788813312.264323:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583734016 00000100:00100000:2.0:1788813312.264342:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583734144 00000100:00100000:2.0:1788813312.264344:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583734144 00000100:00100000:2.0:1788813312.264361:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788813312.264368:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875706583734400:12345-0@lo:400: 00000100:00100000:2.0:1788813312.264422:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875706583734400:12345-0@lo:400: Request processed in 54us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813312.264430:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788813312.264446:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788813312.264452:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583734016:12345-0@lo:400: 00000100:00100000:2.0:1788813312.264478:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583734016:12345-0@lo:400: Request processed in 27us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813312.264484:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788813312.264493:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788813312.264500:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583734144:12345-0@lo:400: 00000100:00100000:2.0:1788813312.264528:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583734144:12345-0@lo:400: Request processed in 28us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813312.264533:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788813312.264555:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788813312.264599:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3ef100 x1875706583734144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813312.264612:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583734144:0@lo:400: 00010000:00080000:2.0:1788813312.264640:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3ee680 x1875706583734016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813312.264649:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583734016:0@lo:400: 00010000:00080000:2.0:1788813312.264658:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3ed180 x1875706583734400/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813312.264673:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875706583734400:0@lo:400: 00000100:00100000:1.0:1788813312.264758:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583734272 00000100:00100000:1.0:1788813312.264764:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583734272 00000100:00100000:1.0:1788813312.264805:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813312.264812:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583734272:12345-0@lo:400: 00000100:00100000:1.0:1788813312.264847:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583734272:12345-0@lo:400: Request processed in 37us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813312.264853:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788813312.264886:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3ef800 x1875706583734272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813312.264895:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583734272:0@lo:400: 00000100:00100000:0.0:1788813312.265234:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1875706583733760:0@lo:8: 00000100:00100000:0.0:1788813312.265272:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813312.265391:0:8116:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813312.265416:0:8116:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c3dbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813312.265462:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583733760 00000100:00100000:3.0:1788813312.265467:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583733760 00000100:00100000:3.0:1788813312.265495:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788813312.265501:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3317:x1875706583733760:12345-0@lo:8: 00010000:00080000:3.0:1788813312.265526:0:6705:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:3.0:1788813312.265553:0:6705:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d74dbab2ddb1737 00002000:00100000:3.0:1788813312.265567:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff908641112800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788813312.265571:0:6705:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1788813312.265575:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788813312.265731:0:6705:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788813312.265891:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788813312.265914:0:6705:0:(import.c:65:import_set_state_nolock()) ffff908641114800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788813312.266144:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813312.266196:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583733888 00000100:00100000:0.0:1788813312.266202:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583733888 00000100:00100000:0.0:1788813312.266244:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788813312.266250:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:8116:x1875706583733888:12345-0@lo:502: 00000100:00100000:3.0:1788813312.267948:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1875706583733760:12345-0@lo:8: Request processed in 2435us (2664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813312.267961:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788813312.271826:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:8116:x1875706583733888:12345-0@lo:502: Request processed in 5567us (6425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813312.271840:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788813312.271972:0:8116:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8116:1875706583733888:0@lo:502: 00000020:01000000:2.0:1788813312.272018:0:8116:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813312.272025:0:8116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813312.272027:0:8116:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788813312.272032:0:8116:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1788813312.272196:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788813312.272214:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788813312.272225:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908774368600/0x6d74dbab2ddb1714 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb171b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813312.272236:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908774368600/0x6d74dbab2ddb1714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb171b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813312.272256:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788813312.272259:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff908749b5cd40 from 1 10000000:01000000:3.0:1788813312.272261:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788813312.272291:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908750ad1e00/0x6d74dbab2ddb173e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813312.272298:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908750ad1e00/0x6d74dbab2ddb173e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813312.272308:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908750ad1e00/0x6d74dbab2ddb173e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813312.272324:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583734528:0@lo:101: 00000100:00100000:3.0:1788813312.272359:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813312.272393:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087586ed240 going to sleep for 11 seconds 00000100:00100000:0.0:1788813312.272496:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583734528 00000100:00100000:0.0:1788813312.272502:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583734528 00000100:00100000:0.0:1788813312.272543:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788813312.272552:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583734528:12345-0@lo:101: 00010000:00010000:0.0:1788813312.272565:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813312.272607:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908740030200/0x6d74dbab2ddb1745 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb173e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813312.272632:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908740030200/0x6d74dbab2ddb1745 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb173e expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813312.272643:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908740030200/0x6d74dbab2ddb1745 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb173e expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813312.272652:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740030200, rc 0) 00000100:00100000:0.0:1788813312.272691:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:5846:x1875706583734528:12345-0@lo:101: Request processed in 141us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813312.272697:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788813312.272787:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583734528:0@lo:101: 00010000:00010000:3.0:1788813312.272799:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908750ad1e00/0x6d74dbab2ddb173e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1745 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813312.272808:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908750ad1e00/0x6d74dbab2ddb173e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb1745 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813312.272855:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583734656:0@lo:501: 00000100:00100000:3.0:1788813312.272878:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813312.272889:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087586ed240 going to sleep for 11 seconds 00000100:00100000:0.0:1788813312.273205:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583734656 00000100:00100000:0.0:1788813312.273210:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583734656 00000100:00100000:0.0:1788813312.273241:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788813312.273246:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:5846:x1875706583734656:12345-0@lo:501: 00000100:00100000:0.0:1788813312.273477:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:5846:x1875706583734656:12345-0@lo:501: Request processed in 229us (597us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788813312.273492:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788813312.273527:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583734656:0@lo:501: 10000000:01000000:0.0:1788813312.273556:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788813312.273562:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908750ad1e00/0x6d74dbab2ddb173e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1745 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813312.273571:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908750ad1e00/0x6d74dbab2ddb173e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1745 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788813312.279174:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff908749ac2d80 x1875706583733760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788813322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813312.279190:0:3317:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788813312.279201:0:3317:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788813312.279338:0:3317:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788813312.279346:0:3317:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788813312.279350:0:3317:0:(import.c:65:import_set_state_nolock()) ffff9087466de000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788813312.279408:0:3317:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788813312.279416:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1875706583733760:0@lo:8: 00000004:00080000:3.0:1788813312.281114:0:8117:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788813312.281285:0:8117:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 254523704070ns, next at 0ns, rc = 0 00000004:00080000:1.0:1788813312.396018:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788813312.465654:0:8118:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788813312.465688:0:8118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8118:1875706583734912:0@lo:7: 00000100:00100000:0.0:1788813312.465766:0:8118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813312.465823:0:8118:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c394000 going to sleep for 11 seconds 00000100:00100000:2.0:1788813312.465885:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813312.465901:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583734784:0@lo:13: 00000100:00100000:2.0:1788813312.465937:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813312.466145:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583734912 00000100:00100000:1.0:1788813312.466153:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583734912 00000100:00100000:1.0:1788813312.466216:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813312.466226:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8118:x1875706583734912:12345-0@lo:7: 00000100:00100000:0.0:1788813312.467109:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583734784 00000100:00100000:0.0:1788813312.467117:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583734784 00000100:00100000:0.0:1788813312.467160:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788813312.467170:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1875706583734784:12345-0@lo:13: 00002000:00000024:0.0:1788813312.467198:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788813312.467267:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1875706583734784:12345-0@lo:13: Request processed in 98us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813312.467274:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788813312.467412:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788813312.467455:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3f2a00 x1875706583734784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813312.467476:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583734784:0@lo:13: 00002000:00080000:0.0:1788813312.484253:0:6704:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788813312.484262:0:6704:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788813312.484452:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8118:x1875706583734912:12345-0@lo:7: Request processed in 18224us (18681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813312.484463:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788813312.488600:0:8118:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3f1500 x1875706583734912/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788813328 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813312.488620:0:8118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8118:1875706583734912:0@lo:7: 00000004:00080000:2.0:1788813312.488636:0:8118:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788813312.488688:0:8118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8118:1875706583735040:0@lo:5: 00000100:00100000:2.0:1788813312.488754:0:8118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813312.488922:0:8118:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c234d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813312.491270:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583735040 00000100:00100000:3.0:1788813312.491310:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583735040 00000100:00100000:3.0:1788813312.491448:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788813312.491459:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8118:x1875706583735040:12345-0@lo:5: 00002000:00080000:3.0:1788813312.491489:0:6705:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788813312.491493:0:6705:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788813312.491916:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8118:x1875706583735040:12345-0@lo:5: Request processed in 458us (3160us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788813312.491925:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788813312.492029:0:8118:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3ee680 x1875706583735040/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788813328 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813312.492065:0:8118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ee680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8118:1875706583735040:0@lo:5: 00000004:00080000:0.0:1788813312.492079:0:8118:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788813312.492121:0:8118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8118:1875706583735168:0@lo:700: 00000100:00100000:0.0:1788813312.492157:0:8118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813312.492194:0:8118:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c394180 going to sleep for 11 seconds 00000100:00100000:1.0:1788813312.492276:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583735168 00000100:00100000:1.0:1788813312.492281:0:6713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583735168 00000100:00100000:1.0:1788813312.492332:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813312.492340:0:6713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8118:x1875706583735168:12345-0@lo:700: 00000100:00100000:1.0:1788813312.492368:0:6713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e4a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6713:1875706583735296:0@lo:700: 00000100:00100000:1.0:1788813312.492397:0:6713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813312.492416:0:6713:0:(client.c:2716:ptlrpc_set_wait()) set ffff908641365000 going to sleep for 11 seconds 00000100:00100000:1.0:1788813312.492434:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583735296 00000100:00100000:1.0:1788813312.492442:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583735296 00000100:00100000:1.0:1788813312.492471:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813312.492477:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6713:x1875706583735296:12345-0@lo:700: 40000000:02000000:0.0:1788813312.559241:0:5856:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788813312.567481:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6713:x1875706583735296:12345-0@lo:700: Request processed in 74994us (75073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813312.567497:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788813312.567829:0:6713:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e4a2d80 x1875706583735296/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788813328 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813312.567844:0:6713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e4a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6713:1875706583735296:0@lo:700: 40000000:02000000:2.0:1788813312.567875:0:6713:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1788813312.664713:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1788813312.664732:0:7669:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788813312.664872:0:6713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8118:x1875706583735168:12345-0@lo:700: Request processed in 172528us (172709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813312.664884:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788813312.664974:0:8118:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3f3480 x1875706583735168/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788813328 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813312.664985:0:8118:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788813312.665015:0:8118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8118:1875706583735168:0@lo:700: 00010000:00010000:3.0:1788813312.700797:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:0.0:1788813312.706105:0:8118:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1788813312.720959:0:8118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8118:1875706583735424:0@lo:5: 00000100:00100000:2.0:1788813312.721292:0:8118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813312.721357:0:8118:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c394e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788813312.722185:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583735424 00000100:00100000:0.0:1788813312.722197:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583735424 00000100:00100000:0.0:1788813312.722262:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788813312.722274:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8118:x1875706583735424:12345-0@lo:5: 00002000:00080000:2.0:1788813312.738428:0:6704:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788813312.738450:0:6704:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1788813312.744425:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8118:x1875706583735424:12345-0@lo:5: Request processed in 22144us (23249us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788813312.744438:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788813312.744517:0:8118:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3f3480 x1875706583735424/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788813328 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813312.744539:0:8118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8118:1875706583735424:0@lo:5: 00000004:00080000:0.0:1788813312.744555:0:8118:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1788813313.724789:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813314.751362:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788813315.509431:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1788813315.779603:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813315.783130:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788813315.783167:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583735552:0@lo:13: 00000100:00100000:0.0:1788813315.783435:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813315.783683:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583735552 00000100:00100000:0.0:1788813315.783695:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583735552 00000100:00100000:0.0:1788813315.783767:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788813315.783780:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583735552:12345-0@lo:13: 00002000:00000024:0.0:1788813315.783831:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813315.783887:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583735552:12345-0@lo:13: Request processed in 110us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813315.783894:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788813315.783919:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788813315.784215:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3f2680 x1875706583735552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813315.784238:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583735552:0@lo:13: 00010000:00010000:3.0:1788813316.796868:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813317.187919:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813317.188030:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562740608 00000100:00100000:0.0:1788813317.188044:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562740608 00000100:00100000:0.0:1788813317.188113:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 112 00000100:00100000:0.0:1788813317.188123:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2358:x1875706562740608:12345-192.168.204.47@tcp:250: 00010000:00080000:0.0:1788813317.188164:0:5843:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from c26434d2-1302-4a28-bfe7-c3365fc6f8a0@192.168.204.47@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:0.0:1788813317.188204:0:5843:0:(genops.c:1384:class_connect()) connect: client c26434d2-1302-4a28-bfe7-c3365fc6f8a0, cookie 0x6d74dbab2ddb174c 00000100:00080000:0.0:1788813317.188388:0:5843:0:(import.c:65:import_set_state_nolock()) ffff908749dad800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788813317.188969:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+5:2358:x1875706562740608:12345-192.168.204.47@tcp:250: Request processed in 841us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813317.188979:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 112 00000100:00100000:2.0:1788813317.201550:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813317.201835:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562740480 00000100:00100000:3.0:1788813317.201849:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562740480 00000100:00100000:3.0:1788813317.201940:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 113 00000100:00100000:3.0:1788813317.201954:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+5:5587:x1875706562740480:12345-192.168.204.47@tcp:101: 00010000:00010000:3.0:1788813317.201978:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813317.202003:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908750ad1400/0x6d74dbab2ddb1753 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x31ee63787e483c8e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813317.202044:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908750ad1400/0x6d74dbab2ddb1753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483c8e expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813317.202057:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908750ad1400/0x6d74dbab2ddb1753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483c8e expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813317.202068:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad1400, rc 0) 00000100:00100000:3.0:1788813317.202319:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+6:5587:x1875706562740480:12345-192.168.204.47@tcp:101: Request processed in 367us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813317.202328:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 113 00000100:00100000:2.0:1788813317.209849:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813317.210042:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562740736 00000100:00100000:0.0:1788813317.210057:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562740736 00000100:00100000:0.0:1788813317.210136:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 114 00000100:00100000:0.0:1788813317.210148:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+6:5587:x1875706562740736:12345-192.168.204.47@tcp:501: 00000100:00100000:0.0:1788813317.210682:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+6:5587:x1875706562740736:12345-192.168.204.47@tcp:501: Request processed in 533us (847us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788813317.210694:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 114 00000100:00100000:1.0:1788813317.224787:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813317.224935:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562740864 00000100:00100000:3.0:1788813317.224950:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562740864 00000100:00100000:3.0:1788813317.225029:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 115 00000100:00100000:3.0:1788813317.225044:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+6:5587:x1875706562740864:12345-192.168.204.47@tcp:101: 00010000:00010000:3.0:1788813317.225073:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813317.225099:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908750ad1200/0x6d74dbab2ddb175a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x31ee63787e483c95 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813317.225138:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908750ad1200/0x6d74dbab2ddb175a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483c95 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813317.225154:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908750ad1200/0x6d74dbab2ddb175a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483c95 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813317.225164:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad1200, rc 0) 00000100:00100000:3.0:1788813317.225248:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+7:5587:x1875706562740864:12345-192.168.204.47@tcp:101: Request processed in 206us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813317.225256:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 115 00000100:00100000:2.0:1788813317.235694:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813317.235801:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562740992 00000100:00100000:3.0:1788813317.235815:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562740992 00000100:00100000:3.0:1788813317.235894:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 116 00000100:00100000:3.0:1788813317.235915:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+7:5587:x1875706562740992:12345-192.168.204.47@tcp:501: 00000100:00100000:3.0:1788813317.236353:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+8:5587:x1875706562740992:12345-192.168.204.47@tcp:501: Request processed in 438us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813317.236362:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 116 00000100:00100000:2.0:1788813317.242184:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813317.242304:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562741120 00000100:00100000:0.0:1788813317.242318:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562741120 00000100:00100000:0.0:1788813317.242391:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 117 00000100:00100000:0.0:1788813317.242413:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+8:5587:x1875706562741120:12345-192.168.204.47@tcp:503: 00000100:00100000:0.0:1788813317.242985:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+8:5587:x1875706562741120:12345-192.168.204.47@tcp:503: Request processed in 571us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813317.242994:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 117 00000100:00100000:1.0:1788813317.256208:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813317.256420:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562741248 00000100:00100000:2.0:1788813317.256442:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562741248 00000100:00100000:2.0:1788813317.256519:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 118 00000100:00100000:2.0:1788813317.256532:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+8:5606:x1875706562741248:12345-192.168.204.47@tcp:502: 00000100:00100000:2.0:1788813317.257062:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+8:5606:x1875706562741248:12345-192.168.204.47@tcp:502: Request processed in 529us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813317.257073:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 118 00000100:00100000:1.0:1788813317.309392:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583736064:0@lo:400: 00000100:00100000:0.0:1788813317.309453:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875706583735936:0@lo:400: 00000100:00100000:2.0:1788813317.309548:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd1fd158-af17-4a1b-8f0b-82e57114d008:3319:1875706583735680:0@lo:400: 00000100:00100000:3.0:1788813317.309841:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583735808:0@lo:400: 00000100:00100000:1.0:1788813317.317837:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813317.317837:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813317.318331:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583736064 00000100:00100000:0.0:1788813317.318343:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583736064 00000100:00100000:0.0:1788813317.318421:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788813317.318434:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583736064:12345-0@lo:400: 00000100:00100000:0.0:1788813317.318632:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583736064:12345-0@lo:400: Request processed in 200us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813317.318642:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788813317.318670:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813317.318882:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583735936 00000100:00100000:0.0:1788813317.318888:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583735936 00000100:00100000:0.0:1788813317.318941:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788813317.318949:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875706583735936:12345-0@lo:400: 00000100:00100000:0.0:1788813317.318993:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875706583735936:12345-0@lo:400: Request processed in 45us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813317.319021:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1788813317.319045:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788813317.319073:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3f0700 x1875706583735936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813317.319090:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875706583735936:0@lo:400: 00010000:00080000:1.0:1788813317.319435:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3f1500 x1875706583736064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813317.319449:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583736064:0@lo:400: 00000100:00100000:2.0:1788813317.319926:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813317.319928:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813317.320041:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fb03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583736320:0@lo:400: 00000100:00100000:3.0:1788813317.320105:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813317.320190:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583736320 00000100:00100000:3.0:1788813317.320198:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583736320 00000100:00100000:3.0:1788813317.320249:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788813317.320258:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583736320:12345-0@lo:400: 00000100:00100000:3.0:1788813317.320307:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583736320:12345-0@lo:400: Request processed in 51us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813317.320314:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788813317.320353:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877fb03480 x1875706583736320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813317.320363:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788813317.320377:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fb03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583736320:0@lo:400: 00000100:00080000:3.0:1788813317.320403:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813317.320529:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875706583736192:0@lo:400: 00000100:00100000:2.0:1788813317.320559:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813317.320625:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583735680 00000100:00100000:0.0:1788813317.320630:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583735680 00000100:00100000:0.0:1788813317.320660:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788813317.320667:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3319:x1875706583735680:12345-0@lo:400: 00000100:00100000:0.0:1788813317.320706:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3319:x1875706583735680:12345-0@lo:400: Request processed in 40us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813317.320712:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788813317.323649:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813317.323750:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562741376 00000100:00100000:3.0:1788813317.323764:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562741376 00000100:00100000:3.0:1788813317.323837:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 120 00000100:00100000:3.0:1788813317.323849:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+8:5606:x1875706562741376:12345-192.168.204.47@tcp:502: 00000100:00100000:3.0:1788813317.324344:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+8:5606:x1875706562741376:12345-192.168.204.47@tcp:502: Request processed in 493us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813317.324353:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 120 00000100:00100000:1.0:1788813317.325234:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583735808 00000100:00100000:1.0:1788813317.325247:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583735808 00000100:00100000:1.0:1788813317.325308:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583736192 00000100:00100000:2.0:1788813317.325312:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd1fd158-af17-4a1b-8f0b-82e57114d008:3319:1875706583735680:0@lo:400: 00000100:00100000:1.0:1788813317.325314:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583736192 00000100:00100000:1.0:1788813317.325362:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788813317.325373:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813317.325374:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583735808:12345-0@lo:400: 00000100:00100000:1.0:1788813317.325532:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583735808:12345-0@lo:400: Request processed in 161us (5608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813317.325541:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788813317.325557:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788813317.325570:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875706583736192:12345-0@lo:400: 00000100:00100000:1.0:1788813317.325625:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875706583736192:12345-0@lo:400: Request processed in 56us (5064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813317.325631:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788813317.327008:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3f1f80 x1875706583735808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813317.327030:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583735808:0@lo:400: 00010000:00080000:2.0:1788813317.327087:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3f2a00 x1875706583736192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813317.327097:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875706583736192:0@lo:400: 00000100:00100000:3.0:1788813317.331433:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813317.331669:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562741504 00000100:00100000:2.0:1788813317.331683:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562741504 00000100:00100000:2.0:1788813317.331759:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 121 00000100:00100000:2.0:1788813317.331772:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+8:5587:x1875706562741504:12345-192.168.204.47@tcp:101: 00010000:00010000:2.0:1788813317.331796:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813317.331819:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908774369c00/0x6d74dbab2ddb1761 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x31ee63787e483cbf expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813317.331861:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908774369c00/0x6d74dbab2ddb1761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483cbf expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813317.331876:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908774369c00/0x6d74dbab2ddb1761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483cbf expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813317.331887:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369c00, rc 0) 00000100:00100000:2.0:1788813317.331989:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+9:5587:x1875706562741504:12345-192.168.204.47@tcp:101: Request processed in 219us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813317.331996:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 121 00000100:00100000:0.0:1788813317.341230:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813317.341339:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562741632 00000100:00100000:3.0:1788813317.341355:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562741632 00000100:00100000:3.0:1788813317.341471:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 122 00000100:00100000:3.0:1788813317.341486:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+9:5587:x1875706562741632:12345-192.168.204.47@tcp:256: 20000000:01000000:3.0:1788813317.341526:0:5843:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788813317.341551:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788813317.341557:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788813317.341560:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788813317.341563:0:5843:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788813317.356647:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+9:5587:x1875706562741632:12345-192.168.204.47@tcp:256: Request processed in 15091us (15359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813317.356672:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 122 00000100:00100000:2.0:1788813317.366465:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813317.366634:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562741760 00000100:00100000:0.0:1788813317.366649:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562741760 00000100:00100000:0.0:1788813317.366725:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 123 00000100:00100000:0.0:1788813317.366738:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+9:5587:x1875706562741760:12345-192.168.204.47@tcp:101: 00010000:00010000:0.0:1788813317.366760:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813317.366785:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908740030c00/0x6d74dbab2ddb1768 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x31ee63787e483cc6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813317.366827:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908740030c00/0x6d74dbab2ddb1768 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483cc6 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813317.366864:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908740030c00/0x6d74dbab2ddb1768 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483cc6 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813317.366875:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740030c00, rc 0) 00000100:00100000:0.0:1788813317.366972:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:5587:x1875706562741760:12345-192.168.204.47@tcp:101: Request processed in 236us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813317.366979:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 123 00000100:00100000:1.0:1788813317.369236:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813317.369507:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562741888 00000100:00100000:0.0:1788813317.369519:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562741888 00000100:00100000:0.0:1788813317.369653:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 124 00000100:00100000:0.0:1788813317.369666:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908760094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:5587:x1875706562741888:12345-192.168.204.47@tcp:501: 00000100:00100000:0.0:1788813317.370068:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908760094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:5587:x1875706562741888:12345-192.168.204.47@tcp:501: Request processed in 403us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813317.370077:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 124 00000100:00100000:1.0:1788813317.377721:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813317.381559:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562742016 00000100:00100000:2.0:1788813317.381601:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562742016 00000100:00100000:2.0:1788813317.381787:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 125 00000100:00100000:2.0:1788813317.381800:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908760094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:5587:x1875706562742016:12345-192.168.204.47@tcp:503: 00000100:00100000:2.0:1788813317.382311:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908760094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:5587:x1875706562742016:12345-192.168.204.47@tcp:503: Request processed in 509us (4606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813317.382321:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 125 00000100:00100000:2.0:1788813317.390708:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813317.390813:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562742144 00000100:00100000:0.0:1788813317.390827:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562742144 00000100:00100000:0.0:1788813317.390915:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 126 00000100:00100000:0.0:1788813317.390928:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908760095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:5610:x1875706562742144:12345-192.168.204.47@tcp:502: 00000100:00100000:0.0:1788813317.392036:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908760095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:5610:x1875706562742144:12345-192.168.204.47@tcp:502: Request processed in 1100us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813317.392049:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 126 00000100:00100000:1.0:1788813317.396510:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813317.400887:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562742272 00000100:00100000:2.0:1788813317.400928:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562742272 00000100:00100000:0.0:1788813317.403194:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 127 00000100:00100000:0.0:1788813317.403214:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908760097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:5610:x1875706562742272:12345-192.168.204.47@tcp:502: 00000100:00100000:0.0:1788813317.404014:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908760097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:5610:x1875706562742272:12345-192.168.204.47@tcp:502: Request processed in 798us (7517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813317.404041:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 127 00000100:00100000:1.0:1788813317.415327:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813317.415712:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562742400 00000100:00100000:2.0:1788813317.415725:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562742400 00000100:00100000:0.0:1788813317.415928:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 4 00000100:00100000:0.0:1788813317.415941:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2358:x1875706562742400:12345-192.168.204.47@tcp:38: 00010000:00080000:0.0:1788813317.416036:0:5849:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from e90f6370-8c16-4659-9369-1cd146993b4c@192.168.204.47@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:0.0:1788813317.417571:0:5849:0:(genops.c:1384:class_connect()) connect: client e90f6370-8c16-4659-9369-1cd146993b4c, cookie 0x6d74dbab2ddb176f 00000004:00100000:0.0:1788813317.417641:0:5849:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788813317.417650:0:5849:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788813317.457205:0:5849:0:(import.c:65:import_set_state_nolock()) ffff9087466dd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813317.457403:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+6:2358:x1875706562742400:12345-192.168.204.47@tcp:38: Request processed in 41451us (42081us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813317.457418:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 4 00010000:00010000:2.0:1788813317.820915:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813317.821241:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813317.821276:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fb01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583736448:0@lo:13: 00000100:00100000:3.0:1788813317.821383:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813317.821725:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583736448 00000100:00100000:0.0:1788813317.821739:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583736448 00000100:00100000:0.0:1788813317.821823:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788813317.821837:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583736448:12345-0@lo:13: 00002000:00000024:0.0:1788813317.821900:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813317.822324:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583736448:12345-0@lo:13: Request processed in 487us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813317.822334:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788813317.826420:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877fb01180 x1875706583736448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813317.826462:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fb01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583736448:0@lo:13: 00000100:00100000:0.0:1788813318.463646:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813318.463691:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813318.463838:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562742656 00000100:00100000:3.0:1788813318.463870:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562742656 00000100:00100000:3.0:1788813318.464125:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562742528 00000100:00100000:3.0:1788813318.464129:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562742528 00000100:00100000:3.0:1788813318.464153:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 5 00000100:00100000:3.0:1788813318.464166:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+7:5587:x1875706562742656:12345-192.168.204.47@tcp:41: 00000004:00000024:3.0:1788813318.464227:0:5851:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788813318.464323:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+7:5587:x1875706562742656:12345-192.168.204.47@tcp:41: Request processed in 159us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813318.464332:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 5 00000100:00100000:3.0:1788813318.464359:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 6 00000100:00100000:3.0:1788813318.464367:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:0:x1875706562742528:12345-192.168.204.47@tcp:41: 00000004:00000024:3.0:1788813318.464379:0:5851:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788813318.464423:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:0:x1875706562742528:12345-192.168.204.47@tcp:41: Request processed in 57us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813318.464430:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 6 00000100:00080000:0.0:1788813318.464797:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813318.474951:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813318.476979:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562742784 00000100:00100000:3.0:1788813318.477002:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562742784 00000100:00100000:3.0:1788813318.477238:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 7 00000100:00100000:3.0:1788813318.477252:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:5587:x1875706562742784:12345-192.168.204.47@tcp:40: 00000100:00100000:3.0:1788813318.477392:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:5587:x1875706562742784:12345-192.168.204.47@tcp:40: Request processed in 141us (2458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813318.477401:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 7 00000100:00100000:1.0:1788813318.487603:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813318.488120:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562742912 00000100:00100000:0.0:1788813318.488135:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562742912 00000100:00100000:0.0:1788813318.488261:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 8 00000100:00100000:0.0:1788813318.488272:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1875706562742912:12345-192.168.204.47@tcp:8: 00010000:00080000:0.0:1788813318.488317:0:6706:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e90f6370-8c16-4659-9369-1cd146993b4c@192.168.204.47@tcp t0 exp 0000000000000000 cur 260 last 0 00000020:00000080:0.0:1788813318.488366:0:6706:0:(genops.c:1384:class_connect()) connect: client e90f6370-8c16-4659-9369-1cd146993b4c, cookie 0x6d74dbab2ddb1776 00002000:00100000:0.0:1788813318.488410:0:6706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e90f6370-8c16-4659-9369-1cd146993b4c/ffff908749daa800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788813318.488442:0:6706:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788813318.488973:0:6706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788813318.491227:0:6706:0:(import.c:65:import_set_state_nolock()) ffff908749dae800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788813318.491397:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:2358:x1875706562742912:12345-192.168.204.47@tcp:8: Request processed in 3117us (3828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813318.491412:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 8 00000100:00100000:0.0:1788813318.500700:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813318.502019:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562743168 00000100:00100000:2.0:1788813318.502105:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562743168 00000100:00100000:2.0:1788813318.502209:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 128 00000100:00100000:2.0:1788813318.502224:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:2360:x1875706562743168:12345-192.168.204.47@tcp:400: 00000100:00100000:2.0:1788813318.502345:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:2360:x1875706562743168:12345-192.168.204.47@tcp:400: Request processed in 123us (1662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813318.502354:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 128 00000100:00100000:1.0:1788813318.515691:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813318.516770:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813318.516942:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562743040 00000100:00100000:3.0:1788813318.516957:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562743040 00000100:00100000:3.0:1788813318.517032:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 9 00000100:00100000:3.0:1788813318.517043:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1875706562743040:12345-192.168.204.47@tcp:8: 00010000:00080000:3.0:1788813318.517087:0:6705:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e90f6370-8c16-4659-9369-1cd146993b4c@192.168.204.47@tcp t0 exp 0000000000000000 cur 260 last 0 00000020:00000080:3.0:1788813318.517133:0:6705:0:(genops.c:1384:class_connect()) connect: client e90f6370-8c16-4659-9369-1cd146993b4c, cookie 0x6d74dbab2ddb177d 00002000:00100000:3.0:1788813318.517147:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e90f6370-8c16-4659-9369-1cd146993b4c/ffff908641110000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788813318.517162:0:6705:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788813318.517825:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788813318.517870:0:6705:0:(import.c:65:import_set_state_nolock()) ffff908641116800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788813318.517982:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+6:2358:x1875706562743040:12345-192.168.204.47@tcp:8: Request processed in 937us (2305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813318.517992:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 9 00000100:00100000:0.0:1788813318.521669:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562743296 00000100:00100000:0.0:1788813318.521693:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562743296 00000100:00100000:0.0:1788813318.521794:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 0 00000100:00100000:0.0:1788813318.521807:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+6:5587:x1875706562743296:12345-192.168.204.47@tcp:33: 00000004:00080000:0.0:1788813318.548507:0:5852:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 26575us 00000004:00200000:2.0:1788813318.589803:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788813318.590001:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+6:5587:x1875706562743296:12345-192.168.204.47@tcp:33: Request processed in 68188us (73231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813318.590032:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 0 00000100:00100000:1.0:1788813318.823386:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813318.823613:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562743424 00000100:00100000:2.0:1788813318.823627:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562743424 00000100:00100000:2.0:1788813318.823699:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 8 00000100:00100000:2.0:1788813318.823709:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+6:5627:x1875706562743424:12345-192.168.204.47@tcp:101: 00010000:00010000:2.0:1788813318.823918:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813318.823958:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368a00/0x6d74dbab2ddb1784 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483cf0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813318.824023:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb178b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813318.824038:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb178b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813318.824055:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb178b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813318.824094:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788813318.824098:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788813318.824114:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb178b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813318.824141:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368a00/0x6d74dbab2ddb1784 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483cf0 expref: 8 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813318.824160:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb178b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483cf0 expref: 7 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813318.824168:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908743ce0300) 00010000:00010000:2.0:1788813318.824171:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813318.824175:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369a00, rc 0) 00000100:00100000:2.0:1788813318.824246:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+7:5627:x1875706562743424:12345-192.168.204.47@tcp:101: Request processed in 537us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813318.824252:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 8 00010000:00010000:3.0:1788813318.846700:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813319.868899:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813320.892894:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813320.892935:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fb02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583736576:0@lo:13: 00000100:00100000:2.0:1788813320.893003:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813320.893133:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583736576 00000100:00100000:0.0:1788813320.893141:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583736576 00000100:00100000:0.0:1788813320.893210:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788813320.893220:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583736576:12345-0@lo:13: 00002000:00000024:0.0:1788813320.893256:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813320.893303:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583736576:12345-0@lo:13: Request processed in 84us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813320.893309:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788813320.893410:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788813320.893442:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877fb02300 x1875706583736576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813320.893460:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fb02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583736576:0@lo:13: 00010000:00010000:2.0:1788813320.894056:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813321.198942:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813321.203292:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562743552 00000100:00100000:1.0:1788813321.203311:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562743552 00000100:00100000:1.0:1788813321.203431:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 9 00000100:00100000:1.0:1788813321.203444:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+7:5679:x1875706562743552:12345-192.168.204.47@tcp:41: 00000004:00000024:1.0:1788813321.203504:0:5849:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788813321.203637:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+7:5679:x1875706562743552:12345-192.168.204.47@tcp:41: Request processed in 196us (4712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813321.203644:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 9 00000100:00080000:2.0:1788813321.208013:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813321.216718:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813321.219920:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562743680 00000100:00100000:0.0:1788813321.219938:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562743680 00000100:00100000:0.0:1788813321.220105:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 9 00000100:00100000:0.0:1788813321.220117:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f6370-8c16-4659-9369-1cd146993b4c+6:5679:x1875706562743680:12345-192.168.204.47@tcp:13: 00002000:00000024:0.0:1788813321.220147:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813321.220246:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f6370-8c16-4659-9369-1cd146993b4c+6:5679:x1875706562743680:12345-192.168.204.47@tcp:13: Request processed in 131us (3539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813321.220253:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 9 00000100:00080000:2.0:1788813321.224723:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813321.226607:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813321.226770:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562743808 00000100:00100000:2.0:1788813321.226781:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562743808 00000100:00100000:2.0:1788813321.226867:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 10 00000100:00100000:2.0:1788813321.226878:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f6370-8c16-4659-9369-1cd146993b4c+6:5679:x1875706562743808:12345-192.168.204.47@tcp:13: 00002000:00000024:2.0:1788813321.226920:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813321.226993:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e90f6370-8c16-4659-9369-1cd146993b4c+6:5679:x1875706562743808:12345-192.168.204.47@tcp:13: Request processed in 117us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813321.227001:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 10 00000100:00080000:0.0:1788813321.227103:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788813321.917369:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788813322.026021:0:7669:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e90f6370-8c16-4659-9369-1cd146993b4c 00000001:00100000:0.0:1788813322.026137:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e90f6370-8c16-4659-9369-1cd146993b4c 00000100:00100000:0.0:1788813322.429945:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fb01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd1fd158-af17-4a1b-8f0b-82e57114d008:3319:1875706583736704:0@lo:400: 00000100:00100000:0.0:1788813322.430027:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813322.430074:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fb01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875706583737216:0@lo:400: 00000100:00100000:0.0:1788813322.430106:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813322.430132:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788813322.430138:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fb00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583737088:0@lo:400: 00000100:00100000:0.0:1788813322.430160:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813322.430189:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fb03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583736832:0@lo:400: 00000100:00100000:0.0:1788813322.430211:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813322.430230:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fb00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583737344:0@lo:400: 00000100:00100000:0.0:1788813322.430252:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813322.430267:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788813322.430272:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fb00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583736960:0@lo:400: 00000100:00100000:0.0:1788813322.430291:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813322.433022:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583737216 00000100:00100000:3.0:1788813322.433038:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583737216 00000100:00100000:3.0:1788813322.433118:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583736832 00000100:00100000:3.0:1788813322.433122:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583736832 00000100:00100000:3.0:1788813322.433137:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583736960 00000100:00100000:3.0:1788813322.433140:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583736960 00000100:00100000:3.0:1788813322.433162:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788813322.433173:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875706583737216:12345-0@lo:400: 00000100:00100000:2.0:1788813322.433388:0:5850:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788813322.433398:0:5850:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788813322.433421:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583737088 00000100:00100000:2.0:1788813322.433426:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583737088 00000100:00100000:2.0:1788813322.433457:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583737344 00000100:00100000:2.0:1788813322.433460:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583737344 00000100:00100000:2.0:1788813322.433475:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788813322.433482:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583737088:12345-0@lo:400: 00000100:00100000:0.0:1788813322.433601:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583736704 00000100:00100000:0.0:1788813322.433606:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583736704 00000100:00080000:0.0:1788813322.436222:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788813322.436232:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788813322.436235:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813322.439296:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788813322.439598:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3319:x1875706583736704:12345-0@lo:400: 00000100:00100000:2.0:1788813322.440985:0:6705:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788813322.441001:0:6705:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788813322.441220:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583737088:12345-0@lo:400: Request processed in 7732us (11052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813322.441253:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788813322.441291:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788813322.441307:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583737344:12345-0@lo:400: 00000100:00100000:2.0:1788813322.441380:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583737344:12345-0@lo:400: Request processed in 80us (11126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813322.441387:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788813322.442547:0:5849:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788813322.442594:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788813322.442609:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583736832:12345-0@lo:400: 00000100:00100000:2.0:1788813322.442687:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583736832:12345-0@lo:400: Request processed in 84us (12474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813322.442693:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788813322.442719:0:5849:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788813322.442726:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788813322.442733:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583736960:12345-0@lo:400: 00000100:00100000:2.0:1788813322.442780:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583736960:12345-0@lo:400: Request processed in 48us (12488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813322.442786:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788813322.446725:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877fb00a80 x1875706583737088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813322.446768:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fb00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583737088:0@lo:400: 00000100:00100000:3.0:1788813322.451659:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875706583737216:12345-0@lo:400: Request processed in 18475us (21539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813322.451675:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788813322.452111:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fb01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875706583737216:0@lo:400: 00000100:00100000:3.0:1788813322.454888:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fb00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583736960:0@lo:400: 00000100:00100000:3.0:1788813322.454910:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fb03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583736832:0@lo:400: 00010000:00080000:3.0:1788813322.454926:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877fb00e00 x1875706583737344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813322.454936:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fb00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583737344:0@lo:400: 00000100:00100000:0.0:1788813322.459221:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3319:x1875706583736704:12345-0@lo:400: Request processed in 19882us (29176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813322.459242:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788813322.462130:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fb01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd1fd158-af17-4a1b-8f0b-82e57114d008:3319:1875706583736704:0@lo:400: 00000001:00100000:2.0:1788813322.511510:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e90f6370-8c16-4659-9369-1cd146993b4c 00010000:00010000:1.0:1788813322.941191:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813322.941717:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813322.941744:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fb01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583737472:0@lo:13: 00000100:00100000:3.0:1788813322.941834:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813322.942132:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583737472 00000100:00100000:0.0:1788813322.942141:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583737472 00000100:00100000:0.0:1788813322.942198:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788813322.942208:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583737472:12345-0@lo:13: 00002000:00000024:0.0:1788813322.942251:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:1.0:1788813322.943141:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877fb01180 x1875706583737472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813322.943166:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fb01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583737472:0@lo:13: 00000100:00100000:0.0:1788813322.943422:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583737472:12345-0@lo:13: Request processed in 1215us (1587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813322.943431:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788813323.655790:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813323.655836:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813323.655873:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813323.655911:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813323.655947:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562744192 00000100:00100000:1.0:1788813323.655959:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562744192 00000100:00100000:1.0:1788813323.656017:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562744320 00000100:00100000:1.0:1788813323.656020:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562744320 00000100:00100000:1.0:1788813323.656041:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 9 00000100:00100000:1.0:1788813323.656051:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+5:2361:x1875706562744192:12345-192.168.204.47@tcp:400: 00000100:00100000:1.0:1788813323.656124:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+5:2361:x1875706562744192:12345-192.168.204.47@tcp:400: Request processed in 74us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813323.656132:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 9 00000100:00100000:1.0:1788813323.656152:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 10 00000100:00100000:1.0:1788813323.656158:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+5:2361:x1875706562744320:12345-192.168.204.47@tcp:400: 00000100:00100000:1.0:1788813323.656183:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+5:2361:x1875706562744320:12345-192.168.204.47@tcp:400: Request processed in 25us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813323.656189:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 10 00000100:00080000:1.0:1788813323.656218:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788813323.656221:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813323.656681:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562744064 00000100:00100000:0.0:1788813323.656687:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562744064 00000100:00100000:0.0:1788813323.656742:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 25 00000100:00100000:0.0:1788813323.656751:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+6:2361:x1875706562744064:12345-192.168.204.47@tcp:400: 00000100:00100000:0.0:1788813323.656802:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+6:2361:x1875706562744064:12345-192.168.204.47@tcp:400: Request processed in 53us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813323.656808:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 25 00000100:00080000:1.0:1788813323.657138:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813323.658466:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562743936 00000100:00100000:2.0:1788813323.658479:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562743936 00000100:00100000:2.0:1788813323.658556:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 130 00000100:00100000:2.0:1788813323.658565:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:2361:x1875706562743936:12345-192.168.204.47@tcp:400: 00000100:00100000:3.0:1788813323.659310:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:2361:x1875706562743936:12345-192.168.204.47@tcp:400: Request processed in 741us (3542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813323.659319:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 130 00010000:00010000:2.0:1788813323.966265:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788813324.234532:0:8323:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788813324.988874:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813326.013447:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813326.013474:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583737600:0@lo:13: 00000100:00100000:2.0:1788813326.013546:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813326.013645:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583737600 00000100:00100000:2.0:1788813326.013657:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583737600 00000100:00100000:2.0:1788813326.013719:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788813326.013738:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583737600:12345-0@lo:13: 00002000:00000024:2.0:1788813326.013775:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813326.013817:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583737600:12345-0@lo:13: Request processed in 90us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813326.013824:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788813326.013842:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788813326.013871:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff908749ac3100 x1875706583737600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813326.013889:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583737600:0@lo:13: 00010000:00010000:0.0:1788813326.014116:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813327.038512:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813327.550324:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583737856:0@lo:400: 00000100:00100000:1.0:1788813327.550439:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813327.550509:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583738368:0@lo:400: 00000100:00100000:1.0:1788813327.550537:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813327.550572:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813327.550598:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583737984:0@lo:400: 00000100:00100000:1.0:1788813327.550620:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813327.550653:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583737856 00000100:00100000:1.0:1788813327.550662:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583737856 00000100:00100000:1.0:1788813327.550736:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583737984 00000100:00100000:1.0:1788813327.550739:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583737984 00000100:00100000:1.0:1788813327.550780:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788813327.550790:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583737856:12345-0@lo:400: 00000100:00100000:1.0:1788813327.550849:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583737856:12345-0@lo:400: Request processed in 61us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813327.550856:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788813327.550875:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788813327.550880:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c232300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583737984:12345-0@lo:400: 00000100:00100000:1.0:1788813327.550910:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c232300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583737984:12345-0@lo:400: Request processed in 30us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813327.550916:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788813327.550937:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583738368 00000100:00100000:1.0:1788813327.550941:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583738368 00000100:00100000:1.0:1788813327.550968:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788813327.550976:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583738368:12345-0@lo:400: 00000100:00100000:1.0:1788813327.551021:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c233100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583738368:12345-0@lo:400: Request processed in 46us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813327.551028:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788813327.551264:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e4a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd1fd158-af17-4a1b-8f0b-82e57114d008:3319:1875706583737728:0@lo:400: 00000100:00100000:3.0:1788813327.551311:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813327.551317:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583738112:0@lo:400: 00000100:00100000:3.0:1788813327.551341:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e4a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875706583738240:0@lo:400: 00000100:00100000:0.0:1788813327.551350:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813327.551362:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813327.551387:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583738240 00000100:00100000:3.0:1788813327.551391:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583738240 00000100:00100000:3.0:1788813327.551417:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788813327.551423:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875706583738240:12345-0@lo:400: 00000100:00100000:0.0:1788813327.551427:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583737984:0@lo:400: 00000100:00100000:0.0:1788813327.551454:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e4a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583737856:0@lo:400: 00000100:00100000:3.0:1788813327.551459:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875706583738240:12345-0@lo:400: Request processed in 37us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813327.551465:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788813327.551468:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c233800 x1875706583738368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813327.551485:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583737728 00000100:00100000:0.0:1788813327.551486:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583738368:0@lo:400: 00000100:00100000:3.0:1788813327.551489:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583737728 00000100:00100000:3.0:1788813327.551511:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788813327.551517:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3319:x1875706583737728:12345-0@lo:400: 00000100:00100000:0.0:1788813327.551530:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583738112 00000100:00100000:0.0:1788813327.551534:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583738112 00000100:00100000:3.0:1788813327.551546:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3319:x1875706583737728:12345-0@lo:400: Request processed in 29us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813327.551552:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788813327.551560:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788813327.551565:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583738112:12345-0@lo:400: 00000100:00100000:3.0:1788813327.551600:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e4a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd1fd158-af17-4a1b-8f0b-82e57114d008:3319:1875706583737728:0@lo:400: 00000100:00100000:3.0:1788813327.551610:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e4a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875706583738240:0@lo:400: 00000100:00100000:0.0:1788813327.551618:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583738112:12345-0@lo:400: Request processed in 53us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813327.551624:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788813327.551646:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e4a0380 x1875706583738112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813327.551656:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583738112:0@lo:400: 00000100:00080000:2.0:1788813327.552002:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813327.552009:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1788813327.897632:0:8472:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea4a111b0 20000000:00000080:3.0:1788813327.897667:0:8472:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90877d998400 uarg=0000000000000000 20000000:01000000:3.0:1788813327.897819:0:8472:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788813327.897823:0:8472:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788813327.897825:0:8472:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788813327.897831:0:8472:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788813327.897837:0:8472:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788813327.897865:0:8472:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788813327.897868:0:8472:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788813327.898147:0:8472:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788813327.898151:0:8472:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788813327.899834:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1788813327.900661:0:8472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1788813327.900733:0:8472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1788813327.900787:0:8472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1788813327.900804:0:8472:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788813327.900807:0:8472:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788813327.907428:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788813327.908674:0:8472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788813327.908766:0:8472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1788813327.908802:0:8472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1788813327.908825:0:8472:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788813327.908829:0:8472:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788813327.915001:0:8475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788813327.916196:0:8472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1788813327.916384:0:8472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1788813327.916423:0:8472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1788813327.916440:0:8472:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788813327.916443:0:8472:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788813327.926341:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788813327.927495:0:8472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788813327.927576:0:8472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788813327.927654:0:8472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:3.0:1788813327.927674:0:8472:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788813327.927713:0:8472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff908750ad1800/0x6d74dbab2ddb1792 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.927738:0:8472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff908750ad1c00/0x6d74dbab2ddb168f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1688 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.927747:0:8472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff908740031800/0x6d74dbab2ddb16b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb16b2 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.927755:0:8472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb16e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb16dc expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.927763:0:8472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb16f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb16ea expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.927770:0:8472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9087413a1c00/0x6d74dbab2ddb16ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb16f8 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.927792:0:8472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff908740030e00/0x6d74dbab2ddb171b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1714 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.927800:0:8472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff908740030200/0x6d74dbab2ddb1745 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb173e expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.927816:0:8472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff908750ad1400/0x6d74dbab2ddb1753 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483c8e expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.927825:0:8472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff908750ad1200/0x6d74dbab2ddb175a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483c95 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.927833:0:8472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff908750ad1800/0x6d74dbab2ddb1792 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.927888:0:8472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff908750ad1200/0x6d74dbab2ddb175a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483c95 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.927908:0:8472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff908750ad1200/0x6d74dbab2ddb175a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483c95 expref: 9 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813327.927926:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8472:1875706583738496:192.168.204.47@tcp:104: 00010000:00010000:3.0:1788813327.928078:0:8472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff908750ad1400/0x6d74dbab2ddb1753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483c8e expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.928087:0:8472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff908750ad1400/0x6d74dbab2ddb1753 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483c8e expref: 9 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813327.928096:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8472:1875706583738624:192.168.204.47@tcp:104: 00010000:00010000:3.0:1788813327.928145:0:8472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff908740030200/0x6d74dbab2ddb1745 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb173e expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.928156:0:8472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff908740030200/0x6d74dbab2ddb1745 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb173e expref: 18 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813327.928168:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8472:1875706583738752:0@lo:104: 00000100:00100000:3.0:1788813327.928222:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788813327.928288:0:8472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff908740030e00/0x6d74dbab2ddb171b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb1714 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.928297:0:8472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff908740030e00/0x6d74dbab2ddb171b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1714 expref: 18 pid: 5843 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813327.928306:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8472:1875706583738880:0@lo:104: 00000100:00100000:3.0:1788813327.928334:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788813327.928363:0:8472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9087413a1c00/0x6d74dbab2ddb16ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb16f8 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.928372:0:8472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9087413a1c00/0x6d74dbab2ddb16ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb16f8 expref: 18 pid: 5844 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813327.928380:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbc9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8472:1875706583739008:0@lo:104: 00010000:00010000:3.0:1788813327.928408:0:8472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb16f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb16ea expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.928417:0:8472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb16f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb16ea expref: 18 pid: 5843 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813327.928425:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbcbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8472:1875706583739136:0@lo:104: 00000100:00100000:0.0:1788813327.928440:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1788813327.928463:0:8472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb16e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb16dc expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813327.928473:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788813327.928478:0:8472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb16e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb16dc expref: 18 pid: 5844 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813327.928489:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbc8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8472:1875706583739264:0@lo:104: 00000100:00100000:0.0:1788813327.928496:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813327.928519:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813327.928526:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583738752 00000100:00100000:0.0:1788813327.928537:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583738752 00010000:00010000:3.0:1788813327.928541:0:8472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff908740031800/0x6d74dbab2ddb16b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb16b2 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.928552:0:8472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff908740031800/0x6d74dbab2ddb16b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb16b2 expref: 18 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813327.928560:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbc9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8472:1875706583739392:0@lo:104: 00000100:00100000:3.0:1788813327.928612:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813327.928622:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583738880 00000100:00100000:0.0:1788813327.928627:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583738880 00010000:00010000:3.0:1788813327.928643:0:8472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff908750ad1c00/0x6d74dbab2ddb168f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb1688 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813327.928646:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583739008 00000100:00100000:0.0:1788813327.928650:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583739008 00010000:00010000:3.0:1788813327.928658:0:8472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff908750ad1c00/0x6d74dbab2ddb168f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1688 expref: 18 pid: 5843 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813327.928664:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583739136 00000100:00100000:0.0:1788813327.928667:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583739136 00000100:00100000:3.0:1788813327.928670:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbcad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8472:1875706583739520:0@lo:104: 00000100:00100000:0.0:1788813327.928679:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583739264 00000100:00100000:0.0:1788813327.928683:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583739264 00000100:00100000:3.0:1788813327.928709:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813327.928710:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583739392 00000100:00100000:0.0:1788813327.928715:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583739392 00000100:00100000:3.0:1788813327.928725:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c394cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813327.928729:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583739520 00000100:00100000:0.0:1788813327.928740:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583739520 00000100:00100000:0.0:1788813327.928763:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788813327.928774:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+9:8472:x1875706583738752:12345-0@lo:104: 00010000:00010000:0.0:1788813327.928792:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff908750ad1e00/0x6d74dbab2ddb173e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb1745 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.928868:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788813327.928876:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+9:8472:x1875706583738752:12345-0@lo:104: Request processed in 103us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813327.928884:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788813327.928906:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788813327.928912:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e45e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+8:8472:x1875706583738880:12345-0@lo:104: 00010000:00010000:0.0:1788813327.928921:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff908774368600/0x6d74dbab2ddb1714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb171b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.928958:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788813327.928963:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e45e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+8:8472:x1875706583738880:12345-0@lo:104: Request processed in 53us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813327.928970:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788813327.929029:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788813327.929037:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+7:8472:x1875706583739008:12345-0@lo:104: 00010000:00010000:0.0:1788813327.929046:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff9087413a0800/0x6d74dbab2ddb16f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb16ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929084:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788813327.929089:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+7:8472:x1875706583739008:12345-0@lo:104: Request processed in 54us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813327.929095:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788813327.929115:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788813327.929121:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+6:8472:x1875706583739136:12345-0@lo:104: 00010000:00010000:0.0:1788813327.929130:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb16ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb16f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929158:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788813327.929163:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+6:8472:x1875706583739136:12345-0@lo:104: Request processed in 42us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813327.929169:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788813327.929179:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788813327.929184:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+5:8472:x1875706583739264:12345-0@lo:104: 00010000:00010000:0.0:1788813327.929192:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff908750ad0600/0x6d74dbab2ddb16dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb16e3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929216:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788813327.929221:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+5:8472:x1875706583739264:12345-0@lo:104: Request processed in 37us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813327.929226:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788813327.929250:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788813327.929256:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+4:8472:x1875706583739392:12345-0@lo:104: 00010000:00010000:0.0:1788813327.929264:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff908750ad1000/0x6d74dbab2ddb16b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb16b9 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929291:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788813327.929295:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+4:8472:x1875706583739392:12345-0@lo:104: Request processed in 41us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813327.929301:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788813327.929321:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788813327.929327:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+3:8472:x1875706583739520:12345-0@lo:104: 00010000:00010000:0.0:1788813327.929335:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff9087413a1600/0x6d74dbab2ddb1688 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb168f expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929362:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788813327.929366:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+3:8472:x1875706583739520:12345-0@lo:104: Request processed in 40us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813327.929372:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788813327.929395:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788813327.929403:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908750ad1e00/0x6d74dbab2ddb173e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb1745 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929411:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1e00 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:0.0:1788813327.929416:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908750ad1e00/0x6d74dbab2ddb173e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb1745 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929427:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908750ad1e00/0x6d74dbab2ddb173e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb1745 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813327.929436:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908750ad1e00/0x6d74dbab2ddb173e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb1745 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813327.929444:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788813327.929482:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff908750ad1e00/0x6d74dbab2ddb173e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1745 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929489:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813327.929512:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908750ad1e00/0x6d74dbab2ddb173e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1745 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929531:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908750ad1e00/0x6d74dbab2ddb173e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1745 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929547:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788813327.929550:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908774368600/0x6d74dbab2ddb1714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb171b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929556:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368600 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:0.0:1788813327.929559:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908774368600/0x6d74dbab2ddb1714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb171b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929566:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908774368600/0x6d74dbab2ddb1714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb171b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813327.929572:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908774368600/0x6d74dbab2ddb1714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb171b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813327.929601:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788813327.929616:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff908774368600/0x6d74dbab2ddb1714 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb171b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929622:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813327.929639:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908774368600/0x6d74dbab2ddb1714 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb171b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929646:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908774368600/0x6d74dbab2ddb1714 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb171b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929656:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788813327.929665:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff9087413a0800/0x6d74dbab2ddb16f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb16ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929671:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a0800 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:0.0:1788813327.929674:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff9087413a0800/0x6d74dbab2ddb16f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb16ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929680:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff9087413a0800/0x6d74dbab2ddb16f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb16ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813327.929685:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff9087413a0800/0x6d74dbab2ddb16f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb16ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813327.929701:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788813327.929717:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff9087413a0800/0x6d74dbab2ddb16f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb16ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929723:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813327.929728:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff9087413a0800/0x6d74dbab2ddb16f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb16ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929734:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff9087413a0800/0x6d74dbab2ddb16f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb16ff expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929746:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788813327.929749:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb16ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb16f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929755:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148d400 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:0.0:1788813327.929758:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb16ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb16f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929775:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb16ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb16f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813327.929781:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb16ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb16f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813327.929787:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788813327.929802:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb16ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb16f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929808:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813327.929813:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb16ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb16f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929820:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb16ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb16f1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929830:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788813327.929833:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908750ad0600/0x6d74dbab2ddb16dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb16e3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929839:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad0600 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:0.0:1788813327.929842:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908750ad0600/0x6d74dbab2ddb16dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb16e3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929849:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908750ad0600/0x6d74dbab2ddb16dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb16e3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813327.929855:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908750ad0600/0x6d74dbab2ddb16dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb16e3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813327.929867:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788813327.929881:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff908750ad0600/0x6d74dbab2ddb16dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb16e3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929887:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813327.929891:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908750ad0600/0x6d74dbab2ddb16dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb16e3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929897:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908750ad0600/0x6d74dbab2ddb16dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb16e3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929907:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788813327.929910:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908750ad1000/0x6d74dbab2ddb16b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb16b9 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929916:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1000 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:0.0:1788813327.929919:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908750ad1000/0x6d74dbab2ddb16b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb16b9 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929927:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908750ad1000/0x6d74dbab2ddb16b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb16b9 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813327.929933:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908750ad1000/0x6d74dbab2ddb16b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb16b9 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813327.929938:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788813327.929948:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff908750ad1000/0x6d74dbab2ddb16b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb16b9 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929953:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813327.929963:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908750ad1000/0x6d74dbab2ddb16b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb16b9 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929969:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908750ad1000/0x6d74dbab2ddb16b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb16b9 expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929976:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813327.929979:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff9087413a1600/0x6d74dbab2ddb1688 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb168f expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929985:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a1600 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:0.0:1788813327.929987:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff9087413a1600/0x6d74dbab2ddb1688 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb168f expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.929993:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff9087413a1600/0x6d74dbab2ddb1688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb168f expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813327.930000:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff9087413a1600/0x6d74dbab2ddb1688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb168f expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813327.930007:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788813327.930020:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff9087413a1600/0x6d74dbab2ddb1688 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb168f expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.930026:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813327.930030:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff9087413a1600/0x6d74dbab2ddb1688 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb168f expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.930037:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff9087413a1600/0x6d74dbab2ddb1688 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb168f expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.930054:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813327.930061:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813327.930064:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813327.930075:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813327.930079:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8472:1875706583738752:0@lo:104: 00010000:00010000:0.0:1788813327.930083:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813327.930095:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8472:1875706583738880:0@lo:104: 00000100:00100000:3.0:1788813327.930105:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbc9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8472:1875706583739008:0@lo:104: 00000100:00100000:0.0:1788813327.930115:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fb00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583739648:0@lo:103: 00000100:00100000:3.0:1788813327.930116:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbcbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8472:1875706583739136:0@lo:104: 00000100:00100000:3.0:1788813327.930137:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbc8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8472:1875706583739264:0@lo:104: 00000100:00100000:3.0:1788813327.930148:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbc9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8472:1875706583739392:0@lo:104: 00000100:00100000:3.0:1788813327.930158:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbcad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8472:1875706583739520:0@lo:104: 00000100:00100000:0.0:1788813327.930169:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813327.930214:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fb00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583740160:0@lo:103: 00000100:00100000:0.0:1788813327.930237:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813327.930263:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788813327.930269:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fb01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583740032:0@lo:103: 00000100:00100000:0.0:1788813327.930287:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813327.930312:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583739648 00000100:00100000:3.0:1788813327.930321:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583739648 00000100:00100000:0.0:1788813327.930324:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fb03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583739776:0@lo:103: 00000100:00100000:0.0:1788813327.930356:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788813327.930363:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff908740030200/0x6d74dbab2ddb1745 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb173e expref: 19 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813327.930367:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583740288:0@lo:103: 00000100:00100000:0.0:1788813327.930392:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813327.930394:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583740160 00000100:00100000:3.0:1788813327.930398:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583740160 00000100:00100000:0.0:1788813327.930406:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788813327.930414:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fb00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583739904:0@lo:103: 00010000:00010000:3.0:1788813327.930415:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb16e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb16dc expref: 20 pid: 5844 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813327.930432:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583740032 00000100:00100000:3.0:1788813327.930435:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583740032 00000100:00100000:0.0:1788813327.930440:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788813327.930450:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb16f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb16ea expref: 21 pid: 5843 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813327.930453:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583740416:0@lo:103: 00000100:00100000:3.0:1788813327.930467:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583739776 00000100:00100000:3.0:1788813327.930471:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583739776 00010000:00010000:3.0:1788813327.930486:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff908740030e00/0x6d74dbab2ddb171b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1714 expref: 22 pid: 5843 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813327.930487:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813327.930504:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583740288 00000100:00100000:3.0:1788813327.930508:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583740288 00010000:00010000:3.0:1788813327.930522:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff908740031800/0x6d74dbab2ddb16b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb16b2 expref: 23 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813327.930522:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583739904 00000100:00100000:0.0:1788813327.930529:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583739904 00010000:00010000:0.0:1788813327.930549:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9087413a1c00/0x6d74dbab2ddb16ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb16f8 expref: 24 pid: 5844 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813327.930567:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583740416 00000100:00100000:0.0:1788813327.930570:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583740416 00010000:00010000:0.0:1788813327.930604:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff908750ad1c00/0x6d74dbab2ddb168f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1688 expref: 25 pid: 5843 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813327.930629:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788813327.930637:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+25:3321:x1875706583739648:12345-0@lo:103: 00010000:00010000:0.0:1788813327.930651:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813327.930657:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff908740030200/0x6d74dbab2ddb1745 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb173e expref: 25 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.930668:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff908740030200/0x6d74dbab2ddb1745 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb173e expref: 25 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.930684:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908740030200/0x6d74dbab2ddb1745 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb173e expref: 25 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.930711:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813327.930747:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+24:3321:x1875706583739648:12345-0@lo:103: Request processed in 110us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813327.930754:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788813327.930772:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788813327.930779:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+23:3321:x1875706583740160:12345-0@lo:103: 00010000:00010000:0.0:1788813327.930787:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813327.930791:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb16e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb16dc expref: 23 pid: 5844 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.930800:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb16e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb16dc expref: 23 pid: 5844 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.930810:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb16e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb16dc expref: 23 pid: 5844 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.930830:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813327.930854:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+22:3321:x1875706583740160:12345-0@lo:103: Request processed in 76us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813327.930860:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788813327.930874:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788813327.930879:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+21:3321:x1875706583740032:12345-0@lo:103: 00010000:00010000:0.0:1788813327.930887:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813327.930891:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb16f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb16ea expref: 21 pid: 5843 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.930898:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb16f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb16ea expref: 21 pid: 5843 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.930907:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb16f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb16ea expref: 21 pid: 5843 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.930916:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813327.930937:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+20:3321:x1875706583740032:12345-0@lo:103: Request processed in 59us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813327.930943:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788813327.930955:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788813327.930960:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3318:x1875706583739776:12345-0@lo:103: 00010000:00010000:0.0:1788813327.930969:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813327.930973:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff908740030e00/0x6d74dbab2ddb171b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1714 expref: 19 pid: 5843 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.930980:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff908740030e00/0x6d74dbab2ddb171b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1714 expref: 19 pid: 5843 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.930995:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908740030e00/0x6d74dbab2ddb171b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb1714 expref: 19 pid: 5843 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.931004:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813327.931032:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:3318:x1875706583739776:12345-0@lo:103: Request processed in 72us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813327.931038:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788813327.931052:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788813327.931058:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:3318:x1875706583740288:12345-0@lo:103: 00010000:00010000:0.0:1788813327.931068:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813327.931073:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff908740031800/0x6d74dbab2ddb16b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb16b2 expref: 17 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.931081:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff908740031800/0x6d74dbab2ddb16b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb16b2 expref: 17 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.931091:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908740031800/0x6d74dbab2ddb16b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb16b2 expref: 17 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.931100:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813327.931118:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:3318:x1875706583740288:12345-0@lo:103: Request processed in 61us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813327.931124:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788813327.931136:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788813327.931143:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:3318:x1875706583739904:12345-0@lo:103: 00010000:00010000:0.0:1788813327.931151:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813327.931155:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9087413a1c00/0x6d74dbab2ddb16ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb16f8 expref: 15 pid: 5844 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.931169:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9087413a1c00/0x6d74dbab2ddb16ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb16f8 expref: 15 pid: 5844 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.931179:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9087413a1c00/0x6d74dbab2ddb16ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb16f8 expref: 15 pid: 5844 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.931188:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813327.931209:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:3318:x1875706583739904:12345-0@lo:103: Request processed in 68us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813327.931214:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788813327.931227:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788813327.931233:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:3318:x1875706583740416:12345-0@lo:103: 00010000:00010000:0.0:1788813327.931241:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813327.931245:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff908750ad1c00/0x6d74dbab2ddb168f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1688 expref: 13 pid: 5843 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.931254:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff908750ad1c00/0x6d74dbab2ddb168f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1688 expref: 13 pid: 5843 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813327.931761:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fb01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583740032:0@lo:103: 00000100:00100000:1.0:1788813327.931773:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fb00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583739648:0@lo:103: 00000100:00100000:1.0:1788813327.931780:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fb00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583740160:0@lo:103: 00010000:00010000:0.0:1788813327.932687:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908750ad1c00/0x6d74dbab2ddb168f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb1688 expref: 13 pid: 5843 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.932717:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813327.932795:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:3318:x1875706583740416:12345-0@lo:103: Request processed in 1561us (2308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813327.932805:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788813327.932910:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fb00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583739904:0@lo:103: 00000100:00100000:0.0:1788813327.932920:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e4a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583740416:0@lo:103: 00000100:00100000:0.0:1788813327.932952:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fb03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583739776:0@lo:103: 00000100:00100000:0.0:1788813327.932961:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583740288:0@lo:103: 00000100:00100000:3.0:1788813327.939328:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813327.939379:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813327.939381:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8472:1875706583738496:192.168.204.47@tcp:104: 00000100:00100000:0.0:1788813327.939399:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8472:1875706583738624:192.168.204.47@tcp:104: 00000100:00100000:3.0:1788813327.939442:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562744448 00010000:00010000:0.0:1788813327.939476:0:8472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff908750ad1800/0x6d74dbab2ddb1792 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813327.939482:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562744448 00010000:00010000:3.0:1788813327.939537:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff908750ad1200/0x6d74dbab2ddb175a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483c95 expref: 10 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813327.939605:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562744576 00000100:00100000:3.0:1788813327.939609:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562744576 00010000:00010000:3.0:1788813327.939625:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff908750ad1400/0x6d74dbab2ddb1753 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483c8e expref: 11 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813327.939633:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 19 00000100:00100000:3.0:1788813327.939647:0:5835:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788813327.939649:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+11:2359:x1875706562744448:12345-192.168.204.47@tcp:103: 00000100:00100000:3.0:1788813327.939658:0:5835:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1788813327.939674:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813327.939684:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff908750ad1200/0x6d74dbab2ddb175a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483c95 expref: 11 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.939713:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff908750ad1200/0x6d74dbab2ddb175a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483c95 expref: 11 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.939739:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908750ad1200/0x6d74dbab2ddb175a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483c95 expref: 11 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.939762:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813327.939821:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 20 00000100:00100000:3.0:1788813327.939830:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:2359:x1875706562744576:12345-192.168.204.47@tcp:103: 00000100:00100000:0.0:1788813327.939839:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:2359:x1875706562744448:12345-192.168.204.47@tcp:103: Request processed in 194us (531us total) trans 0 rc 0/0 00010000:00010000:3.0:1788813327.939840:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813327.939850:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff908750ad1400/0x6d74dbab2ddb1753 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483c8e expref: 10 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813327.939854:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 19 00010000:00010000:3.0:1788813327.939867:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff908750ad1400/0x6d74dbab2ddb1753 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483c8e expref: 10 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.939882:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908750ad1400/0x6d74dbab2ddb1753 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483c8e expref: 9 pid: 5844 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.939895:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff908750ad1800/0x6d74dbab2ddb1792 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.939905:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908750ad1800/0x6d74dbab2ddb1792 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.939921:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff908750ad1800/0x6d74dbab2ddb1792 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.939943:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff908750ad1800/0x6d74dbab2ddb1792 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.939949:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff908750ad1800/0x6d74dbab2ddb1792 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.939957:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff908750ad1800/0x6d74dbab2ddb1792 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.939964:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1800 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:3.0:1788813327.939968:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff908750ad1800/0x6d74dbab2ddb1792 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.939977:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff908750ad1800/0x6d74dbab2ddb1792 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.939998:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff908750ad1800/0x6d74dbab2ddb1792 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813327.940007:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813327.940031:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+8:2359:x1875706562744576:12345-192.168.204.47@tcp:103: Request processed in 202us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813327.940038:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 20 00010000:00010000:0.0:1788813327.940183:0:8472:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff908750ad1800/0x6d74dbab2ddb1792 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.940192:0:8472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff908750ad1800/0x6d74dbab2ddb1792 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813327.940207:0:8472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908750ad1800/0x6d74dbab2ddb1792 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813328.064462:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813328.070159:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583740544:0@lo:13: 00000100:00100000:1.0:1788813328.070274:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813328.072204:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583740544 00000100:00100000:0.0:1788813328.072225:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583740544 00000100:00100000:0.0:1788813328.072927:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788813328.072946:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c232680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583740544:12345-0@lo:13: 00002000:00000024:0.0:1788813328.073000:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813328.076422:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c232680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583740544:12345-0@lo:13: Request processed in 3463us (6127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813328.076447:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788813328.076805:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3f2a00 x1875706583740544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813328.076942:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583740544:0@lo:13: 00000100:00100000:1.0:1788813328.773639:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813328.773701:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813328.773743:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813328.773858:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562744832 00000100:00100000:2.0:1788813328.773872:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562744832 00000100:00100000:2.0:1788813328.773964:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562744960 00000100:00100000:2.0:1788813328.773968:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562744960 00000100:00100000:2.0:1788813328.773993:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 13 00000100:00100000:2.0:1788813328.774006:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+5:2360:x1875706562744832:12345-192.168.204.47@tcp:400: 00000100:00100000:2.0:1788813328.774098:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c231880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+5:2360:x1875706562744832:12345-192.168.204.47@tcp:400: Request processed in 94us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813328.774108:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 13 00000100:00100000:2.0:1788813328.774129:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 14 00000100:00100000:2.0:1788813328.774136:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+5:2360:x1875706562744960:12345-192.168.204.47@tcp:400: 00000100:00100000:2.0:1788813328.774199:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+5:2360:x1875706562744960:12345-192.168.204.47@tcp:400: Request processed in 63us (455us total) trans 0 rc 0/0 00000100:00080000:1.0:1788813328.774416:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788813328.774428:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813328.774534:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 14 00000100:00100000:0.0:1788813328.774640:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562744704 00000100:00100000:0.0:1788813328.774647:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562744704 00000100:00100000:0.0:1788813328.774723:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 29 00000100:00100000:0.0:1788813328.774731:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+6:2360:x1875706562744704:12345-192.168.204.47@tcp:400: 00000100:00100000:0.0:1788813328.774775:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c233b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+6:2360:x1875706562744704:12345-192.168.204.47@tcp:400: Request processed in 45us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813328.774780:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 29 00000100:00080000:1.0:1788813328.774904:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788813329.087637:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813329.156348:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813329.156468:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562745088 00000100:00100000:3.0:1788813329.156483:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562745088 00000100:00100000:3.0:1788813329.156574:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 132 00000100:00100000:3.0:1788813329.156636:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+8:5602:x1875706562745088:12345-192.168.204.47@tcp:101: 00010000:00010000:3.0:1788813329.156663:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813329.156700:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908750ad1400/0x6d74dbab2ddb1799 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31ee63787e483cf7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813329.156759:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908750ad1400/0x6d74dbab2ddb1799 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483cf7 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813329.156774:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908750ad1400/0x6d74dbab2ddb1799 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483cf7 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813329.156787:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad1400, rc 0) 00000100:00100000:3.0:1788813329.156863:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+9:5602:x1875706562745088:12345-192.168.204.47@tcp:101: Request processed in 231us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813329.156871:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 132 00000100:00100000:3.0:1788813329.166645:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813329.167633:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562745216 00000100:00100000:1.0:1788813329.167651:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562745216 00000100:00100000:1.0:1788813329.167750:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 133 00000100:00100000:1.0:1788813329.167763:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+9:5602:x1875706562745216:12345-192.168.204.47@tcp:501: 00000100:00100000:1.0:1788813329.168441:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+9:5602:x1875706562745216:12345-192.168.204.47@tcp:501: Request processed in 673us (1862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813329.168452:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 133 00000100:00100000:1.0:1788813329.179320:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813329.179436:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562745344 00000100:00100000:0.0:1788813329.179452:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562745344 00000100:00100000:0.0:1788813329.179545:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 134 00000100:00100000:0.0:1788813329.179561:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+9:5602:x1875706562745344:12345-192.168.204.47@tcp:503: 00000100:00100000:0.0:1788813329.179937:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+9:5602:x1875706562745344:12345-192.168.204.47@tcp:503: Request processed in 378us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813329.179947:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 134 00000100:00100000:2.0:1788813329.228183:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813329.228403:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562745472 00000100:00100000:1.0:1788813329.228418:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562745472 00000100:00100000:1.0:1788813329.228498:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 135 00000100:00100000:1.0:1788813329.228528:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+9:6072:x1875706562745472:12345-192.168.204.47@tcp:502: 00000100:00100000:1.0:1788813329.229000:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+9:6072:x1875706562745472:12345-192.168.204.47@tcp:502: Request processed in 489us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813329.229021:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 135 00000100:00100000:1.0:1788813329.254143:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813329.254335:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562745600 00000100:00100000:3.0:1788813329.254351:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562745600 00000100:00100000:3.0:1788813329.254440:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 136 00000100:00100000:3.0:1788813329.254462:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+9:6072:x1875706562745600:12345-192.168.204.47@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788813329.255843:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+9:6072:x1875706562745600:12345-192.168.204.47@tcp:502:llog_process_th.0 Request processed in 713us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813329.255858:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 136 00000100:00100000:2.0:1788813329.266049:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813329.268629:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562745728 00000100:00100000:0.0:1788813329.268656:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562745728 00000100:00100000:2.0:1788813329.268958:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 137 00000100:00100000:2.0:1788813329.268974:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+9:5602:x1875706562745728:12345-192.168.204.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813329.269002:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813329.269255:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908774368a00/0x6d74dbab2ddb17a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x31ee63787e483cfe expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813329.269301:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908774368a00/0x6d74dbab2ddb17a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483cfe expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813329.269317:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908774368a00/0x6d74dbab2ddb17a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483cfe expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813329.269331:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368a00, rc 0) 00000100:00100000:2.0:1788813329.269504:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:5602:x1875706562745728:12345-192.168.204.47@tcp:101:ll_cfg_requeue.0 Request processed in 534us (3473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813329.269521:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 137 00000100:00100000:2.0:1788813329.279682:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813329.280132:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562745856 00000100:00100000:3.0:1788813329.280146:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562745856 00000100:00100000:3.0:1788813329.280690:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 138 00000100:00100000:3.0:1788813329.280711:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:5602:x1875706562745856:12345-192.168.204.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813329.282516:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:5602:x1875706562745856:12345-192.168.204.47@tcp:501:ll_cfg_requeue.0 Request processed in 1806us (2844us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788813329.282530:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 138 10000000:01000000:0.0:1788813329.788787:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788813329.788802:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff908641187800 from 39 10000000:01000000:0.0:1788813329.788811:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788813329.788911:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb17a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813329.788926:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb17a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813329.788940:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb17a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813329.788974:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583740672:0@lo:101: 00000100:00100000:0.0:1788813329.789096:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813329.789164:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dffb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788813329.789429:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583740672 00000100:00100000:3.0:1788813329.789443:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583740672 00000100:00100000:3.0:1788813329.790021:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788813329.790035:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+12:5846:x1875706583740672:12345-0@lo:101: 00010000:00010000:3.0:1788813329.790066:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813329.790087:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908750ad0800/0x6d74dbab2ddb17ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb17a7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813329.790123:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908750ad0800/0x6d74dbab2ddb17ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb17a7 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813329.790136:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908750ad0800/0x6d74dbab2ddb17ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb17a7 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813329.790146:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad0800, rc 0) 00000100:00100000:3.0:1788813329.790245:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:5846:x1875706583740672:12345-0@lo:101: Request processed in 213us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813329.790254:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788813329.790373:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583740672:0@lo:101: 00010000:00010000:0.0:1788813329.790397:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb17a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb17ae expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813329.790406:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb17a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb17ae expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813329.790491:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583740800:0@lo:501: 00000100:00100000:0.0:1788813329.790528:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813329.792748:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dffb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788813329.792995:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583740800 00000100:00100000:1.0:1788813329.793008:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583740800 00000100:00100000:0.0:1788813329.793612:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788813329.793625:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:5846:x1875706583740800:12345-0@lo:501: 00000100:00100000:0.0:1788813329.794634:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:5846:x1875706583740800:12345-0@lo:501: Request processed in 1005us (4098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813329.794647:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788813329.795078:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583740800:0@lo:501: 00000100:00100000:0.0:1788813329.795486:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583740928:0@lo:503: 00000100:00100000:0.0:1788813329.795572:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813329.795900:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dff300 going to sleep for 11 seconds 00000100:00100000:2.0:1788813329.796519:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583740928 00000100:00100000:2.0:1788813329.796548:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583740928 00000100:00100000:2.0:1788813329.796846:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788813329.796858:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:5846:x1875706583740928:12345-0@lo:503: 00000100:00100000:2.0:1788813329.797425:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:5846:x1875706583740928:12345-0@lo:503: Request processed in 326us (1609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813329.797436:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788813329.797574:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583740928:0@lo:503: 00000100:00100000:2.0:1788813329.800110:0:8498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8498:1875706583741056:0@lo:502: 00000100:00100000:2.0:1788813329.800551:0:8498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813329.800922:0:8498:0:(client.c:2716:ptlrpc_set_wait()) set ffff90875efc9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813329.801032:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583741056 00000100:00100000:0.0:1788813329.801043:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583741056 00000100:00100000:0.0:1788813329.801117:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788813329.801130:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:8498:x1875706583741056:12345-0@lo:502: 00000100:00100000:0.0:1788813329.803216:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:8498:x1875706583741056:12345-0@lo:502: Request processed in 2075us (2652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813329.803304:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788813329.803780:0:8498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8498:1875706583741056:0@lo:502: 00000100:00100000:2.0:1788813329.803950:0:8498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8498:1875706583741184:0@lo:502: 00000100:00100000:2.0:1788813329.804025:0:8498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813329.804074:0:8498:0:(client.c:2716:ptlrpc_set_wait()) set ffff90875efc9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813329.804138:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583741184 00000100:00100000:0.0:1788813329.804349:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583741184 00000100:00100000:0.0:1788813329.804533:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788813329.804543:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:8498:x1875706583741184:12345-0@lo:502: 00000100:00100000:0.0:1788813329.804922:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:8498:x1875706583741184:12345-0@lo:502: Request processed in 379us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813329.804930:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788813329.805036:0:8498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8498:1875706583741184:0@lo:502: 00000040:00080000:1.0:1788813329.805070:0:8498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788813329.806527:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788813329.806571:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788813329.806903:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb17a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb17ae expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813329.806946:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb17a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb17ae expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813329.806959:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788813329.806962:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788813329.806966:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788813329.807019:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb17b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813329.807029:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb17b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813329.807042:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb17b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813329.807070:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583741312:0@lo:101: 00000100:00100000:0.0:1788813329.807330:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813329.807484:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dff9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813329.807535:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583741312 00000100:00100000:3.0:1788813329.807545:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583741312 00000100:00100000:3.0:1788813329.807763:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788813329.807775:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+13:5846:x1875706583741312:12345-0@lo:101: 00010000:00010000:3.0:1788813329.807791:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813329.807807:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908750ad0e00/0x6d74dbab2ddb17bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb17b5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813329.807845:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908750ad0e00/0x6d74dbab2ddb17bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb17b5 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813329.807858:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908750ad0e00/0x6d74dbab2ddb17bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb17b5 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813329.807868:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad0e00, rc 0) 00000100:00100000:3.0:1788813329.807938:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:5846:x1875706583741312:12345-0@lo:101: Request processed in 165us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813329.807945:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788813329.808023:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583741312:0@lo:101: 00010000:00010000:0.0:1788813329.808041:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb17b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb17bc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813329.808052:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb17b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb17bc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813329.808119:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583741440:0@lo:501: 00000100:00100000:0.0:1788813329.808146:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813329.808561:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dff9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813329.808640:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583741440 00000100:00100000:2.0:1788813329.808646:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583741440 00000100:00100000:3.0:1788813329.808719:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788813329.808728:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:5846:x1875706583741440:12345-0@lo:501: 00000100:00100000:3.0:1788813329.809053:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:5846:x1875706583741440:12345-0@lo:501: Request processed in 326us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813329.809060:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788813329.809133:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583741440:0@lo:501: 00000100:00100000:0.0:1788813329.809190:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583741568:0@lo:503: 00000100:00100000:0.0:1788813329.809244:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813329.809796:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dff9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813329.809887:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583741568 00000100:00100000:1.0:1788813329.809893:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583741568 00000100:00100000:1.0:1788813329.809930:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788813329.809946:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:5846:x1875706583741568:12345-0@lo:503: 00000100:00100000:1.0:1788813329.810799:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:5846:x1875706583741568:12345-0@lo:503: Request processed in 846us (1547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813329.810809:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788813329.810970:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583741568:0@lo:503: 00000100:00100000:0.0:1788813329.811767:0:8499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8499:1875706583741696:0@lo:502: 00000100:00100000:0.0:1788813329.811979:0:8499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813329.812026:0:8499:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dffc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813329.812448:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583741696 00000100:00100000:1.0:1788813329.812457:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583741696 00000100:00100000:1.0:1788813329.812500:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788813329.812511:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:8499:x1875706583741696:12345-0@lo:502: 00000100:00100000:0.0:1788813329.814102:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:8499:x1875706583741696:12345-0@lo:502: Request processed in 1582us (2112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813329.814118:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788813329.814501:0:8499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8499:1875706583741696:0@lo:502: 00000020:01000000:1.0:1788813329.814550:0:8499:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813329.814563:0:8499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813329.814566:0:8499:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788813329.814571:0:8499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788813329.815142:0:8499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c230a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8499:1875706583741824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813329.815490:0:8499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813329.815639:0:8499:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fa35240 going to sleep for 11 seconds 00000100:00100000:2.0:1788813329.815712:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583741824 00000100:00100000:2.0:1788813329.815721:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583741824 00000100:00100000:2.0:1788813329.815905:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788813329.815917:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:8499:x1875706583741824:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813329.816324:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:8499:x1875706583741824:12345-0@lo:502:llog_process_th.0 Request processed in 407us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813329.816332:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788813329.816994:0:8499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c230a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8499:1875706583741824:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788813329.817045:0:8499:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813329.817055:0:8499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813329.817058:0:8499:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788813329.817063:0:8499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788813329.817818:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788813329.817919:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788813329.817935:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb17b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb17bc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813329.817951:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb17b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb17bc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813329.817966:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788813329.817969:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff908774402000 from 39 10000000:01000000:0.0:1788813329.817973:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788813329.818022:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031200/0x6d74dbab2ddb17c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813329.818032:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908740031200/0x6d74dbab2ddb17c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813329.818069:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908740031200/0x6d74dbab2ddb17c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813329.818101:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583741952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788813329.818363:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813329.818531:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dff3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813329.818611:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583741952 00000100:00100000:2.0:1788813329.818621:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583741952 00000100:00100000:2.0:1788813329.818995:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788813329.819008:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:5846:x1875706583741952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813329.819037:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813329.819058:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908774369800/0x6d74dbab2ddb17ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb17c3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813329.819096:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908774369800/0x6d74dbab2ddb17ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb17c3 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813329.819110:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908774369800/0x6d74dbab2ddb17ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb17c3 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813329.819120:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369800, rc 0) 00000100:00100000:2.0:1788813329.819310:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:5846:x1875706583741952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 304us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813329.819319:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788813329.820143:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583741952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813329.820281:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908740031200/0x6d74dbab2ddb17c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb17ca expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813329.820296:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908740031200/0x6d74dbab2ddb17c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb17ca expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813329.820474:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583742080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813329.820538:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813329.820615:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dff3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813329.820741:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583742080 00000100:00100000:3.0:1788813329.820750:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583742080 00000100:00100000:3.0:1788813329.820806:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788813329.820816:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:5846:x1875706583742080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813329.823353:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583742080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813329.823490:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583742208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813329.823568:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813329.823627:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dff3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813329.823665:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583742208 00000100:00100000:0.0:1788813329.823673:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583742208 00000100:00100000:0.0:1788813329.823719:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788813329.823729:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:5846:x1875706583742208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813329.824136:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:5846:x1875706583742080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2329us (2605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813329.824147:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788813329.825506:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:5846:x1875706583742208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1771us (1931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813329.825526:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788813329.825963:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583742208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813329.827792:0:8500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8500:1875706583742336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813329.829272:0:8500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813329.829351:0:8500:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dff480 going to sleep for 11 seconds 00000100:00100000:3.0:1788813329.829613:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583742336 00000100:00100000:3.0:1788813329.829625:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583742336 00000100:00100000:3.0:1788813329.829705:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788813329.829717:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:8500:x1875706583742336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813329.832999:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:8500:x1875706583742336:12345-0@lo:502:llog_process_th.0 Request processed in 3266us (3719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813329.833018:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788813329.834016:0:8500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8500:1875706583742336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813329.837990:0:8500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8500:1875706583742464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813329.838130:0:8500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813329.838203:0:8500:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dff480 going to sleep for 11 seconds 00000100:00100000:1.0:1788813329.838484:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583742464 00000100:00100000:1.0:1788813329.838497:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583742464 00000100:00100000:1.0:1788813329.838611:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788813329.838623:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:8500:x1875706583742464:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813329.839556:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:8500:x1875706583742464:12345-0@lo:502:llog_process_th.0 Request processed in 929us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813329.839615:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788813329.839912:0:8500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8500:1875706583742464:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788813329.839961:0:8500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788813329.840076:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788813329.840103:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788813329.840128:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031200/0x6d74dbab2ddb17c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb17ca expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813329.840142:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908740031200/0x6d74dbab2ddb17c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb17ca expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813329.840154:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788813329.840157:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788813329.840161:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788813329.840870:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740030e00/0x6d74dbab2ddb17d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813329.840882:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908740030e00/0x6d74dbab2ddb17d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813329.840893:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908740030e00/0x6d74dbab2ddb17d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813329.840931:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583742592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788813329.840995:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813329.841052:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dff480 going to sleep for 11 seconds 00000100:00100000:2.0:1788813329.841261:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583742592 00000100:00100000:2.0:1788813329.841269:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583742592 00000100:00100000:2.0:1788813329.841327:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788813329.841338:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:5846:x1875706583742592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813329.841352:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813329.841440:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908774368200/0x6d74dbab2ddb17d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb17d1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813329.841474:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908774368200/0x6d74dbab2ddb17d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb17d1 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813329.841487:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908774368200/0x6d74dbab2ddb17d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb17d1 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813329.841506:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368200, rc 0) 00000100:00100000:2.0:1788813329.841938:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:5846:x1875706583742592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 600us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813329.841945:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788813329.845816:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583742592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813329.845863:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908740030e00/0x6d74dbab2ddb17d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb17d8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813329.845881:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908740030e00/0x6d74dbab2ddb17d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb17d8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813329.845996:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583742720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813329.846083:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813329.846156:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dff480 going to sleep for 11 seconds 00000100:00100000:2.0:1788813329.846240:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583742720 00000100:00100000:2.0:1788813329.846251:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583742720 00000100:00100000:2.0:1788813329.846316:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788813329.846328:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:5846:x1875706583742720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813329.846761:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:5846:x1875706583742720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 433us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813329.846770:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788813329.846811:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583742720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813329.846853:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583742848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813329.846899:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813329.846931:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dff480 going to sleep for 11 seconds 00000100:00100000:2.0:1788813329.847019:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583742848 00000100:00100000:2.0:1788813329.847025:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583742848 00000100:00100000:2.0:1788813329.847056:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788813329.847063:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:5846:x1875706583742848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813329.847251:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:5846:x1875706583742848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813329.847258:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788813329.847513:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583742848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813329.849291:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8502:1875706583742976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813329.849420:0:8502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813329.849472:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583742976 00000100:00100000:2.0:1788813329.849481:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583742976 00000100:00100000:2.0:1788813329.849538:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788813329.849548:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:8502:x1875706583742976:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813329.850056:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:8502:x1875706583742976:12345-0@lo:502:llog_process_th.0 Request processed in 507us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813329.850076:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788813329.850143:0:8502:0:(client.c:2716:ptlrpc_set_wait()) set ffff908781d18b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788813329.850170:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8502:1875706583742976:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788813329.850930:0:8502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813329.850944:0:8502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813329.850946:0:8502:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788813329.850954:0:8502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788813329.850995:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8502:1875706583743104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813329.851059:0:8502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813329.851089:0:8502:0:(client.c:2716:ptlrpc_set_wait()) set ffff908748f54c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813329.851130:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583743104 00000100:00100000:0.0:1788813329.851139:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583743104 00000100:00100000:0.0:1788813329.851707:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788813329.851718:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:8502:x1875706583743104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813329.851977:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:8502:x1875706583743104:12345-0@lo:502:llog_process_th.0 Request processed in 260us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813329.851994:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788813329.852061:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8502:1875706583743104:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788813329.852088:0:8502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813329.852094:0:8502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813329.852096:0:8502:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788813329.852102:0:8502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1788813329.853011:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788813329.853041:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788813329.853054:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740030e00/0x6d74dbab2ddb17d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb17d8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813329.853068:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908740030e00/0x6d74dbab2ddb17d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb17d8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813329.853107:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788813329.853111:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff908781c96000 from 39 10000000:01000000:1.0:1788813329.853115:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788813329.853170:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148da00/0x6d74dbab2ddb17df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813329.853348:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff90874148da00/0x6d74dbab2ddb17df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813329.853428:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff90874148da00/0x6d74dbab2ddb17df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813329.853458:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c230a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583743232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788813329.853530:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813329.853644:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fa35780 going to sleep for 11 seconds 00000100:00100000:3.0:1788813329.856884:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583743232 00000100:00100000:3.0:1788813329.856904:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583743232 00000100:00100000:3.0:1788813329.856982:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788813329.857010:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:5846:x1875706583743232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813329.857035:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813329.857059:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908750ad0200/0x6d74dbab2ddb17e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb17df expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813329.857095:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908750ad0200/0x6d74dbab2ddb17e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb17df expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813329.857107:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908750ad0200/0x6d74dbab2ddb17e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb17df expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813329.857118:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad0200, rc 0) 00000100:00100000:3.0:1788813329.857576:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:5846:x1875706583743232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 566us (4043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813329.857708:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c230a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583743232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813329.857734:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff90874148da00/0x6d74dbab2ddb17df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb17e6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813329.857746:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff90874148da00/0x6d74dbab2ddb17df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb17e6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813329.857863:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c230a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583743360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813329.857915:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813329.857966:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fa35780 going to sleep for 11 seconds 00000100:00100000:2.0:1788813329.858022:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583743360 00000100:00100000:2.0:1788813329.858028:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583743360 00000100:00100000:2.0:1788813329.858072:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788813329.858080:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583743360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813329.858465:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583743360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 385us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813329.858475:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788813329.859317:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788813329.859551:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c230a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583743360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813329.859677:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c230a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583743488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813329.859758:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813329.859806:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fa35780 going to sleep for 11 seconds 00000100:00100000:3.0:1788813329.859941:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583743488 00000100:00100000:3.0:1788813329.859951:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583743488 00000100:00100000:3.0:1788813329.860003:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788813329.860013:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:5846:x1875706583743488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813329.860722:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:5846:x1875706583743488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 704us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813329.860731:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788813329.863141:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c230a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583743488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813329.864078:0:8504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8504:1875706583743616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813329.864305:0:8504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813329.864466:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583743616 00000100:00100000:3.0:1788813329.864477:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583743616 00000100:00100000:3.0:1788813329.864540:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788813329.864551:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:8504:x1875706583743616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813329.864938:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:8504:x1875706583743616:12345-0@lo:502:llog_process_th.0 Request processed in 387us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813329.864952:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788813329.865121:0:8504:0:(client.c:2716:ptlrpc_set_wait()) set ffff908748f54f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813329.865156:0:8504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8504:1875706583743616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813329.865346:0:8504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8504:1875706583743744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813329.865457:0:8504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813329.865486:0:8504:0:(client.c:2716:ptlrpc_set_wait()) set ffff908748f54f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813329.865597:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583743744 00000100:00100000:1.0:1788813329.865605:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583743744 00000100:00100000:1.0:1788813329.865638:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788813329.865647:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:8504:x1875706583743744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813329.865924:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:8504:x1875706583743744:12345-0@lo:502:llog_process_th.0 Request processed in 277us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813329.865932:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788813329.866077:0:8504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8504:1875706583743744:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788813329.866098:0:8504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788813329.866485:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788813329.866505:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788813329.866518:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148da00/0x6d74dbab2ddb17df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb17e6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813329.866531:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff90874148da00/0x6d74dbab2ddb17df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb17e6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813329.866542:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788813329.866545:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788813329.866549:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788813329.866615:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148d000/0x6d74dbab2ddb17ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813329.866625:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff90874148d000/0x6d74dbab2ddb17ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813329.866635:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff90874148d000/0x6d74dbab2ddb17ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813329.866676:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c231f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583743872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788813329.866718:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813329.867732:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fa35840 going to sleep for 11 seconds 00000100:00100000:2.0:1788813329.868958:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583743872 00000100:00100000:2.0:1788813329.868972:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583743872 00000100:00100000:2.0:1788813329.869036:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788813329.869048:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:5846:x1875706583743872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813329.869068:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813329.869093:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908774369200/0x6d74dbab2ddb17f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb17ed expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813329.869128:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908774369200/0x6d74dbab2ddb17f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb17ed expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813329.869141:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908774369200/0x6d74dbab2ddb17f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb17ed expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813329.869151:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369200, rc 0) 00000100:00100000:2.0:1788813329.869260:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583743872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 214us (2541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813329.869267:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788813329.869778:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c231f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583743872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813329.869804:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff90874148d000/0x6d74dbab2ddb17ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb17f4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813329.869816:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff90874148d000/0x6d74dbab2ddb17ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb17f4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813329.869926:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c231f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583744000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813329.869974:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813329.870014:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fa35840 going to sleep for 11 seconds 00000100:00100000:3.0:1788813329.870573:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583744000 00000100:00100000:3.0:1788813329.870593:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583744000 00000100:00100000:3.0:1788813329.870636:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788813329.870647:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583744000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813329.872304:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583744000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1549us (2219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813329.872320:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788813329.875682:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c231f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583744000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813329.875786:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c231f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583744128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813329.875905:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813329.875958:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fa35840 going to sleep for 11 seconds 00000100:00100000:3.0:1788813329.876092:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583744128 00000100:00100000:3.0:1788813329.876102:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583744128 00000100:00100000:3.0:1788813329.876187:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788813329.876201:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583744128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813329.876906:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583744128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 704us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813329.876916:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788813329.878206:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c231f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583744128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813329.879491:0:8505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8505:1875706583744256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813329.879749:0:8505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813329.879806:0:8505:0:(client.c:2716:ptlrpc_set_wait()) set ffff908748f54780 going to sleep for 11 seconds 00000100:00100000:1.0:1788813329.880067:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583744256 00000100:00100000:1.0:1788813329.880077:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583744256 00000100:00100000:1.0:1788813329.880244:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788813329.880257:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:8505:x1875706583744256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813329.880674:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:8505:x1875706583744256:12345-0@lo:502:llog_process_th.0 Request processed in 417us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813329.880698:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788813329.880823:0:8505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8505:1875706583744256:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788813329.880874:0:8505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813329.880885:0:8505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813329.880888:0:8505:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788813329.880897:0:8505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788813329.880938:0:8505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8505:1875706583744384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813329.880984:0:8505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813329.887628:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583744384 00000100:00100000:3.0:1788813329.887647:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583744384 00000100:00100000:3.0:1788813329.888078:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788813329.888091:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:8505:x1875706583744384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813329.890005:0:8505:0:(client.c:2716:ptlrpc_set_wait()) set ffff908748f54780 going to sleep for 11 seconds 00000100:00100000:2.0:1788813329.891500:0:8505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8505:1875706583744384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788813329.891551:0:8505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813329.891562:0:8505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813329.891565:0:8505:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788813329.891572:0:8505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000100:00100000:3.0:1788813329.891939:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:8505:x1875706583744384:12345-0@lo:502:llog_process_th.0 Request processed in 3847us (10950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813329.891952:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000020:01000000:3.0:1788813329.892596:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1788813329.892622:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788813329.892635:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148d000/0x6d74dbab2ddb17ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb17f4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813329.892672:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff90874148d000/0x6d74dbab2ddb17ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb17f4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813329.892687:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788813329.892691:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff908749b5cd40 from 1 10000000:01000000:3.0:1788813329.892695:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788813329.893302:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908750ad1600/0x6d74dbab2ddb17fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813329.893314:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908750ad1600/0x6d74dbab2ddb17fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813329.893327:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908750ad1600/0x6d74dbab2ddb17fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813329.893360:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbcb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583744512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788813329.894303:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813329.894609:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087486e4900 going to sleep for 11 seconds 00000100:00100000:2.0:1788813329.894817:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583744512 00000100:00100000:2.0:1788813329.894958:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583744512 00000100:00100000:1.0:1788813329.895556:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788813329.895573:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583744512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813329.895615:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813329.895642:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb1802 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb17fb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813329.895692:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb1802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb17fb expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813329.895711:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb1802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb17fb expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813329.895721:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148ce00, rc 0) 00000100:00100000:1.0:1788813329.895812:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:5846:x1875706583744512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 244us (1511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813329.895819:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788813329.896788:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbcb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583744512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813329.896820:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908750ad1600/0x6d74dbab2ddb17fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1802 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813329.896909:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908750ad1600/0x6d74dbab2ddb17fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb1802 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813329.897018:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c231f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583744640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813329.897081:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813329.897312:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fa35180 going to sleep for 11 seconds 00000100:00100000:3.0:1788813329.897469:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583744640 00000100:00100000:3.0:1788813329.897480:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583744640 00000100:00100000:3.0:1788813329.897573:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788813329.897618:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:5846:x1875706583744640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813329.898139:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:5846:x1875706583744640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 522us (1054us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788813329.898281:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788813329.898409:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c231f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583744640:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788813329.898450:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788813329.898461:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908750ad1600/0x6d74dbab2ddb17fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1802 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813329.898473:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908750ad1600/0x6d74dbab2ddb17fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1802 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813330.114348:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788813330.556257:0:8532:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb4cfab90 20000000:00000080:3.0:1788813330.556286:0:8532:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90876e40f400 uarg=0000000000000000 20000000:01000000:3.0:1788813330.556368:0:8532:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788813330.556382:0:8532:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788813330.556387:0:8532:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788813330.563529:0:8533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788813330.564073:0:8532:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788813330.575231:0:8532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788813330.575305:0:8532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788813330.575386:0:8532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788813330.575413:0:8532:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788813330.576941:0:8532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff908750ad1200/0x6d74dbab2ddb1809 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813330.576975:0:8532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff908750ad0c00/0x6d74dbab2ddb157e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1577 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813330.576986:0:8532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90874148d600/0x6d74dbab2ddb15e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb15d9 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813330.576994:0:8532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff908740030000/0x6d74dbab2ddb16ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb16a4 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813330.577007:0:8532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff908740030c00/0x6d74dbab2ddb1768 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483cc6 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813330.577016:0:8532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff908750ad1200/0x6d74dbab2ddb1809 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813330.577113:0:8532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff908740030c00/0x6d74dbab2ddb1768 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483cc6 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813330.577131:0:8532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff908740030c00/0x6d74dbab2ddb1768 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483cc6 expref: 9 pid: 5841 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813330.577149:0:8532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbc9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8532:1875706583744768:192.168.204.47@tcp:104: 00010000:00010000:3.0:1788813330.578563:0:8532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff908740030000/0x6d74dbab2ddb16ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb16a4 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813330.578605:0:8532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff908740030000/0x6d74dbab2ddb16ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb16a4 expref: 18 pid: 5844 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813330.578622:0:8532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbc9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8532:1875706583744896:0@lo:104: 00000100:00100000:3.0:1788813330.578719:0:8532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788813330.578784:0:8532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90874148d600/0x6d74dbab2ddb15e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb15d9 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813330.578791:0:8532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90874148d600/0x6d74dbab2ddb15e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb15d9 expref: 18 pid: 5841 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813330.578799:0:8532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbc8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8532:1875706583745024:0@lo:104: 00000100:00100000:3.0:1788813330.578825:0:8532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788813330.578855:0:8532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff908750ad0c00/0x6d74dbab2ddb157e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb1577 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813330.578863:0:8532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff908750ad0c00/0x6d74dbab2ddb157e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1577 expref: 18 pid: 5844 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813330.578872:0:8532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbcb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8532:1875706583745152:0@lo:104: 00000100:00100000:3.0:1788813330.578891:0:8532:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087486e4240 going to sleep for 11 seconds 00000100:00100000:2.0:1788813330.579185:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788813330.579209:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813330.579223:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583744896 00000100:00100000:2.0:1788813330.579231:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583744896 00000100:00100000:2.0:1788813330.579285:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583745024 00000100:00100000:2.0:1788813330.579289:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583745024 00000100:00100000:2.0:1788813330.579299:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583745152 00000100:00100000:2.0:1788813330.579301:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583745152 00000100:00100000:2.0:1788813330.579314:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788813330.579323:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbcb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+5:8532:x1875706583744896:12345-0@lo:104: 00010000:00010000:2.0:1788813330.579341:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff90874148c400/0x6d74dbab2ddb16a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb16ab expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813330.579425:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788813330.579459:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbcb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+5:8532:x1875706583744896:12345-0@lo:104: Request processed in 137us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813330.579467:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788813330.579488:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788813330.579494:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876ea29850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+4:8532:x1875706583745024:12345-0@lo:104: 00010000:00010000:2.0:1788813330.579503:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff9087413a0200/0x6d74dbab2ddb15d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb15e0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813330.579542:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788813330.579547:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876ea29850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+4:8532:x1875706583745024:12345-0@lo:104: Request processed in 53us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813330.579554:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788813330.579627:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788813330.579634:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+3:8532:x1875706583745152:12345-0@lo:104: 00010000:00010000:2.0:1788813330.579654:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff908740030a00/0x6d74dbab2ddb1577 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb157e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813330.579690:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788813330.579696:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+3:8532:x1875706583745152:12345-0@lo:104: Request processed in 63us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813330.579702:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788813330.579721:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788813330.579746:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff90874148c400/0x6d74dbab2ddb16a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb16ab expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813330.579754:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148c400 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:2.0:1788813330.579759:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff90874148c400/0x6d74dbab2ddb16a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb16ab expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813330.579780:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff90874148c400/0x6d74dbab2ddb16a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb16ab expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813330.579789:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff90874148c400/0x6d74dbab2ddb16a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb16ab expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813330.579795:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788813330.579837:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff90874148c400/0x6d74dbab2ddb16a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb16ab expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813330.579845:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813330.579872:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff90874148c400/0x6d74dbab2ddb16a4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb16ab expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813330.579879:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff90874148c400/0x6d74dbab2ddb16a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb16ab expref: -99 pid: 7652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813330.579896:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788813330.579899:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff9087413a0200/0x6d74dbab2ddb15d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb15e0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813330.579905:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a0200 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:2.0:1788813330.579908:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff9087413a0200/0x6d74dbab2ddb15d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb15e0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813330.579914:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff9087413a0200/0x6d74dbab2ddb15d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb15e0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813330.579921:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff9087413a0200/0x6d74dbab2ddb15d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb15e0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813330.579933:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788813330.579947:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff9087413a0200/0x6d74dbab2ddb15d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb15e0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813330.579954:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813330.579968:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff9087413a0200/0x6d74dbab2ddb15d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb15e0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813330.579975:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff9087413a0200/0x6d74dbab2ddb15d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb15e0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813330.579986:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813330.579989:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908740030a00/0x6d74dbab2ddb1577 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb157e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813330.579995:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740030a00 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:2.0:1788813330.579998:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908740030a00/0x6d74dbab2ddb1577 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb157e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813330.580005:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908740030a00/0x6d74dbab2ddb1577 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb157e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813330.580011:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908740030a00/0x6d74dbab2ddb1577 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb157e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813330.580016:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788813330.580029:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff908740030a00/0x6d74dbab2ddb1577 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb157e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813330.580035:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813330.580048:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908740030a00/0x6d74dbab2ddb1577 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb157e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813330.580055:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908740030a00/0x6d74dbab2ddb1577 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb157e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813330.580071:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813330.580073:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813330.580075:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813330.580083:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813330.580100:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583745280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813330.580140:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788813330.582008:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813330.582044:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583745408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813330.582150:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813330.582238:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813330.582246:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583745536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813330.582270:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813330.582313:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583745280 00000100:00100000:0.0:1788813330.582323:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583745280 00010000:00010000:0.0:1788813330.582376:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff908740030000/0x6d74dbab2ddb16ab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb16a4 expref: 19 pid: 5844 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813330.582412:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583745408 00000100:00100000:0.0:1788813330.582414:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583745408 00010000:00010000:0.0:1788813330.582426:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90874148d600/0x6d74dbab2ddb15e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb15d9 expref: 20 pid: 5841 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813330.582448:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583745536 00000100:00100000:0.0:1788813330.582451:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583745536 00010000:00010000:0.0:1788813330.582463:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff908750ad0c00/0x6d74dbab2ddb157e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1577 expref: 21 pid: 5844 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813330.582499:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788813330.582507:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+21:3321:x1875706583745280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813330.582527:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813330.582533:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff908740030000/0x6d74dbab2ddb16ab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb16a4 expref: 21 pid: 5844 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813330.582545:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff908740030000/0x6d74dbab2ddb16ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb16a4 expref: 21 pid: 5844 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813330.582570:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813330.582671:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+21:3321:x1875706583745280:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (2530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813330.582690:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788813330.582715:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788813330.582723:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+20:3318:x1875706583745408:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813330.584007:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788813330.584032:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+20:3318:x1875706583745536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813330.584052:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813330.584062:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff908750ad0c00/0x6d74dbab2ddb157e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1577 expref: 20 pid: 5844 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813330.584076:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff908750ad0c00/0x6d74dbab2ddb157e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1577 expref: 20 pid: 5844 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813330.584096:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813330.584174:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+20:3318:x1875706583745536:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (1902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813330.584181:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788813330.584277:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583745280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813330.584319:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583745536:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813330.584448:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813330.584455:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90874148d600/0x6d74dbab2ddb15e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb15d9 expref: 19 pid: 5841 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813330.584464:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90874148d600/0x6d74dbab2ddb15e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb15d9 expref: 19 pid: 5841 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813330.584474:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813330.584512:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3318:x1875706583745408:12345-0@lo:103:ldlm_bl.0 Request processed in 1791us (2364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813330.584520:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1788813330.584911:0:8532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908740030000/0x6d74dbab2ddb16ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb16a4 expref: 18 pid: 5844 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813330.584927:0:8532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbc9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8532:1875706583744896:0@lo:104: 00010000:00010000:3.0:1788813330.584938:0:8532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90874148d600/0x6d74dbab2ddb15e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb15d9 expref: 17 pid: 5841 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813330.584964:0:8532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbc8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8532:1875706583745024:0@lo:104: 00010000:00010000:3.0:1788813330.584976:0:8532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908750ad0c00/0x6d74dbab2ddb157e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb1577 expref: 16 pid: 5844 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813330.584984:0:8532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbcb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8532:1875706583745152:0@lo:104: 00000100:00100000:2.0:1788813330.585330:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583745408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813330.600119:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813330.600281:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562745984 00000100:00100000:0.0:1788813330.600315:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562745984 00010000:00010000:0.0:1788813330.600373:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff908740030c00/0x6d74dbab2ddb1768 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483cc6 expref: 10 pid: 5841 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813330.600439:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 24 00000100:00100000:0.0:1788813330.600451:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:2359:x1875706562745984:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813330.600472:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813330.600478:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff908740030c00/0x6d74dbab2ddb1768 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483cc6 expref: 10 pid: 5841 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813330.600492:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff908740030c00/0x6d74dbab2ddb1768 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483cc6 expref: 10 pid: 5841 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813330.600522:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff908750ad1200/0x6d74dbab2ddb1809 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813330.600532:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908750ad1200/0x6d74dbab2ddb1809 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813330.600557:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff908750ad1200/0x6d74dbab2ddb1809 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813330.600564:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff908750ad1200/0x6d74dbab2ddb1809 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813330.600572:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff908750ad1200/0x6d74dbab2ddb1809 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813330.600615:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff908750ad1200/0x6d74dbab2ddb1809 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813330.600623:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1200 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813330.600636:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff908750ad1200/0x6d74dbab2ddb1809 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813330.600656:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff908750ad1200/0x6d74dbab2ddb1809 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813330.600667:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff908750ad1200/0x6d74dbab2ddb1809 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813330.600910:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813330.600999:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:2359:x1875706562745984:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 548us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813330.601009:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 24 00010000:00010000:3.0:1788813330.601995:0:8532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908740030c00/0x6d74dbab2ddb1768 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483cc6 expref: 9 pid: 5841 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813330.602017:0:8532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbc9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8532:1875706583744768:192.168.204.47@tcp:104: 00010000:00010000:3.0:1788813330.602060:0:8532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff908750ad1200/0x6d74dbab2ddb1809 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813330.602071:0:8532:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff908750ad1200/0x6d74dbab2ddb1809 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813330.602078:0:8532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff908750ad1200/0x6d74dbab2ddb1809 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813330.602085:0:8532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908750ad1200/0x6d74dbab2ddb1809 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813331.133711:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813331.136275:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583745664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813331.136375:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813331.136835:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583745664 00000100:00100000:3.0:1788813331.136845:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583745664 00000100:00100000:3.0:1788813331.136938:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788813331.136950:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813331.136952:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583745664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813331.137001:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813331.137076:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583745664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813331.137104:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788813331.137376:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877fbc9500 x1875706583745664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813331.137400:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583745664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813331.716247:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813331.718073:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562746112 00000100:00100000:2.0:1788813331.718151:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562746112 00000100:00100000:2.0:1788813331.718250:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 171 00000100:00100000:2.0:1788813331.718264:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90875243bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+9:5602:x1875706562746112:12345-192.168.204.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813331.718286:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813331.718316:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908774368400/0x6d74dbab2ddb1810 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31ee63787e483d05 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813331.718356:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908774368400/0x6d74dbab2ddb1810 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d05 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813331.718370:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908774368400/0x6d74dbab2ddb1810 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d05 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813331.718380:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368400, rc 0) 00000100:00100000:2.0:1788813331.718466:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90875243bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:5602:x1875706562746112:12345-192.168.204.47@tcp:101:ll_cfg_requeue.0 Request processed in 206us (2689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813331.718474:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 171 00000100:00100000:1.0:1788813331.723660:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813331.724793:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562746240 00000100:00100000:3.0:1788813331.724812:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562746240 00000100:00100000:3.0:1788813331.724891:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 172 00000100:00100000:3.0:1788813331.724954:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:5602:x1875706562746240:12345-192.168.204.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813331.725384:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:5602:x1875706562746240:12345-192.168.204.47@tcp:501:ll_cfg_requeue.0 Request processed in 433us (1741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813331.725394:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 172 00000100:00100000:3.0:1788813331.729955:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813331.731081:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562746368 00000100:00100000:0.0:1788813331.731098:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562746368 00000100:00100000:0.0:1788813331.731179:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 173 00000100:00100000:0.0:1788813331.731194:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:5602:x1875706562746368:12345-192.168.204.47@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813331.731532:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:5602:x1875706562746368:12345-192.168.204.47@tcp:503:ll_cfg_requeue.0 Request processed in 339us (1590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813331.731542:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 173 00000100:00100000:1.0:1788813331.737696:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813331.738476:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562746496 00000100:00100000:3.0:1788813331.738492:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562746496 00000100:00100000:3.0:1788813331.738576:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 174 00000100:00100000:3.0:1788813331.738629:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:6125:x1875706562746496:12345-192.168.204.47@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788813331.743476:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:6125:x1875706562746496:12345-192.168.204.47@tcp:502:llog_process_th.0 Request processed in 4322us (5259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813331.743500:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 174 00000100:00100000:3.0:1788813331.759523:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813331.759759:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562746624 00000100:00100000:2.0:1788813331.759773:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562746624 00000100:00100000:2.0:1788813331.759845:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 175 00000100:00100000:2.0:1788813331.759857:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:6125:x1875706562746624:12345-192.168.204.47@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788813331.760473:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:6125:x1875706562746624:12345-192.168.204.47@tcp:502:llog_process_th.0 Request processed in 613us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813331.760493:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 175 00010000:00010000:2.0:1788813332.156856:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788813332.285847:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788813332.285855:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff908641187800 from 4 10000000:01000000:3.0:1788813332.285860:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788813332.285908:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908750ad1200/0x6d74dbab2ddb1817 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813332.285920:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908750ad1200/0x6d74dbab2ddb1817 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813332.285930:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908750ad1200/0x6d74dbab2ddb1817 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813332.285965:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbcb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583745792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788813332.286052:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813332.286097:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087486e40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813332.286121:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583745792 00000100:00100000:3.0:1788813332.286130:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583745792 00000100:00100000:3.0:1788813332.286176:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788813332.286186:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:5846:x1875706583745792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813332.286200:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813332.286213:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908750ad0c00/0x6d74dbab2ddb181e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb1817 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813332.286237:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908750ad0c00/0x6d74dbab2ddb181e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1817 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813332.286248:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908750ad0c00/0x6d74dbab2ddb181e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1817 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813332.286257:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad0c00, rc 0) 00000100:00100000:3.0:1788813332.286294:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:5846:x1875706583745792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813332.286300:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788813332.286350:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbcb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583745792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813332.286365:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908750ad1200/0x6d74dbab2ddb1817 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb181e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813332.286374:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908750ad1200/0x6d74dbab2ddb1817 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb181e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813332.286432:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbcb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583745920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813332.286456:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813332.286469:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087486e40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813332.287750:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583745920 00000100:00100000:2.0:1788813332.287763:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583745920 00000100:00100000:2.0:1788813332.288140:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788813332.288153:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:5846:x1875706583745920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813332.288444:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:5846:x1875706583745920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 292us (1985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813332.288451:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788813332.288508:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbcb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583745920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813332.288555:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583746048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813332.291225:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813332.291286:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff908748f54a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813332.291847:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583746048 00000100:00100000:0.0:1788813332.291857:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583746048 00000100:00100000:0.0:1788813332.291905:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788813332.291915:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:5846:x1875706583746048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813332.292194:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:5846:x1875706583746048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 280us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813332.292202:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788813332.292740:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583746048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813332.294505:0:8571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbc8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8571:1875706583746176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813332.294648:0:8571:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813332.294705:0:8571:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087486e4900 going to sleep for 11 seconds 00000100:00100000:2.0:1788813332.296171:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583746176 00000100:00100000:2.0:1788813332.296185:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583746176 00000100:00100000:2.0:1788813332.296250:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788813332.296260:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:8571:x1875706583746176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813332.296539:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:8571:x1875706583746176:12345-0@lo:502:llog_process_th.0 Request processed in 267us (1877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813332.296549:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788813332.296755:0:8571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbc8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8571:1875706583746176:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788813332.296790:0:8571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813332.296800:0:8571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813332.296803:0:8571:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788813332.296811:0:8571:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff908641187800 00000020:00000080:3.0:1788813332.296814:0:8571:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788813332.296909:0:8571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbc8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8571:1875706583746304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813332.296955:0:8571:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813332.296998:0:8571:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087486e4900 going to sleep for 11 seconds 00000100:00100000:2.0:1788813332.298167:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583746304 00000100:00100000:2.0:1788813332.298177:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583746304 00000100:00100000:2.0:1788813332.298222:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788813332.298231:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:8571:x1875706583746304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813332.298456:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:8571:x1875706583746304:12345-0@lo:502:llog_process_th.0 Request processed in 225us (1499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813332.298469:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788813332.298683:0:8571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbc8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8571:1875706583746304:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788813332.298716:0:8571:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813332.298725:0:8571:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813332.298727:0:8571:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788813332.298733:0:8571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788813332.299723:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788813332.299748:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788813332.299760:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908750ad1200/0x6d74dbab2ddb1817 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb181e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813332.299775:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908750ad1200/0x6d74dbab2ddb1817 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb181e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813332.299787:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788813332.299792:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff908774402000 from 4 10000000:01000000:2.0:1788813332.299795:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788813332.299847:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908774369400/0x6d74dbab2ddb1825 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813332.299857:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908774369400/0x6d74dbab2ddb1825 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813332.299868:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908774369400/0x6d74dbab2ddb1825 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813332.299891:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583746432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788813332.299945:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813332.299983:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff908748f54780 going to sleep for 11 seconds 00000100:00100000:3.0:1788813332.300224:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583746432 00000100:00100000:3.0:1788813332.300234:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583746432 00000100:00100000:3.0:1788813332.300278:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788813332.300287:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:5846:x1875706583746432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813332.300311:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813332.300323:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908750ad1800/0x6d74dbab2ddb182c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb1825 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813332.300348:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908750ad1800/0x6d74dbab2ddb182c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1825 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813332.300359:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908750ad1800/0x6d74dbab2ddb182c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1825 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813332.300368:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad1800, rc 0) 00000100:00100000:3.0:1788813332.300411:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583746432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813332.300418:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788813332.300499:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583746432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813332.300514:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908774369400/0x6d74dbab2ddb1825 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb182c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813332.300523:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908774369400/0x6d74dbab2ddb1825 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb182c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813332.300776:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583746560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813332.300809:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813332.301130:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff908748f54780 going to sleep for 11 seconds 00000100:00100000:3.0:1788813332.301219:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583746560 00000100:00100000:3.0:1788813332.301224:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583746560 00000100:00100000:3.0:1788813332.301259:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788813332.301267:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583746560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813332.301777:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583746560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813332.302001:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583746688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813332.302760:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813332.302795:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff908748f54780 going to sleep for 11 seconds 00000100:00100000:2.0:1788813332.302972:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583746688 00000100:00100000:2.0:1788813332.302982:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583746688 00000100:00100000:3.0:1788813332.303185:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:5846:x1875706583746560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813332.303196:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788813332.303239:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788813332.303248:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583746688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813332.303446:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583746688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813332.303453:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788813332.312890:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583746688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813332.320473:0:8575:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8575:1875706583746816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813332.320562:0:8575:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813332.320737:0:8575:0:(client.c:2716:ptlrpc_set_wait()) set ffff908748f54780 going to sleep for 11 seconds 00000100:00100000:3.0:1788813332.320792:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583746816 00000100:00100000:3.0:1788813332.320807:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583746816 00000100:00100000:3.0:1788813332.320864:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788813332.320874:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:8575:x1875706583746816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813332.321274:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:8575:x1875706583746816:12345-0@lo:502:llog_process_th.0 Request processed in 401us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813332.321283:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788813332.321550:0:8575:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8575:1875706583746816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788813332.321597:0:8575:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813332.321619:0:8575:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813332.321622:0:8575:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788813332.321630:0:8575:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff908774402000 00000020:00000080:3.0:1788813332.321632:0:8575:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788813332.321713:0:8575:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbc8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8575:1875706583746944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813332.321767:0:8575:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813332.321802:0:8575:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749ce4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813332.322357:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583746944 00000100:00100000:2.0:1788813332.322365:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583746944 00000100:00100000:2.0:1788813332.322417:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788813332.322427:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:8575:x1875706583746944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813332.323209:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:8575:x1875706583746944:12345-0@lo:502:llog_process_th.0 Request processed in 781us (1438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813332.323219:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788813332.324302:0:8575:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbc8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8575:1875706583746944:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788813332.324343:0:8575:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813332.324351:0:8575:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813332.324353:0:8575:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788813332.324357:0:8575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788813332.324485:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788813332.324514:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788813332.324539:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908774369400/0x6d74dbab2ddb1825 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb182c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813332.324552:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908774369400/0x6d74dbab2ddb1825 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb182c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813332.324563:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788813332.324566:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff908781c96000 from 4 10000000:01000000:2.0:1788813332.324569:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788813332.324634:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908774369600/0x6d74dbab2ddb1833 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813332.324643:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908774369600/0x6d74dbab2ddb1833 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813332.324652:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908774369600/0x6d74dbab2ddb1833 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813332.324678:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583747072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788813332.324758:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813332.324797:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fa35cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813332.324826:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583747072 00000100:00100000:2.0:1788813332.324832:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583747072 00000100:00100000:2.0:1788813332.324871:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788813332.324880:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583747072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813332.324891:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813332.324904:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908774368e00/0x6d74dbab2ddb183a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb1833 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813332.324941:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908774368e00/0x6d74dbab2ddb183a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1833 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813332.324951:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908774368e00/0x6d74dbab2ddb183a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1833 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813332.324960:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368e00, rc 0) 00000100:00100000:2.0:1788813332.324995:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:5846:x1875706583747072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813332.325001:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788813332.325040:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583747072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813332.325054:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908774369600/0x6d74dbab2ddb1833 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb183a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813332.325063:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908774369600/0x6d74dbab2ddb1833 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb183a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813332.326056:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583747200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813332.326105:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813332.326146:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fa35cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813332.326169:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583747200 00000100:00100000:2.0:1788813332.326174:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583747200 00000100:00100000:2.0:1788813332.326209:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788813332.326218:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:5846:x1875706583747200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813332.326509:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:5846:x1875706583747200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813332.326525:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788813332.326598:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583747200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813332.326644:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583747328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813332.326682:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813332.326700:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90875efc9780 going to sleep for 11 seconds 00000100:00100000:2.0:1788813332.326712:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583747328 00000100:00100000:2.0:1788813332.326716:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583747328 00000100:00100000:2.0:1788813332.326754:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788813332.326761:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908760094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:5846:x1875706583747328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813332.330171:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908760094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:5846:x1875706583747328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3401us (3479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813332.330186:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788813332.330268:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583747328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813332.333320:0:8576:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8576:1875706583747456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813332.333407:0:8576:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813332.333444:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583747456 00000100:00100000:0.0:1788813332.333450:0:8576:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749cf3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788813332.333451:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583747456 00000100:00100000:2.0:1788813332.333490:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788813332.333499:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908760094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:8576:x1875706583747456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813332.338234:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908760094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:8576:x1875706583747456:12345-0@lo:502:llog_process_th.0 Request processed in 4725us (4816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813332.338248:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788813332.338398:0:8576:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8576:1875706583747456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788813332.338440:0:8576:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813332.338450:0:8576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813332.338452:0:8576:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788813332.338461:0:8576:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff908781c96000 00000020:00000080:3.0:1788813332.338463:0:8576:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788813332.338658:0:8576:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbc9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8576:1875706583747584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813332.338708:0:8576:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813332.338750:0:8576:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749ce4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788813332.339409:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583747584 00000100:00100000:2.0:1788813332.339418:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583747584 00000100:00100000:2.0:1788813332.339476:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788813332.339485:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908760095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:8576:x1875706583747584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813332.341033:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908760095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:8576:x1875706583747584:12345-0@lo:502:llog_process_th.0 Request processed in 1543us (2318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813332.341046:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788813332.341368:0:8576:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbc9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:8576:1875706583747584:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788813332.341407:0:8576:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813332.341415:0:8576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813332.341418:0:8576:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788813332.341424:0:8576:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788813332.342506:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788813332.342543:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788813332.342555:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908774369600/0x6d74dbab2ddb1833 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb183a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813332.342568:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908774369600/0x6d74dbab2ddb1833 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb183a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813332.672240:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583747968:0@lo:400:kworker.0 00000100:00100000:3.0:1788813332.672322:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813332.672377:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813332.672384:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875706583747840:0@lo:400:kworker.0 00000100:00100000:3.0:1788813332.672410:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813332.672446:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583747840 00000100:00100000:3.0:1788813332.672457:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583747840 00000100:00100000:3.0:1788813332.672520:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788813332.672529:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875706583747840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813332.672630:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875706583747840:12345-0@lo:400:kworker.0 Request processed in 102us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813332.672637:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788813332.672680:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875706583747840:0@lo:400:kworker.0 00000100:00100000:1.0:1788813332.672757:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583747712:0@lo:400:kworker.0 00000100:00100000:1.0:1788813332.672788:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813332.672817:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583748224:0@lo:400:kworker.0 00000100:00100000:1.0:1788813332.672838:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813332.672863:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813332.672869:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875706583748096:0@lo:400:kworker.0 00000100:00100000:1.0:1788813332.672890:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813332.672919:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583747968 00000100:00100000:1.0:1788813332.672930:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583747968 00000100:00100000:1.0:1788813332.672957:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583748224 00000100:00100000:1.0:1788813332.672960:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583748224 00000100:00100000:1.0:1788813332.672980:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788813332.672985:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583747968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813332.673023:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583747968:12345-0@lo:400:kworker.0 Request processed in 37us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813332.673029:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788813332.673041:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788813332.673047:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583748224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813332.673077:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583748224:12345-0@lo:400:kworker.0 Request processed in 30us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813332.673083:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788813332.673098:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788813332.673102:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813332.673114:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583747712 00000100:00100000:1.0:1788813332.673117:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583747712 00000100:00100000:1.0:1788813332.673136:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583748096 00000100:00100000:1.0:1788813332.673139:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583748096 00000100:00100000:1.0:1788813332.673157:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788813332.673162:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583747712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813332.673193:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c231f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583747712:12345-0@lo:400:kworker.0 Request processed in 31us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813332.673199:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788813332.673210:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788813332.673216:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875706583748096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813332.673243:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875706583748096:12345-0@lo:400:kworker.0 Request processed in 27us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813332.673256:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788813332.673289:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875706583748096:0@lo:400:kworker.0 00000100:00100000:1.0:1788813332.673298:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583747712:0@lo:400:kworker.0 00010000:00080000:1.0:1788813332.673310:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877fbc9500 x1875706583748224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813332.673320:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583748224:0@lo:400:kworker.0 00000100:00080000:1.0:1788813332.673338:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788813332.673356:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877fbc8700 x1875706583747968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813332.673365:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583747968:0@lo:400:kworker.0 00010000:00010000:1.0:1788813333.180827:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813333.180951:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813333.180974:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583748352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813333.181065:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813333.181280:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583748352 00000100:00100000:3.0:1788813333.181292:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583748352 00000100:00100000:3.0:1788813333.181364:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788813333.181443:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583748352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813333.181482:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813333.181536:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583748352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813333.181543:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788813333.181757:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877fbca300 x1875706583748352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813333.181776:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583748352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813333.895224:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813333.895278:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813333.895324:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813333.895371:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813333.895390:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562746880 00000100:00100000:2.0:1788813333.895410:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562746880 00000100:00100000:1.0:1788813333.895422:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562747136 00000100:00100000:1.0:1788813333.895434:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562747136 00000100:00100000:3.0:1788813333.895519:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562747008 00000100:00100000:3.0:1788813333.895527:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562747008 00000100:00100000:2.0:1788813333.895674:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 33 00000100:00100000:2.0:1788813333.895689:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:2362:x1875706562746880:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813333.895823:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:2362:x1875706562746880:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 137us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813333.895832:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 33 00000100:00100000:0.0:1788813333.895927:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562746752 00000100:00100000:0.0:1788813333.895934:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562746752 00000100:00100000:0.0:1788813333.895986:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 191 00000100:00100000:0.0:1788813333.895996:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908760097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:2362:x1875706562746752:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813333.896060:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908760097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:2362:x1875706562746752:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 65us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813333.896068:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 191 00000100:00100000:0.0:1788813333.900173:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 17 00000100:00100000:0.0:1788813333.900195:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+5:2362:x1875706562747136:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813333.900283:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c231c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+5:2362:x1875706562747136:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 97us (5004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813333.900291:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 17 00000100:00100000:3.0:1788813333.902146:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 18 00000100:00100000:3.0:1788813333.902165:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c232a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+5:2362:x1875706562747008:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:3.0:1788813333.902268:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c232a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+5:2362:x1875706562747008:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 109us (6898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813333.902276:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 18 00000100:00080000:2.0:1788813333.904924:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788813333.904937:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813333.904941:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788813334.204906:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813335.234152:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813336.253724:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813336.258247:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813336.258273:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583748480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813336.258359:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813336.258647:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583748480 00000100:00100000:0.0:1788813336.258656:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583748480 00000100:00100000:0.0:1788813336.258724:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788813336.258742:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583748480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813336.258782:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813336.258841:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583748480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813336.258862:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788813336.258885:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788813336.258934:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877fbca300 x1875706583748480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813336.258952:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583748480:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788813337.278547:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813337.790843:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583748608:0@lo:400:kworker.0 00000100:00100000:2.0:1788813337.790919:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813337.790978:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908643b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875706583749120:0@lo:400:kworker.0 00000100:00100000:2.0:1788813337.791006:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813337.791038:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788813337.791053:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583748736:0@lo:400:kworker.0 00000100:00100000:2.0:1788813337.791079:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813337.791097:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908643b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583749248:0@lo:400:kworker.0 00000100:00100000:2.0:1788813337.791117:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813337.791147:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583748864:0@lo:400:kworker.0 00000100:00100000:2.0:1788813337.791168:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813337.791186:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813337.791191:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583748992:0@lo:400:kworker.0 00000100:00100000:2.0:1788813337.791211:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813337.791243:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583748608 00000100:00100000:2.0:1788813337.791251:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583748608 00000100:00100000:2.0:1788813337.791297:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788813337.791305:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3320:x1875706583748608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813337.791352:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3320:x1875706583748608:12345-0@lo:400:kworker.0 Request processed in 47us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813337.791358:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788813337.791392:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583749120 00000100:00100000:2.0:1788813337.791396:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583749120 00000100:00100000:2.0:1788813337.791431:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583748736 00000100:00100000:2.0:1788813337.791434:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583748736 00000100:00100000:2.0:1788813337.791446:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583748864 00000100:00100000:2.0:1788813337.791448:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583748864 00000100:00100000:2.0:1788813337.791860:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788813337.791868:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875706583749120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813337.791907:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875706583749120:12345-0@lo:400:kworker.0 Request processed in 40us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813337.791912:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788813337.791937:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788813337.791942:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583748736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813337.791972:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583748736:12345-0@lo:400:kworker.0 Request processed in 30us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813337.791977:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788813337.791988:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788813337.792008:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583748864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813337.792042:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583748864:12345-0@lo:400:kworker.0 Request processed in 48us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813337.792047:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788813337.792070:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583749248 00000100:00100000:2.0:1788813337.792074:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583749248 00000100:00100000:2.0:1788813337.792099:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583748992 00000100:00100000:2.0:1788813337.792102:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583748992 00000100:00100000:2.0:1788813337.792117:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788813337.792122:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583749248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813337.792150:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583749248:12345-0@lo:400:kworker.0 Request processed in 28us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813337.792156:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788813337.792167:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788813337.792173:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583748992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813337.792200:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583748992:12345-0@lo:400:kworker.0 Request processed in 28us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813337.792206:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788813337.792232:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813337.792236:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788813337.792270:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3edc00 x1875706583748992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813337.792291:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583748992:0@lo:400:kworker.0 00000100:00100000:2.0:1788813337.792305:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583748864:0@lo:400:kworker.0 00000100:00100000:2.0:1788813337.792417:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583748736:0@lo:400:kworker.0 00010000:00080000:2.0:1788813337.792440:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff908643b4dc00 x1875706583749248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813337.792450:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908643b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583749248:0@lo:400:kworker.0 00000100:00100000:2.0:1788813337.792956:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583748608:0@lo:400:kworker.0 00000100:00100000:2.0:1788813337.792971:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908643b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875706583749120:0@lo:400:kworker.0 00000001:02000400:3.0:1788813338.271984:0:8833:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg447-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1788813338.301392:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813338.307677:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788813338.307702:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583749376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813338.307775:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813338.307912:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583749376 00000100:00100000:3.0:1788813338.307921:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583749376 00000100:00100000:3.0:1788813338.307987:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788813338.307998:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583749376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813338.308050:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813338.308247:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583749376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 249us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813338.308255:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788813338.308303:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3f2680 x1875706583749376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813338.308344:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583749376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813339.015701:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813339.015728:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562747392 00000100:00100000:0.0:1788813339.015737:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813339.015739:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562747392 00000100:00100000:0.0:1788813339.015761:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813339.015782:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813339.015797:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 37 00000100:00100000:0.0:1788813339.015800:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562747264 00000100:00100000:0.0:1788813339.015803:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562747264 00000100:00100000:2.0:1788813339.015807:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+6:2360:x1875706562747392:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813339.015825:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 193 00000100:00100000:0.0:1788813339.015831:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:2360:x1875706562747264:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813339.015878:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+6:2360:x1875706562747392:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 71us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813339.015878:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:2360:x1875706562747264:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 46us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813339.015886:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 37 00000100:00100000:0.0:1788813339.015886:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 193 00000100:00100000:2.0:1788813339.015907:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562747648 00000100:00100000:2.0:1788813339.015911:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562747648 00000100:00100000:2.0:1788813339.015933:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562747520 00000100:00100000:2.0:1788813339.015935:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562747520 00000100:00100000:2.0:1788813339.015954:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 21 00000100:00100000:2.0:1788813339.015960:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+5:2360:x1875706562747648:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813339.015994:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+5:2360:x1875706562747648:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 34us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813339.016001:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 21 00000100:00100000:2.0:1788813339.016012:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 22 00000100:00100000:2.0:1788813339.016032:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+5:2360:x1875706562747520:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813339.016055:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+5:2360:x1875706562747520:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 38us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813339.016061:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 22 00000100:00080000:2.0:1788813339.016080:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788813339.016083:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813339.016086:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788813339.325394:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813340.350254:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813341.372959:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813341.373005:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813341.373321:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583749504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813341.373390:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813341.373505:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583749504 00000100:00100000:3.0:1788813341.373512:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583749504 00000100:00100000:3.0:1788813341.373574:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788813341.373608:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583749504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813341.373645:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813341.373695:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583749504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813341.373703:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788813341.373741:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877fbca300 x1875706583749504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813341.373759:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583749504:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788813341.373959:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788813342.398646:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813342.909369:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c231180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583749888:0@lo:400:kworker.0 00000100:00100000:1.0:1788813342.909443:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813342.909498:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788813342.909503:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c230a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583750016:0@lo:400:kworker.0 00000100:00100000:1.0:1788813342.909526:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813342.909617:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c233480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583749632:0@lo:400:kworker.0 00000100:00100000:2.0:1788813342.909649:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813342.909678:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875706583750144:0@lo:400:kworker.0 00000100:00100000:2.0:1788813342.909697:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813342.909712:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788813342.909716:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583749760:0@lo:400:kworker.0 00000100:00100000:2.0:1788813342.909732:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813342.909744:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fb01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583750272:0@lo:400:kworker.0 00000100:00100000:2.0:1788813342.909759:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813342.909784:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583749888 00000100:00100000:2.0:1788813342.909813:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583749888 00000100:00100000:2.0:1788813342.909857:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583750144 00000100:00100000:2.0:1788813342.909859:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583750144 00000100:00100000:2.0:1788813342.909869:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583749760 00000100:00100000:2.0:1788813342.909871:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583749760 00000100:00100000:2.0:1788813342.909883:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788813342.909890:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583749888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813342.909938:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583749888:12345-0@lo:400:kworker.0 Request processed in 48us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813342.909945:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788813342.909962:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788813342.909967:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875706583750144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813342.909990:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875706583750144:12345-0@lo:400:kworker.0 Request processed in 23us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813342.909995:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788813342.910004:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788813342.910009:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583749760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813342.910031:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583749760:12345-0@lo:400:kworker.0 Request processed in 22us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813342.910036:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788813342.910054:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583750016 00000100:00100000:2.0:1788813342.910057:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583750016 00000100:00100000:2.0:1788813342.910074:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583750272 00000100:00100000:2.0:1788813342.910076:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583750272 00000100:00100000:2.0:1788813342.910104:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788813342.910110:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583750016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813342.910135:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583750016:12345-0@lo:400:kworker.0 Request processed in 26us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813342.910149:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788813342.910159:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788813342.910163:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583750272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813342.910185:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583750272:12345-0@lo:400:kworker.0 Request processed in 22us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813342.910190:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788813342.910211:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813342.910215:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813342.910245:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583749760:0@lo:400:kworker.0 00010000:00080000:2.0:1788813342.910256:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877fb01180 x1875706583750272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813342.910266:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fb01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583750272:0@lo:400:kworker.0 00000100:00100000:2.0:1788813342.910273:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c233800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875706583750144:0@lo:400:kworker.0 00010000:00080000:2.0:1788813342.910297:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c230a80 x1875706583750016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813342.910305:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c230a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583750016:0@lo:400:kworker.0 00000100:00100000:2.0:1788813342.910313:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c231180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583749888:0@lo:400:kworker.0 00000100:00100000:1.0:1788813342.910502:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583749632 00000100:00100000:1.0:1788813342.910513:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583749632 00000100:00100000:1.0:1788813342.910546:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788813342.910552:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3320:x1875706583749632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813342.910610:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3320:x1875706583749632:12345-0@lo:400:kworker.0 Request processed in 58us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813342.910616:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788813342.910706:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c233480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583749632:0@lo:400:kworker.0 00000001:02000400:1.0:1788813343.387657:0:9076:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg447-server.virtnet: executing yml_node 00010000:00010000:3.0:1788813343.423522:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813343.423641:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788813343.423667:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583750400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813343.423740:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813343.423810:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583750400 00000100:00100000:0.0:1788813343.423819:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583750400 00000100:00100000:0.0:1788813343.423870:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788813343.423879:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583750400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788813343.426705:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813343.427795:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583750400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3909us (4047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813343.427816:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788813343.436242:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff908749ac1f80 x1875706583750400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813343.436272:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583750400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813344.137692:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813344.137749:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813344.137773:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813344.137801:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813344.137838:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562748032 00000100:00100000:2.0:1788813344.137851:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562748032 00000100:00100000:2.0:1788813344.137918:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562748160 00000100:00100000:2.0:1788813344.137921:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562748160 00000100:00100000:2.0:1788813344.137946:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 10 00000100:00100000:2.0:1788813344.137957:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+5:2358:x1875706562748032:12345-192.168.204.47@tcp:9:kworker.0 00000020:00000080:2.0:1788813344.138006:0:8270:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb1776 00000100:00080000:2.0:1788813344.138020:0:8270:0:(import.c:65:import_set_state_nolock()) ffff908749dae800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788813344.138067:0:8270:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788813344.138462:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+2:2358:x1875706562748032:12345-192.168.204.47@tcp:9:kworker.0 Request processed in 506us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813344.138469:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 10 00000100:00100000:2.0:1788813344.138487:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 11 00000100:00100000:2.0:1788813344.138495:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+5:2358:x1875706562748160:12345-192.168.204.47@tcp:9:kworker.0 00000020:00000080:2.0:1788813344.138512:0:8270:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb177d 00000100:00080000:2.0:1788813344.138520:0:8270:0:(import.c:65:import_set_state_nolock()) ffff908641116800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788813344.138544:0:8270:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788813344.138815:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+2:2358:x1875706562748160:12345-192.168.204.47@tcp:9:kworker.0 Request processed in 319us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813344.138822:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 11 00000100:00100000:2.0:1788813344.138851:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562747904 00000100:00100000:2.0:1788813344.138857:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562747904 00000100:00100000:2.0:1788813344.138892:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 41 00000100:00100000:2.0:1788813344.138898:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:2361:x1875706562747904:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813344.138938:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:2361:x1875706562747904:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 40us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813344.138946:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 41 00000100:00080000:2.0:1788813344.138964:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788813344.138967:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813344.138969:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788813344.139035:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813344.139041:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813344.139439:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562747776 00000100:00100000:1.0:1788813344.139446:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562747776 00000100:00100000:1.0:1788813344.139490:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 195 00000100:00100000:1.0:1788813344.139498:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:2361:x1875706562747776:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813344.139532:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:2361:x1875706562747776:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 35us (1852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813344.139538:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 195 00010000:00010000:3.0:1788813344.445706:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813345.469366:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813346.494048:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813346.494072:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583750528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813346.494142:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788813346.494276:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813346.494496:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583750528 00000100:00100000:3.0:1788813346.494505:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583750528 00000100:00100000:3.0:1788813346.494701:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788813346.494712:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583750528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813346.494751:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813346.494813:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583750528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813346.494819:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788813346.494952:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877fbca300 x1875706583750528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813346.494971:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583750528:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788813346.495948:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788813347.517033:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788813347.603011:0:7669:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e90f6370-8c16-4659-9369-1cd146993b4c 00000020:00000080:2.0:1788813347.603023:0:7669:0:(genops.c:885:class_export_put()) final put ffff908641110000/e90f6370-8c16-4659-9369-1cd146993b4c 00000020:00000080:0.0:1788813347.603969:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff908641110000/e90f6370-8c16-4659-9369-1cd146993b4c for lustre-OST0001 00000020:00000080:0.0:1788813347.604066:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff908641116800 for lustre-OST0001 00000001:00100000:0.0:1788813347.619952:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e90f6370-8c16-4659-9369-1cd146993b4c 00000020:00000080:0.0:1788813347.619963:0:6729:0:(genops.c:885:class_export_put()) final put ffff908749daa800/e90f6370-8c16-4659-9369-1cd146993b4c 00000020:00000080:2.0:1788813347.620038:0:484:0:(genops.c:844:class_export_destroy()) destroying export ffff908749daa800/e90f6370-8c16-4659-9369-1cd146993b4c for lustre-OST0000 00000020:00000080:2.0:1788813347.620092:0:484:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff908749dae800 for lustre-OST0000 00000100:00100000:2.0:1788813348.029119:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908643b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583750912:0@lo:400:kworker.0 00000100:00100000:2.0:1788813348.029192:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813348.029273:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583750912 00000100:00100000:2.0:1788813348.029282:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583750912 00000100:00100000:2.0:1788813348.029350:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788813348.029360:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583750912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813348.029424:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583750912:12345-0@lo:400:kworker.0 Request processed in 66us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813348.029432:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788813348.029612:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908643b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583750656:0@lo:400:kworker.0 00000100:00100000:0.0:1788813348.029651:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813348.029681:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788813348.029687:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908643b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583750784:0@lo:400:kworker.0 00000100:00100000:0.0:1788813348.029711:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788813348.029735:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813348.029747:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583750656 00000100:00100000:0.0:1788813348.029751:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583750656 00000100:00100000:0.0:1788813348.029779:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788813348.029786:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3320:x1875706583750656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813348.029843:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3320:x1875706583750656:12345-0@lo:400:kworker.0 Request processed in 57us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813348.029849:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788813348.029877:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583750784 00000100:00100000:0.0:1788813348.029881:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583750784 00000100:00100000:0.0:1788813348.029903:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788813348.029909:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583750784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813348.029955:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583750784:12345-0@lo:400:kworker.0 Request processed in 46us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813348.029962:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788813348.029999:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908643b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583750784:0@lo:400:kworker.0 00000100:00100000:0.0:1788813348.030008:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908643b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583750656:0@lo:400:kworker.0 00000100:00100000:2.0:1788813348.039075:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908643b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583750912:0@lo:400:kworker.0 00000100:00100000:2.0:1788813348.039185:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813348.039197:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908643b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583751040:0@lo:400:kworker.0 00000100:00100000:2.0:1788813348.039261:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813348.039313:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583751040 00000100:00100000:2.0:1788813348.039320:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583751040 00000100:00100000:2.0:1788813348.039369:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788813348.039377:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583751040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813348.039423:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583751040:12345-0@lo:400:kworker.0 Request processed in 47us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813348.039430:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788813348.039465:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788813348.039482:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff908643b4ca80 x1875706583751040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813348.039493:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908643b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583751040:0@lo:400:kworker.0 00000100:00100000:2.0:1788813348.039530:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908643b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875706583751168:0@lo:400:kworker.0 00000100:00100000:2.0:1788813348.039554:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813348.039604:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583751168 00000100:00100000:2.0:1788813348.039608:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583751168 00000100:00100000:2.0:1788813348.039637:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788813348.039645:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875706583751168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813348.039677:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875706583751168:12345-0@lo:400:kworker.0 Request processed in 33us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813348.039683:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1788813348.039698:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813348.039712:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908643b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875706583751168:0@lo:400:kworker.0 00000100:00100000:2.0:1788813348.039738:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813348.039751:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908643b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583751296:0@lo:400:kworker.0 00000100:00100000:2.0:1788813348.039774:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813348.039796:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583751296 00000100:00100000:2.0:1788813348.039800:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583751296 00000100:00100000:2.0:1788813348.039839:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788813348.039846:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583751296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813348.039878:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583751296:12345-0@lo:400:kworker.0 Request processed in 32us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813348.039884:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1788813348.039898:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788813348.039912:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff908643b4ca80 x1875706583751296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813348.039922:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908643b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583751296:0@lo:400:kworker.0 00010000:00010000:1.0:1788813348.546244:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813348.546404:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813348.546425:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583751424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813348.546499:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813348.546615:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583751424 00000100:00100000:0.0:1788813348.546625:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583751424 00000100:00100000:0.0:1788813348.546675:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788813348.546685:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583751424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788813348.546737:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813348.546803:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583751424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813348.546810:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788813348.546868:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff908749ac1f80 x1875706583751424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813348.546887:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583751424:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788813348.646517:0:9269:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.40 00000100:00100000:0.0:1788813349.270890:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813349.271614:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562748288 00000100:00100000:2.0:1788813349.271633:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562748288 00000100:00100000:2.0:1788813349.272946:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 197 00000100:00100000:2.0:1788813349.272971:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:2361:x1875706562748288:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813349.273104:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:2361:x1875706562748288:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 142us (2229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813349.273113:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 197 00000100:00100000:1.0:1788813349.279809:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813349.279952:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562748416 00000100:00100000:0.0:1788813349.279964:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562748416 00000100:00100000:0.0:1788813349.280051:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 45 00000100:00100000:0.0:1788813349.280063:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+6:2362:x1875706562748416:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813349.280167:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+6:2362:x1875706562748416:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 106us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813349.280175:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 45 00000100:00080000:1.0:1788813349.280726:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788813349.565202:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813350.589577:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813351.614898:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813351.615009:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788813351.615050:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583751552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813351.615131:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813351.615215:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583751552 00000100:00100000:1.0:1788813351.615241:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583751552 00000100:00080000:0.0:1788813351.615298:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813351.615334:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788813351.615345:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583751552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788813351.615393:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813351.615450:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583751552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813351.615457:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788813351.615649:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877fbcb480 x1875706583751552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813351.615670:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583751552:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788813351.989336:0:9367:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.40 00010000:00010000:0.0:1788813352.642046:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813353.149283:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583751936:0@lo:400:kworker.0 00000100:00100000:0.0:1788813353.149362:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813353.152129:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fb01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583751680:0@lo:400:kworker.0 00000100:00100000:2.0:1788813353.152219:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813353.152332:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583752064:0@lo:400:kworker.0 00000100:00100000:1.0:1788813353.152368:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813353.155104:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fb01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583751808:0@lo:400:kworker.0 00000100:00100000:0.0:1788813353.155410:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813353.155457:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583752320:0@lo:400:kworker.0 00000100:00100000:0.0:1788813353.155489:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813353.156967:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583751936 00000100:00100000:3.0:1788813353.156990:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583751936 00000100:00100000:3.0:1788813353.157060:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583751808 00000100:00100000:3.0:1788813353.157065:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583751808 00000100:00100000:3.0:1788813353.157093:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788813353.157103:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583751936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813353.157179:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583751936:12345-0@lo:400:kworker.0 Request processed in 78us (7816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813353.157188:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788813353.157216:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788813353.157223:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583751808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813353.157234:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583752064 00000100:00100000:0.0:1788813353.157241:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583752064 00000100:00100000:3.0:1788813353.157261:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583751808:12345-0@lo:400:kworker.0 Request processed in 38us (1851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813353.157267:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788813353.157279:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583752320 00000100:00100000:0.0:1788813353.157285:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583752320 00000100:00100000:0.0:1788813353.157375:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788813353.157385:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583752064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813353.157393:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788813353.157414:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583752320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813353.157429:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583752064:12345-0@lo:400:kworker.0 Request processed in 46us (5059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813353.157436:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788813353.157458:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788813353.157462:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788813353.157464:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813353.157499:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583751936:0@lo:400:kworker.0 00000100:00100000:0.0:1788813353.157535:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fb01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583751808:0@lo:400:kworker.0 00010000:00080000:0.0:1788813353.157729:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e5eb480 x1875706583752320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813353.157741:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583752320:0@lo:400:kworker.0 00000100:00100000:3.0:1788813353.157767:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583752320:12345-0@lo:400:kworker.0 Request processed in 354us (2275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813353.157775:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788813353.158693:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583751680 00000100:00100000:0.0:1788813353.158701:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583751680 00000100:00100000:0.0:1788813353.158755:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788813353.158765:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3320:x1875706583751680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813353.158826:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3320:x1875706583751680:12345-0@lo:400:kworker.0 Request processed in 63us (6607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813353.158846:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00010000:00080000:1.0:1788813353.159779:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e5e9c00 x1875706583752064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813353.159795:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583752064:0@lo:400:kworker.0 00000100:00100000:2.0:1788813353.162332:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fb01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583751680:0@lo:400:kworker.0 00000100:00100000:2.0:1788813353.162347:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875706583752192:0@lo:400:kworker.0 00000100:00100000:2.0:1788813353.162425:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813353.162488:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583752192 00000100:00100000:3.0:1788813353.162495:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583752192 00000100:00100000:3.0:1788813353.162559:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788813353.162567:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875706583752192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813353.162641:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875706583752192:12345-0@lo:400:kworker.0 Request processed in 75us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813353.162655:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788813353.163466:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875706583752192:0@lo:400:kworker.0 00000100:00080000:1.0:1788813353.165282:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788813353.661020:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813353.661796:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e4a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583752448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813353.662074:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813353.662619:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583752448 00000100:00100000:0.0:1788813353.662627:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583752448 00000100:00100000:0.0:1788813353.662679:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788813353.662689:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583752448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788813353.662726:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813353.664478:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583752448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1782us (2396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813353.664490:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788813353.664627:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e4a1880 x1875706583752448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813353.664647:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e4a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583752448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813354.373674:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813354.373726:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813354.373871:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562748672 00000100:00100000:1.0:1788813354.373881:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562748672 00000100:00100000:1.0:1788813354.373961:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 49 00000100:00100000:1.0:1788813354.373971:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+6:2359:x1875706562748672:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813354.374046:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+6:2359:x1875706562748672:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 77us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813354.374054:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 49 00000100:00100000:2.0:1788813354.374361:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562748544 00000100:00100000:2.0:1788813354.374367:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562748544 00000100:00100000:2.0:1788813354.374404:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 199 00000100:00100000:2.0:1788813354.374411:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:2359:x1875706562748544:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813354.374452:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:2359:x1875706562748544:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 42us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813354.374459:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 199 00000100:00080000:0.0:1788813354.374761:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1788813354.541973:0:9464:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.40 00010000:00010000:3.0:1788813354.686815:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813355.709520:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813356.733354:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813356.733575:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813356.733631:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583752576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813356.733730:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813356.736635:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583752576 00000100:00100000:0.0:1788813356.736664:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583752576 00000100:00100000:0.0:1788813356.736786:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788813356.736802:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583752576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813356.736888:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813356.737029:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c233480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583752576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 230us (3298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813356.737039:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1788813356.737177:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877fbcad80 x1875706583752576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813356.737208:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583752576:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788813356.737359:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1788813356.978449:0:9512:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Sep 7 16:35:55 EDT 2026 00010000:00010000:3.0:1788813357.756902:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813358.273084:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e4a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583752832:0@lo:400:kworker.0 00000100:00100000:0.0:1788813358.273653:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813358.273717:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773ad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583753344:0@lo:400:kworker.0 00000100:00100000:0.0:1788813358.273744:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813358.274155:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583752704:0@lo:400:kworker.0 00000100:00100000:2.0:1788813358.274192:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813358.274219:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773adb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875706583753216:0@lo:400:kworker.0 00000100:00100000:2.0:1788813358.274245:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813358.274296:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583752704 00000100:00100000:2.0:1788813358.274304:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583752704 00000100:00100000:2.0:1788813358.274355:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788813358.274364:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3320:x1875706583752704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813358.274416:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3320:x1875706583752704:12345-0@lo:400:kworker.0 Request processed in 53us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813358.274423:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788813358.274454:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583752832 00000100:00100000:2.0:1788813358.274458:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583752832 00000100:00100000:2.0:1788813358.274480:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583753216 00000100:00100000:2.0:1788813358.274483:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583753216 00000100:00100000:2.0:1788813358.274511:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788813358.274517:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583752832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813358.274550:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583752832:12345-0@lo:400:kworker.0 Request processed in 34us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813358.274556:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788813358.274567:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788813358.274572:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875706583753216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813358.274632:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875706583753216:12345-0@lo:400:kworker.0 Request processed in 59us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813358.274637:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788813358.274885:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e4a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583752832:0@lo:400:kworker.0 00000100:00100000:0.0:1788813358.274910:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fb01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583752960:0@lo:400:kworker.0 00000100:00100000:0.0:1788813358.274935:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813358.274954:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813358.274961:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fb01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583753088:0@lo:400:kworker.0 00000100:00100000:0.0:1788813358.274983:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813358.275010:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583752960 00000100:00100000:0.0:1788813358.275013:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583752960 00000100:00100000:0.0:1788813358.275036:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788813358.275043:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583752960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813358.275076:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583752960:12345-0@lo:400:kworker.0 Request processed in 33us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813358.275082:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788813358.275113:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583753344 00000100:00100000:0.0:1788813358.275117:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583753344 00000100:00100000:0.0:1788813358.275140:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583753088 00000100:00100000:0.0:1788813358.275142:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583753088 00000100:00100000:0.0:1788813358.275165:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788813358.275181:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583753344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813358.275216:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583753344:12345-0@lo:400:kworker.0 Request processed in 37us (1471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813358.275222:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788813358.275236:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788813358.275241:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773adb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583753088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813358.275269:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773adb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583753088:12345-0@lo:400:kworker.0 Request processed in 28us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813358.275274:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1788813358.275313:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877fb01180 x1875706583753088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813358.275324:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fb01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583753088:0@lo:400:kworker.0 00000100:00100000:0.0:1788813358.275334:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fb01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583752960:0@lo:400:kworker.0 00010000:00080000:0.0:1788813358.275365:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff908773ad9500 x1875706583753344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813358.275373:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773ad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583753344:0@lo:400:kworker.0 00000100:00100000:2.0:1788813358.277144:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e4a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583752704:0@lo:400:kworker.0 00000100:00100000:2.0:1788813358.277163:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773adb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875706583753216:0@lo:400:kworker.0 00000100:00080000:2.0:1788813358.277200:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788813358.277205:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813358.277208:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813358.780830:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813358.780854:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583753472:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788813358.780973:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813358.781310:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813358.781472:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583753472 00000100:00100000:2.0:1788813358.781491:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583753472 00000100:00100000:2.0:1788813358.781549:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788813358.781559:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583753472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813358.781613:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813358.781670:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583753472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813358.781677:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788813358.781687:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e5e9c00 x1875706583753472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813358.781706:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583753472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813359.492902:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813359.492978:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562748800 00000100:00100000:3.0:1788813359.492990:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562748800 00000100:00100000:3.0:1788813359.494337:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 201 00000100:00100000:3.0:1788813359.494354:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:2361:x1875706562748800:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:3.0:1788813359.494441:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:2361:x1875706562748800:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 92us (1549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813359.494449:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 201 00000100:00100000:3.0:1788813359.513052:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813359.513273:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562748928 00000100:00100000:0.0:1788813359.513284:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562748928 00000100:00100000:0.0:1788813359.513374:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 53 00000100:00100000:0.0:1788813359.513385:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:2361:x1875706562748928:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813359.513467:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:2361:x1875706562748928:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 85us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813359.513474:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 53 00000100:00080000:1.0:1788813359.513674:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788813359.805431:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813360.828757:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813361.857457:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813361.857509:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813361.857535:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c230a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583753600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813361.857629:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813361.858345:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583753600 00000100:00100000:2.0:1788813361.858355:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583753600 00000100:00100000:2.0:1788813361.858428:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788813361.858438:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583753600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813361.858477:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813361.858569:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583753600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813361.858576:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788813361.858776:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c230a80 x1875706583753600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813361.858798:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c230a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583753600:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788813361.858871:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788813362.880981:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813363.390245:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583754112:0@lo:400:kworker.0 00000100:00100000:3.0:1788813363.390313:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813363.390380:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813363.390386:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875706583753984:0@lo:400:kworker.0 00000100:00100000:3.0:1788813363.390414:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813363.390447:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583754112 00000100:00100000:3.0:1788813363.390456:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583754112 00000100:00100000:3.0:1788813363.390538:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788813363.390549:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583754112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813363.390625:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583754112:12345-0@lo:400:kworker.0 Request processed in 78us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813363.390632:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788813363.390655:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788813363.390685:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877fbca680 x1875706583754112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813363.390697:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583754112:0@lo:400:kworker.0 00000100:00100000:0.0:1788813363.390881:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583753856:0@lo:400:kworker.0 00000100:00100000:0.0:1788813363.390914:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813363.390943:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583754368:0@lo:400:kworker.0 00000100:00100000:0.0:1788813363.390963:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813363.390987:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788813363.390992:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583753728:0@lo:400:kworker.0 00000100:00100000:0.0:1788813363.391031:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813363.391050:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875706583754240:0@lo:400:kworker.0 00000100:00100000:0.0:1788813363.391069:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813363.391094:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583754368 00000100:00100000:0.0:1788813363.391098:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583754368 00000100:00100000:0.0:1788813363.391129:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788813363.391135:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583754368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813363.391170:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583754368:12345-0@lo:400:kworker.0 Request processed in 35us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813363.391176:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788813363.391196:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583753984 00000100:00100000:0.0:1788813363.391200:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583753984 00000100:00100000:0.0:1788813363.391220:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583753856 00000100:00100000:0.0:1788813363.391222:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583753856 00000100:00100000:0.0:1788813363.391233:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583754240 00000100:00100000:0.0:1788813363.391235:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583754240 00000100:00100000:0.0:1788813363.391248:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788813363.391254:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875706583753984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813363.391287:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875706583753984:12345-0@lo:400:kworker.0 Request processed in 33us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813363.391293:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788813363.391314:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788813363.391320:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583753856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813363.391348:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583753856:12345-0@lo:400:kworker.0 Request processed in 28us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813363.391354:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788813363.391365:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788813363.391371:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875706583754240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813363.391396:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875706583754240:12345-0@lo:400:kworker.0 Request processed in 26us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813363.391402:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788813363.391432:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875706583754240:0@lo:400:kworker.0 00000100:00100000:0.0:1788813363.391441:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583753856:0@lo:400:kworker.0 00010000:00080000:0.0:1788813363.391451:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877fbca300 x1875706583754368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813363.391460:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583754368:0@lo:400:kworker.0 00000100:00100000:2.0:1788813363.391572:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583753728 00000100:00100000:2.0:1788813363.391595:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583753728 00000100:00100000:2.0:1788813363.391625:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788813363.391631:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3321:x1875706583753728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813363.391669:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3321:x1875706583753728:12345-0@lo:400:kworker.0 Request processed in 39us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813363.391675:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788813363.391716:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583753728:0@lo:400:kworker.0 00000100:00080000:3.0:1788813363.393176:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788813363.393185:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813363.393230:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875706583753984:0@lo:400:kworker.0 00010000:00010000:3.0:1788813363.901082:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813363.902340:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583754496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813363.902407:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813363.902523:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583754496 00000100:00100000:1.0:1788813363.902532:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583754496 00000100:00100000:1.0:1788813363.902611:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788813363.902621:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583754496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788813363.902659:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813363.902709:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583754496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813363.902715:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788813363.903071:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e5e9c00 x1875706583754496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813363.903091:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583754496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813364.618901:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813364.618953:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813364.619104:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562749056 00000100:00100000:3.0:1788813364.619113:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562749056 00000100:00100000:3.0:1788813364.619164:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 203 00000100:00100000:3.0:1788813364.619173:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:2359:x1875706562749056:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:3.0:1788813364.619253:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:2359:x1875706562749056:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 80us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813364.619260:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 203 00000100:00100000:0.0:1788813364.619777:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562749184 00000100:00100000:0.0:1788813364.619783:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562749184 00000100:00080000:3.0:1788813364.619976:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813364.620205:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 57 00000100:00100000:0.0:1788813364.620214:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c233800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:2359:x1875706562749184:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813364.620285:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c233800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:2359:x1875706562749184:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 71us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813364.620292:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 57 00010000:00010000:1.0:1788813364.924767:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813365.948709:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813366.976657:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813366.976702:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583754624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813366.976800:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813366.976959:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583754624 00000100:00100000:2.0:1788813366.976970:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583754624 00000100:00100000:2.0:1788813366.977055:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788813366.977067:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583754624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813366.977117:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813366.977171:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583754624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813366.977179:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788813366.977399:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788813366.977434:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c231500 x1875706583754624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813366.977461:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c231500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583754624:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788813366.977808:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813367.997705:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813368.515492:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583754752:0@lo:400:kworker.0 00000100:00100000:1.0:1788813368.515598:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813368.515791:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583755136:0@lo:400:kworker.0 00000100:00100000:3.0:1788813368.515830:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813368.516063:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583754752 00000100:00100000:0.0:1788813368.516073:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583754752 00000100:00100000:0.0:1788813368.516134:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788813368.516145:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3320:x1875706583754752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813368.516212:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3320:x1875706583754752:12345-0@lo:400:kworker.0 Request processed in 68us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813368.516219:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788813368.516685:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583755008:0@lo:400:kworker.0 00000100:00100000:0.0:1788813368.516718:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813368.516927:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583754752:0@lo:400:kworker.0 00000100:00100000:1.0:1788813368.516936:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875706583755264:0@lo:400:kworker.0 00000100:00100000:1.0:1788813368.516963:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813368.517007:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788813368.517014:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583754880:0@lo:400:kworker.0 00000100:00100000:1.0:1788813368.517035:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813368.517060:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583755392:0@lo:400:kworker.0 00000100:00100000:1.0:1788813368.517083:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813368.519629:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583755008 00000100:00100000:2.0:1788813368.519644:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583755008 00000100:00100000:2.0:1788813368.519709:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583755264 00000100:00100000:2.0:1788813368.519713:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583755264 00000100:00100000:2.0:1788813368.519729:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583754880 00000100:00100000:2.0:1788813368.519733:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583754880 00000100:00100000:2.0:1788813368.519750:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788813368.519760:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583755008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813368.519879:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583755008:12345-0@lo:400:kworker.0 Request processed in 119us (3158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813368.519886:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788813368.519924:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788813368.519930:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875706583755264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813368.519976:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875706583755264:12345-0@lo:400:kworker.0 Request processed in 47us (3013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813368.519982:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788813368.519997:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788813368.520002:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583754880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813368.520030:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583754880:12345-0@lo:400:kworker.0 Request processed in 29us (2994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813368.520035:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1788813368.520092:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813368.520139:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583754880:0@lo:400:kworker.0 00000100:00100000:2.0:1788813368.520151:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875706583755264:0@lo:400:kworker.0 00000100:00100000:2.0:1788813368.522789:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583755136 00000100:00100000:2.0:1788813368.522811:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583755136 00000100:00100000:2.0:1788813368.522882:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583755392 00000100:00100000:2.0:1788813368.522885:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583755392 00000100:00100000:2.0:1788813368.522923:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788813368.522933:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583755136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813368.523027:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583755136:12345-0@lo:400:kworker.0 Request processed in 95us (7195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813368.523035:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788813368.523063:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788813368.523070:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583755392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813368.523109:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583755392:12345-0@lo:400:kworker.0 Request processed in 39us (6025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813368.523126:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1788813368.523145:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813368.523158:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788813368.523192:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e5e9880 x1875706583755392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813368.523206:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583755392:0@lo:400:kworker.0 00010000:00080000:3.0:1788813368.527173:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e5ea300 x1875706583755136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813368.527196:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583755136:0@lo:400:kworker.0 00000100:00100000:0.0:1788813368.527715:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583755008:0@lo:400:kworker.0 00010000:00010000:0.0:1788813369.021028:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813369.021231:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813369.021254:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583755520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813369.021328:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813369.021513:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583755520 00000100:00100000:1.0:1788813369.021522:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583755520 00000100:00100000:1.0:1788813369.021602:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788813369.021614:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583755520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788813369.021654:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813369.021705:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c231500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583755520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813369.021728:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788813369.021869:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e5e8a80 x1875706583755520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813369.021890:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583755520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813369.733776:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813369.733841:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813369.734043:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562749440 00000100:00100000:3.0:1788813369.734057:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562749440 00000100:00100000:3.0:1788813369.734147:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 61 00000100:00100000:3.0:1788813369.734160:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+6:2362:x1875706562749440:12345-192.168.204.47@tcp:400:kworker.0 00000100:00080000:2.0:1788813369.734268:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813369.734529:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562749312 00000100:00100000:0.0:1788813369.734535:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562749312 00000100:00100000:0.0:1788813369.734568:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 205 00000100:00100000:3.0:1788813369.734603:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+6:2362:x1875706562749440:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 420us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813369.734607:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:2362:x1875706562749312:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:3.0:1788813369.734618:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 61 00000100:00100000:0.0:1788813369.734649:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:2362:x1875706562749312:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 72us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813369.734672:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 205 00010000:00010000:3.0:1788813370.044774:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813371.068728:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813372.092871:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813372.092900:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813372.092932:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773ad8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583755648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813372.093459:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813372.093817:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583755648 00000100:00100000:1.0:1788813372.093830:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583755648 00000100:00100000:1.0:1788813372.093946:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788813372.093975:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583755648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788813372.094039:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788813372.094947:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813372.096341:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583755648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2372us (2871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813372.096356:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1788813372.096723:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff908773ad8380 x1875706583755648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813372.096757:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773ad8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583755648:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788813372.750789:0:10144:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 16:36:11 (1788813371) === 00010000:00010000:3.0:1788813373.118200:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813373.207545:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813373.208303:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562749568 00000100:00100000:2.0:1788813373.208315:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562749568 00000100:00100000:2.0:1788813373.208452:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 206 00000100:00100000:2.0:1788813373.208465:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:8127:x1875706562749568:12345-192.168.204.47@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788813373.208485:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813373.208504:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908774369000/0x6d74dbab2ddb1841 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x31ee63787e483d0c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813373.208537:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908774369000/0x6d74dbab2ddb1841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d0c expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813373.208548:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908774369000/0x6d74dbab2ddb1841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d0c expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813373.208558:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369000, rc 0) 00000100:00100000:2.0:1788813373.208693:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+11:8127:x1875706562749568:12345-192.168.204.47@tcp:101:mount.lustre.0 Request processed in 230us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813373.208700:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 206 00000100:00100000:2.0:1788813373.220776:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813373.220959:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562749696 00000100:00100000:0.0:1788813373.220971:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562749696 00000100:00100000:0.0:1788813373.221115:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 207 00000100:00100000:0.0:1788813373.221126:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+11:8127:x1875706562749696:12345-192.168.204.47@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788813373.222998:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+11:8127:x1875706562749696:12345-192.168.204.47@tcp:501:mount.lustre.0 Request processed in 1859us (2228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813373.223024:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 207 00000100:00100000:1.0:1788813373.243303:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813373.244369:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562749824 00000100:00100000:2.0:1788813373.244388:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562749824 00000100:00100000:2.0:1788813373.244493:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 208 00000100:00100000:2.0:1788813373.244506:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+11:8127:x1875706562749824:12345-192.168.204.47@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788813373.245191:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+11:8127:x1875706562749824:12345-192.168.204.47@tcp:503:mount.lustre.0 Request processed in 684us (1906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813373.245200:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 208 00000100:00100000:1.0:1788813373.261142:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813373.262635:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562749952 00000100:00100000:0.0:1788813373.262651:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562749952 00000100:00100000:0.0:1788813373.262734:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 209 00000100:00100000:0.0:1788813373.262746:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+11:8131:x1875706562749952:12345-192.168.204.47@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788813373.263350:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+11:8131:x1875706562749952:12345-192.168.204.47@tcp:502:llog_process_th.0 Request processed in 603us (2220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813373.263360:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 209 00000100:00100000:3.0:1788813373.294617:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813373.294893:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562750080 00000100:00100000:1.0:1788813373.294903:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562750080 00000100:00100000:1.0:1788813373.294964:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 210 00000100:00100000:1.0:1788813373.294975:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+11:8131:x1875706562750080:12345-192.168.204.47@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788813373.295289:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+11:8131:x1875706562750080:12345-192.168.204.47@tcp:502:llog_process_th.0 Request processed in 314us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813373.295297:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 210 00000100:00100000:1.0:1788813373.307166:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813373.307573:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562750208 00000100:00100000:2.0:1788813373.307685:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562750208 00000100:00100000:2.0:1788813373.307752:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 211 00000100:00100000:2.0:1788813373.307950:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+11:8127:x1875706562750208:12345-192.168.204.47@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788813373.307971:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813373.307991:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908774368600/0x6d74dbab2ddb1848 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x31ee63787e483d36 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813373.308244:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908774368600/0x6d74dbab2ddb1848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d36 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813373.308259:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908774368600/0x6d74dbab2ddb1848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d36 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813373.308269:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368600, rc 0) 00000100:00100000:2.0:1788813373.308402:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+12:8127:x1875706562750208:12345-192.168.204.47@tcp:101:mount.lustre.0 Request processed in 457us (1393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813373.308435:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 211 00000100:00100000:0.0:1788813373.322882:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813373.322993:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562750336 00000100:00100000:1.0:1788813373.323017:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562750336 00000100:00100000:1.0:1788813373.323079:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 212 00000100:00100000:1.0:1788813373.323108:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+12:8127:x1875706562750336:12345-192.168.204.47@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788813373.323138:0:5844:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788813373.323159:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788813373.323164:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788813373.323167:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788813373.323169:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788813373.326737:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+12:8127:x1875706562750336:12345-192.168.204.47@tcp:256:mount.lustre.0 Request processed in 3617us (3848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813373.326752:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 212 00000100:00100000:2.0:1788813373.337734:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813373.340825:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562750464 00000100:00100000:3.0:1788813373.340843:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562750464 00000100:00100000:3.0:1788813373.340905:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 213 00000100:00100000:3.0:1788813373.340915:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+12:8127:x1875706562750464:12345-192.168.204.47@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788813373.340936:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813373.340957:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908750ad1000/0x6d74dbab2ddb184f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x31ee63787e483d3d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813373.341015:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908750ad1000/0x6d74dbab2ddb184f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d3d expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813373.341027:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908750ad1000/0x6d74dbab2ddb184f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d3d expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813373.341036:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad1000, rc 0) 00000100:00100000:3.0:1788813373.341116:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:8127:x1875706562750464:12345-192.168.204.47@tcp:101:mount.lustre.0 Request processed in 202us (3397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813373.341127:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 213 00000100:00100000:0.0:1788813373.348521:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813373.348642:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562750592 00000100:00100000:1.0:1788813373.348654:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562750592 00000100:00100000:1.0:1788813373.348715:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 214 00000100:00100000:1.0:1788813373.348726:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:8127:x1875706562750592:12345-192.168.204.47@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788813373.349082:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:8127:x1875706562750592:12345-192.168.204.47@tcp:501:mount.lustre.0 Request processed in 355us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813373.349092:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 214 00000100:00100000:2.0:1788813373.351636:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813373.354404:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562750720 00000100:00100000:0.0:1788813373.354424:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562750720 00000100:00100000:0.0:1788813373.354602:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 215 00000100:00100000:0.0:1788813373.354614:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:8127:x1875706562750720:12345-192.168.204.47@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788813373.354882:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:8127:x1875706562750720:12345-192.168.204.47@tcp:503:mount.lustre.0 Request processed in 268us (3258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813373.354891:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 215 00000100:00100000:2.0:1788813373.364636:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813373.364751:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562750848 00000100:00100000:3.0:1788813373.364762:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562750848 00000100:00100000:3.0:1788813373.364832:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 216 00000100:00100000:3.0:1788813373.364844:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:8135:x1875706562750848:12345-192.168.204.47@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788813373.365104:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:8135:x1875706562750848:12345-192.168.204.47@tcp:502:llog_process_th.0 Request processed in 261us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813373.365112:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 216 00000100:00100000:2.0:1788813373.373821:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813373.373927:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562750976 00000100:00100000:0.0:1788813373.373938:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562750976 00000100:00100000:0.0:1788813373.374003:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 217 00000100:00100000:0.0:1788813373.374016:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:8135:x1875706562750976:12345-192.168.204.47@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788813373.374327:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:8135:x1875706562750976:12345-192.168.204.47@tcp:502:llog_process_th.0 Request processed in 313us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813373.374667:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 217 00000100:00100000:2.0:1788813373.386758:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813373.386829:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813373.387065:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562751488 00000100:00100000:3.0:1788813373.387076:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562751488 00000100:00100000:3.0:1788813373.387163:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562751104 00000100:00100000:3.0:1788813373.387166:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562751104 00000100:00100000:3.0:1788813373.387208:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 62 00000100:00100000:3.0:1788813373.387218:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+6:2359:x1875706562751488:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:3.0:1788813373.387308:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+6:2359:x1875706562751488:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 81us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813373.387348:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 62 00000100:00100000:3.0:1788813373.387370:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 10 00000100:00100000:3.0:1788813373.387375:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2358:x1875706562751104:12345-192.168.204.47@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788813373.387406:0:8269:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 1aa21be5-2246-40d3-8e20-d34501daf545@192.168.204.47@tcp t0 exp 0000000000000000 cur 315 last 0 00000020:00000080:3.0:1788813373.387449:0:8269:0:(genops.c:1384:class_connect()) connect: client 1aa21be5-2246-40d3-8e20-d34501daf545, cookie 0x6d74dbab2ddb1856 00000004:00100000:3.0:1788813373.387486:0:8269:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788813373.387805:0:8269:0:(import.c:65:import_set_state_nolock()) ffff9087742f3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788813373.387857:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aa21be5-2246-40d3-8e20-d34501daf545+6:2358:x1875706562751104:12345-192.168.204.47@tcp:38:mount.lustre.0 Request processed in 480us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813373.387865:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 10 00000100:00080000:2.0:1788813373.388190:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813373.395244:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813373.395321:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813373.398262:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562751232 00000100:00100000:0.0:1788813373.398289:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562751232 00000100:00100000:0.0:1788813373.398598:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562751360 00000100:00100000:0.0:1788813373.398602:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562751360 00000100:00100000:0.0:1788813373.398640:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 11 00000100:00100000:0.0:1788813373.398651:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa21be5-2246-40d3-8e20-d34501daf545+7:0:x1875706562751232:12345-192.168.204.47@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788813373.398708:0:5850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788813373.398874:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa21be5-2246-40d3-8e20-d34501daf545+7:0:x1875706562751232:12345-192.168.204.47@tcp:41:mount.lustre.0 Request processed in 223us (3640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813373.398883:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 11 00000100:00100000:0.0:1788813373.398902:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 12 00000100:00100000:0.0:1788813373.398909:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa21be5-2246-40d3-8e20-d34501daf545+6:8127:x1875706562751360:12345-192.168.204.47@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788813373.398921:0:5850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788813373.398958:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa21be5-2246-40d3-8e20-d34501daf545+6:8127:x1875706562751360:12345-192.168.204.47@tcp:41:mount.lustre.0 Request processed in 49us (3637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813373.398964:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 12 00000100:00080000:2.0:1788813373.399117:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813373.408774:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813373.408958:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562751616 00000100:00100000:0.0:1788813373.408973:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562751616 00000100:00100000:0.0:1788813373.409042:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 13 00000100:00100000:0.0:1788813373.409053:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa21be5-2246-40d3-8e20-d34501daf545+6:8127:x1875706562751616:12345-192.168.204.47@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788813373.409228:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa21be5-2246-40d3-8e20-d34501daf545+6:8127:x1875706562751616:12345-192.168.204.47@tcp:40:mount.lustre.0 Request processed in 176us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813373.409235:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 13 00000100:00100000:2.0:1788813373.412213:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813373.412318:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562751744 00000100:00100000:3.0:1788813373.412330:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562751744 00000100:00100000:3.0:1788813373.412390:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 12 00000100:00100000:3.0:1788813373.412400:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e451880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1875706562751744:12345-192.168.204.47@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788813373.412440:0:6705:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 1aa21be5-2246-40d3-8e20-d34501daf545@192.168.204.47@tcp t0 exp 0000000000000000 cur 315 last 0 00000020:00000080:3.0:1788813373.412477:0:6705:0:(genops.c:1384:class_connect()) connect: client 1aa21be5-2246-40d3-8e20-d34501daf545, cookie 0x6d74dbab2ddb185d 00002000:00100000:3.0:1788813373.412490:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1aa21be5-2246-40d3-8e20-d34501daf545/ffff9087742f2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788813373.412505:0:6705:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788813373.412797:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788813373.412847:0:6705:0:(import.c:65:import_set_state_nolock()) ffff9087742f4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788813373.412922:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e451880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1aa21be5-2246-40d3-8e20-d34501daf545+6:2358:x1875706562751744:12345-192.168.204.47@tcp:8:mount.lustre.0 Request processed in 520us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813373.412930:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 12 00000100:00100000:1.0:1788813373.416371:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813373.416523:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562752000 00000100:00100000:2.0:1788813373.416538:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562752000 00000100:00100000:2.0:1788813373.416644:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 1 00000100:00100000:2.0:1788813373.416657:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aa21be5-2246-40d3-8e20-d34501daf545+6:8127:x1875706562752000:12345-192.168.204.47@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788813373.416744:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788813373.416857:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1aa21be5-2246-40d3-8e20-d34501daf545+6:8127:x1875706562752000:12345-192.168.204.47@tcp:33:mount.lustre.0 Request processed in 203us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813373.416865:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 1 00000100:00100000:2.0:1788813373.422719:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813373.422845:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562751872 00000100:00100000:0.0:1788813373.422857:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562751872 00000100:00100000:0.0:1788813373.422916:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 13 00000100:00100000:0.0:1788813373.422924:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e453b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2358:x1875706562751872:12345-192.168.204.47@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788813373.422971:0:8270:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 1aa21be5-2246-40d3-8e20-d34501daf545@192.168.204.47@tcp t0 exp 0000000000000000 cur 315 last 0 00000020:00000080:0.0:1788813373.423009:0:8270:0:(genops.c:1384:class_connect()) connect: client 1aa21be5-2246-40d3-8e20-d34501daf545, cookie 0x6d74dbab2ddb1864 00002000:00100000:0.0:1788813373.423024:0:8270:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1aa21be5-2246-40d3-8e20-d34501daf545/ffff908749dae000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788813373.423052:0:8270:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788813373.423311:0:8270:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788813373.423361:0:8270:0:(import.c:65:import_set_state_nolock()) ffff908749daa000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788813373.423450:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e453b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aa21be5-2246-40d3-8e20-d34501daf545+6:2358:x1875706562751872:12345-192.168.204.47@tcp:8:mount.lustre.0 Request processed in 525us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813373.423458:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 13 00000100:00100000:2.0:1788813373.631645:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583755904:0@lo:400:kworker.0 00000100:00100000:2.0:1788813373.631716:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813373.631771:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583756416:0@lo:400:kworker.0 00000100:00100000:2.0:1788813373.631797:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813373.631856:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788813373.631862:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583755776:0@lo:400:kworker.0 00000100:00100000:2.0:1788813373.631892:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813373.631913:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875706583756288:0@lo:400:kworker.0 00000100:00100000:2.0:1788813373.631933:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813373.631959:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583756032:0@lo:400:kworker.0 00000100:00100000:2.0:1788813373.631981:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813373.631999:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813373.632005:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e450e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583756160:0@lo:400:kworker.0 00000100:00100000:2.0:1788813373.632025:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813373.632054:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583756416 00000100:00100000:2.0:1788813373.632063:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583756416 00000100:00100000:2.0:1788813373.632131:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583756160 00000100:00100000:2.0:1788813373.632135:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583756160 00000100:00100000:2.0:1788813373.632156:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788813373.632165:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e452a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583756416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813373.632345:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e452a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583756416:12345-0@lo:400:kworker.0 Request processed in 53us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813373.632355:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788813373.632376:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788813373.632383:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e451180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583756160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813373.632420:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e451180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583756160:12345-0@lo:400:kworker.0 Request processed in 37us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813373.632426:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788813373.632447:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583755904 00000100:00100000:2.0:1788813373.632450:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583755904 00000100:00100000:2.0:1788813373.632472:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583756288 00000100:00100000:2.0:1788813373.632481:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583756288 00000100:00100000:2.0:1788813373.632499:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583756032 00000100:00100000:2.0:1788813373.632502:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583756032 00000100:00100000:2.0:1788813373.632516:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788813373.632522:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583755904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813373.632552:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583755904:12345-0@lo:400:kworker.0 Request processed in 31us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813373.632559:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788813373.632570:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788813373.632576:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875706583756288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813373.632633:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875706583756288:12345-0@lo:400:kworker.0 Request processed in 57us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813373.632639:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788813373.632650:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788813373.632655:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583756032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813373.632679:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583756032:12345-0@lo:400:kworker.0 Request processed in 25us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813373.632685:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1788813373.632700:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788813373.632705:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788813373.632733:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e450e00 x1875706583756160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813373.632748:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e450e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583756160:0@lo:400:kworker.0 00000100:00100000:2.0:1788813373.632759:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583756032:0@lo:400:kworker.0 00000100:00100000:2.0:1788813373.632787:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e452d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875706583756288:0@lo:400:kworker.0 00000100:00100000:2.0:1788813373.632821:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583755904:0@lo:400:kworker.0 00010000:00080000:2.0:1788813373.632832:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e450000 x1875706583756416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813373.632841:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583756416:0@lo:400:kworker.0 00000100:00100000:2.0:1788813373.632871:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583755776 00000100:00100000:2.0:1788813373.632875:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583755776 00000100:00100000:2.0:1788813373.632900:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788813373.632907:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3321:x1875706583755776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813373.632941:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3321:x1875706583755776:12345-0@lo:400:kworker.0 Request processed in 35us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813373.632946:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788813373.632978:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583755776:0@lo:400:kworker.0 00000001:00100000:2.0:1788813373.701968:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1aa21be5-2246-40d3-8e20-d34501daf545 00000100:00100000:2.0:1788813374.143007:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583756544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813374.143080:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813374.143159:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583756544 00000100:00100000:2.0:1788813374.143166:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583756544 00000100:00100000:2.0:1788813374.143219:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788813374.143230:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583756544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813374.143254:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813374.143303:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583756544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813374.143310:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788813374.143411:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e450380 x1875706583756544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813374.143438:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583756544:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788813374.148743:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813375.166538:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813376.189692:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813377.212850:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813377.213109:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813377.213129:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773ad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583756672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813377.213198:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813377.213400:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583756672 00000100:00100000:0.0:1788813377.213408:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583756672 00000100:00100000:0.0:1788813377.213484:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788813377.213494:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583756672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813377.213540:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813377.213615:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583756672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813377.213621:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788813377.213793:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff908773ad9f80 x1875706583756672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788813377.213856:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813377.214719:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773ad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583756672:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788813378.238317:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788813378.339003:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1aa21be5-2246-40d3-8e20-d34501daf545 00000001:00100000:0.0:1788813378.365222:0:7669:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1aa21be5-2246-40d3-8e20-d34501daf545 00000100:00100000:3.0:1788813378.465142:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813378.465192:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813378.465334:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562752128 00000100:00100000:0.0:1788813378.465355:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562752128 00000100:00100000:3.0:1788813378.465424:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813378.465467:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813378.465475:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 219 00000100:00100000:1.0:1788813378.468920:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2361:x1875706562752128:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813378.469027:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2361:x1875706562752128:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 3539us (3902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813378.469038:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 219 00000100:00100000:2.0:1788813378.472268:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562752384 00000100:00100000:2.0:1788813378.472283:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562752384 00000100:00100000:2.0:1788813378.474301:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562752256 00000100:00100000:2.0:1788813378.474314:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562752256 00000100:00100000:0.0:1788813378.474461:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 66 00000100:00100000:0.0:1788813378.474489:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa21be5-2246-40d3-8e20-d34501daf545+5:2361:x1875706562752384:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813378.474642:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa21be5-2246-40d3-8e20-d34501daf545+5:2361:x1875706562752384:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 166us (9447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813378.474651:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 66 00000100:00080000:1.0:1788813378.475725:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813378.475912:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 67 00000100:00100000:2.0:1788813378.475928:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+6:2361:x1875706562752256:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813378.476022:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+6:2361:x1875706562752256:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 99us (10555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813378.476029:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 67 00000100:00100000:2.0:1788813378.476284:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562752640 00000100:00100000:2.0:1788813378.476292:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562752640 00000100:00100000:2.0:1788813378.476354:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 37 00000100:00100000:2.0:1788813378.476362:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aa21be5-2246-40d3-8e20-d34501daf545+5:2361:x1875706562752640:12345-192.168.204.47@tcp:400:kworker.0 00000100:00080000:1.0:1788813378.476734:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813378.478952:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813378.479377:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562752512 00000100:00100000:0.0:1788813378.479393:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562752512 00000100:00100000:0.0:1788813378.479487:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 38 00000100:00100000:0.0:1788813378.479503:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aa21be5-2246-40d3-8e20-d34501daf545+5:2361:x1875706562752512:12345-192.168.204.47@tcp:400:kworker.0 00000100:00080000:1.0:1788813378.479557:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813378.479642:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aa21be5-2246-40d3-8e20-d34501daf545+5:2361:x1875706562752512:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 142us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813378.479652:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 38 00000100:00100000:2.0:1788813378.479878:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aa21be5-2246-40d3-8e20-d34501daf545+5:2361:x1875706562752640:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 3509us (14450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813378.479892:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 37 00000100:00100000:3.0:1788813378.757667:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583756928:0@lo:400:kworker.0 00000100:00100000:3.0:1788813378.757746:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813378.757793:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908761eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583757440:0@lo:400:kworker.0 00000100:00100000:3.0:1788813378.757816:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813378.757846:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788813378.757852:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583756800:0@lo:400:kworker.0 00000100:00100000:3.0:1788813378.757879:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813378.757898:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908761eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875706583757312:0@lo:400:kworker.0 00000100:00100000:3.0:1788813378.757916:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813378.757939:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908761eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583757056:0@lo:400:kworker.0 00000100:00100000:3.0:1788813378.757960:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813378.757976:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813378.757980:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908761eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583757184:0@lo:400:kworker.0 00000100:00100000:3.0:1788813378.758000:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813378.758041:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583756928 00000100:00100000:3.0:1788813378.758050:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583756928 00000100:00100000:3.0:1788813378.758087:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583757312 00000100:00100000:3.0:1788813378.758090:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583757312 00000100:00100000:3.0:1788813378.758110:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583757056 00000100:00100000:3.0:1788813378.758113:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583757056 00000100:00100000:3.0:1788813378.758143:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788813378.758152:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583756928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813378.758203:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583756928:12345-0@lo:400:kworker.0 Request processed in 53us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813378.758211:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788813378.758227:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788813378.758232:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875706583757312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813378.758268:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875706583757312:12345-0@lo:400:kworker.0 Request processed in 36us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813378.758274:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788813378.758285:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788813378.758290:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583757056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813378.758334:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583757056:12345-0@lo:400:kworker.0 Request processed in 43us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813378.758339:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788813378.758793:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583756800 00000100:00100000:3.0:1788813378.758798:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583756800 00000100:00100000:3.0:1788813378.758822:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788813378.758829:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3321:x1875706583756800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813378.758866:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3321:x1875706583756800:12345-0@lo:400:kworker.0 Request processed in 37us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813378.758879:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788813378.758914:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583757440 00000100:00100000:3.0:1788813378.758917:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583757440 00000100:00100000:3.0:1788813378.758941:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583757184 00000100:00100000:3.0:1788813378.758944:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583757184 00000100:00100000:3.0:1788813378.758957:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788813378.758961:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583757440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813378.758988:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583757440:12345-0@lo:400:kworker.0 Request processed in 27us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813378.758993:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788813378.759002:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788813378.759008:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583757184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813378.759033:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583757184:12345-0@lo:400:kworker.0 Request processed in 25us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813378.759038:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788813378.759076:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff908761eb6d80 x1875706583757184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813378.759091:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908761eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583757184:0@lo:400:kworker.0 00000100:00100000:3.0:1788813378.759102:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908761eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583757056:0@lo:400:kworker.0 00000100:00080000:1.0:1788813378.759242:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788813378.759246:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813378.759311:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583756800:0@lo:400:kworker.0 00000100:00100000:2.0:1788813378.759323:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908761eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875706583757312:0@lo:400:kworker.0 00000100:00100000:2.0:1788813378.759333:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583756928:0@lo:400:kworker.0 00010000:00080000:2.0:1788813378.759343:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff908761eb5c00 x1875706583757440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813378.759364:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908761eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583757440:0@lo:400:kworker.0 00000100:00100000:3.0:1788813379.261653:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583757568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813379.261744:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788813379.261859:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813379.261965:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583757568 00000100:00100000:2.0:1788813379.261974:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583757568 00000100:00100000:2.0:1788813379.262026:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788813379.262035:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583757568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813379.262076:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813379.262134:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583757568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813379.262141:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1788813379.262286:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e450380 x1875706583757568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813379.262306:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583757568:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788813379.472714:0:10342:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg447-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1788813380.284941:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813381.310825:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813382.340048:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583757696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813382.340122:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813382.340211:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583757696 00000100:00100000:0.0:1788813382.340220:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583757696 00000100:00100000:0.0:1788813382.340277:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788813382.340286:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583757696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813382.340324:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813382.340369:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583757696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813382.340376:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788813382.340398:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788813382.340444:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff908773ad8e00 x1875706583757696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813382.340463:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773ad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583757696:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788813382.341158:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813383.364908:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813383.561780:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813383.561823:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813383.561853:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813383.561875:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813383.561905:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813383.561938:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562752896 00000100:00100000:1.0:1788813383.561947:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562752896 00000100:00100000:1.0:1788813383.562007:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562753024 00000100:00100000:1.0:1788813383.562010:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562753024 00000100:00100000:1.0:1788813383.562034:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 71 00000100:00100000:1.0:1788813383.562047:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:2361:x1875706562752896:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813383.562133:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:2361:x1875706562752896:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 88us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813383.562141:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 71 00000100:00100000:1.0:1788813383.562159:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 72 00000100:00100000:1.0:1788813383.562165:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa21be5-2246-40d3-8e20-d34501daf545+5:2361:x1875706562753024:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813383.562189:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa21be5-2246-40d3-8e20-d34501daf545+5:2361:x1875706562753024:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 24us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813383.562195:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 72 00000100:00100000:1.0:1788813383.562213:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562753152 00000100:00100000:1.0:1788813383.562217:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562753152 00000100:00100000:1.0:1788813383.562243:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562753280 00000100:00100000:1.0:1788813383.562254:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562753280 00000100:00100000:1.0:1788813383.562277:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 41 00000100:00100000:1.0:1788813383.562283:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aa21be5-2246-40d3-8e20-d34501daf545+5:2361:x1875706562753152:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813383.562309:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aa21be5-2246-40d3-8e20-d34501daf545+5:2361:x1875706562753152:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 26us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813383.562315:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 41 00000100:00100000:1.0:1788813383.562326:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 42 00000100:00100000:1.0:1788813383.562332:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876facb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aa21be5-2246-40d3-8e20-d34501daf545+5:2361:x1875706562753280:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813383.562353:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876facb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aa21be5-2246-40d3-8e20-d34501daf545+5:2361:x1875706562753280:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 22us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813383.562358:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 42 00000100:00100000:1.0:1788813383.562630:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562752768 00000100:00100000:1.0:1788813383.562635:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562752768 00000100:00100000:1.0:1788813383.562663:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 221 00000100:00100000:1.0:1788813383.562671:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2361:x1875706562752768:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813383.562698:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2361:x1875706562752768:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 28us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813383.562704:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 221 00000100:00080000:1.0:1788813383.562733:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788813383.562737:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788813383.562740:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813383.869103:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583757824:0@lo:400:kworker.0 00000100:00100000:3.0:1788813383.869200:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813383.869266:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875706583758336:0@lo:400:kworker.0 00000100:00100000:0.0:1788813383.869292:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583757952:0@lo:400:kworker.0 00000100:00100000:3.0:1788813383.869300:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813383.869334:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813383.869342:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583758080:0@lo:400:kworker.0 00000100:00100000:0.0:1788813383.869358:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583758464:0@lo:400:kworker.0 00000100:00100000:3.0:1788813383.869370:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813383.869390:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813383.869398:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583758208:0@lo:400:kworker.0 00000100:00100000:0.0:1788813383.869403:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813383.869428:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813383.869457:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583758336 00000100:00100000:0.0:1788813383.869465:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583758336 00000100:00100000:0.0:1788813383.869524:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583757952 00000100:00100000:0.0:1788813383.869527:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583757952 00000100:00100000:0.0:1788813383.869539:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583758080 00000100:00100000:0.0:1788813383.869541:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583758080 00000100:00100000:0.0:1788813383.869556:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788813383.869564:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875706583758336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813383.869614:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583757824 00000100:00100000:1.0:1788813383.869620:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583757824 00000100:00100000:0.0:1788813383.869651:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875706583758336:12345-0@lo:400:kworker.0 Request processed in 87us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813383.869656:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788813383.869664:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788813383.869668:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3320:x1875706583757824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813383.869701:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788813383.869710:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583757952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813383.869714:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3320:x1875706583757824:12345-0@lo:400:kworker.0 Request processed in 46us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813383.869729:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788813383.869766:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788813383.869773:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583757952:12345-0@lo:400:kworker.0 Request processed in 63us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813383.869778:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583758080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813383.869785:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788813383.869821:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583758080:12345-0@lo:400:kworker.0 Request processed in 47us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813383.869823:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583757952:0@lo:400:kworker.0 00000100:00100000:1.0:1788813383.869835:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788813383.869876:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583758464 00000100:00100000:0.0:1788813383.869880:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583758464 00000100:00100000:1.0:1788813383.869886:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583758208 00000100:00100000:1.0:1788813383.869892:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583758208 00000100:00100000:0.0:1788813383.869913:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788813383.869923:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788813383.869924:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583758464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813383.869934:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583758208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813383.869968:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583758464:12345-0@lo:400:kworker.0 Request processed in 46us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813383.869975:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788813383.869980:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583758208:12345-0@lo:400:kworker.0 Request processed in 47us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813383.869988:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1788813383.870013:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e5e9880 x1875706583758464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813383.870025:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583758464:0@lo:400:kworker.0 00000100:00080000:3.0:1788813383.870477:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788813383.870482:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788813383.870507:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e5eb100 x1875706583758208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813383.870518:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583758208:0@lo:400:kworker.0 00000100:00100000:3.0:1788813383.870529:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583758080:0@lo:400:kworker.0 00000100:00100000:3.0:1788813383.870556:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583757824:0@lo:400:kworker.0 00000100:00100000:3.0:1788813383.870567:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875706583758336:0@lo:400:kworker.0 00010000:00010000:0.0:1788813384.380860:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813384.382759:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813384.382782:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583758592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813384.382854:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813384.382916:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583758592 00000100:00100000:1.0:1788813384.382924:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583758592 00000100:00100000:1.0:1788813384.382969:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788813384.382978:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583758592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788813384.383014:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813384.383056:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583758592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813384.383063:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788813384.383104:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e5ea680 x1875706583758592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813384.383547:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583758592:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788813385.404804:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813386.428762:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813387.454842:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583758720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813387.454942:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813387.455282:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583758720 00000100:00100000:2.0:1788813387.455294:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583758720 00000100:00100000:2.0:1788813387.455388:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788813387.455559:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583758720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813387.455640:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813387.455722:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583758720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 325us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813387.455730:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788813387.455761:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788813387.455927:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e450a80 x1875706583758720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813387.455951:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e450a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583758720:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788813387.461505:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813388.476869:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813388.680951:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813388.681021:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813388.681089:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813388.681089:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562753536 00000100:00100000:1.0:1788813388.681116:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562753792 00000100:00100000:0.0:1788813388.681117:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562753536 00000100:00100000:3.0:1788813388.681121:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813388.681123:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562753792 00000100:00100000:3.0:1788813388.681152:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813388.681182:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562753408 00000100:00100000:3.0:1788813388.681186:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562753408 00000100:00100000:1.0:1788813388.681205:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562753920 00000100:00100000:1.0:1788813388.681208:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562753920 00000100:00100000:0.0:1788813388.681212:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562753664 00000100:00100000:0.0:1788813388.681218:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562753664 00000100:00100000:1.0:1788813388.681236:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 45 00000100:00100000:3.0:1788813388.681237:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 223 00000100:00100000:3.0:1788813388.681250:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2362:x1875706562753408:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813388.681250:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aa21be5-2246-40d3-8e20-d34501daf545+5:2362:x1875706562753792:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813388.681256:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 76 00000100:00100000:0.0:1788813388.681269:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:2362:x1875706562753536:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:3.0:1788813388.681344:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2362:x1875706562753408:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 95us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813388.681344:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aa21be5-2246-40d3-8e20-d34501daf545+5:2362:x1875706562753792:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 95us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813388.681345:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:2362:x1875706562753536:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 77us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813388.681360:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 223 00000100:00100000:1.0:1788813388.681360:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 45 00000100:00100000:0.0:1788813388.681364:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 76 00000100:00100000:0.0:1788813388.681396:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 77 00000100:00100000:1.0:1788813388.681398:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 46 00000100:00100000:0.0:1788813388.681413:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa21be5-2246-40d3-8e20-d34501daf545+5:2362:x1875706562753664:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813388.681414:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aa21be5-2246-40d3-8e20-d34501daf545+5:2362:x1875706562753920:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813388.681454:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa21be5-2246-40d3-8e20-d34501daf545+5:2362:x1875706562753664:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 47us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813388.681463:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 77 00000100:00100000:1.0:1788813388.681473:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1aa21be5-2246-40d3-8e20-d34501daf545+5:2362:x1875706562753920:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 64us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813388.681481:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 46 00000100:00080000:1.0:1788813388.681504:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788813388.681520:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788813388.681523:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813388.991176:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773adaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583758848:0@lo:400:kworker.0 00000100:00100000:0.0:1788813388.991204:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583758976:0@lo:400:kworker.0 00000100:00100000:1.0:1788813388.992684:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583759232:0@lo:400:kworker.0 00000100:00100000:0.0:1788813388.993610:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813388.993704:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773ad8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583759488:0@lo:400:kworker.0 00000100:00100000:0.0:1788813388.993750:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813388.997021:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813388.997141:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773ad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875706583759360:0@lo:400:kworker.0 00000100:00100000:3.0:1788813388.997231:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813389.001221:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583758848 00000100:00100000:2.0:1788813389.001246:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583758848 00000100:00100000:2.0:1788813389.001407:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788813389.001420:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3320:x1875706583758848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813389.001562:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3320:x1875706583758848:12345-0@lo:400:kworker.0 Request processed in 144us (4554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813389.001571:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788813389.001697:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773adaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583758848:0@lo:400:kworker.0 00000100:00100000:0.0:1788813389.001825:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583758976 00000100:00100000:0.0:1788813389.001831:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583758976 00000100:00100000:0.0:1788813389.001867:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583759360 00000100:00100000:0.0:1788813389.001870:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583759360 00000100:00100000:0.0:1788813389.001905:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788813389.001913:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583758976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813389.001961:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583758976:12345-0@lo:400:kworker.0 Request processed in 49us (8357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813389.001967:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788813389.001980:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788813389.001994:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875706583759360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813389.002029:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875706583759360:12345-0@lo:400:kworker.0 Request processed in 37us (4797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813389.002035:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788813389.002063:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583759488 00000100:00100000:0.0:1788813389.002067:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583759488 00000100:00100000:0.0:1788813389.002097:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788813389.002103:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583759488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813389.002137:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583759488:12345-0@lo:400:kworker.0 Request processed in 34us (8387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813389.002144:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1788813389.002164:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788813389.002170:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813389.002486:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583758976:0@lo:400:kworker.0 00010000:00080000:0.0:1788813389.002514:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff908773ad8380 x1875706583759488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813389.002527:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773ad8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583759488:0@lo:400:kworker.0 00000100:00100000:2.0:1788813389.003047:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773ad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875706583759360:0@lo:400:kworker.0 00000100:00100000:0.0:1788813389.003370:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583759104:0@lo:400:kworker.0 00000100:00100000:0.0:1788813389.003437:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813389.004726:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813389.006051:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583759232 00000100:00100000:1.0:1788813389.006066:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583759232 00000100:00100000:1.0:1788813389.006157:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788813389.006172:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583759232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813389.006283:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583759232:12345-0@lo:400:kworker.0 Request processed in 114us (1560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813389.006301:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1788813389.006363:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff908773ada300 x1875706583759232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813389.006381:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583759232:0@lo:400:kworker.0 00000100:00080000:0.0:1788813389.007198:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813389.011780:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583759104 00000100:00100000:2.0:1788813389.011815:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583759104 00000100:00100000:2.0:1788813389.011905:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788813389.011917:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583759104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813389.012037:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583759104:12345-0@lo:400:kworker.0 Request processed in 122us (8599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813389.012044:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788813389.012108:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583759104:0@lo:400:kworker.0 00000100:00080000:2.0:1788813389.012143:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813389.500944:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583759616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813389.501056:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813389.501287:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583759616 00000100:00100000:3.0:1788813389.501299:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583759616 00000100:00100000:3.0:1788813389.501370:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788813389.501381:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583759616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813389.501430:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813389.505677:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583759616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4284us (4607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813389.505696:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:3.0:1788813389.505809:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1788813389.511207:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e5e9c00 x1875706583759616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813389.511248:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583759616:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788813390.535853:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813391.548834:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813392.573993:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813392.574026:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583759744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813392.574140:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813392.574329:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583759744 00000100:00100000:2.0:1788813392.574340:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583759744 00000100:00100000:2.0:1788813392.574429:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788813392.574452:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583759744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813392.574505:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813392.574568:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583759744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813392.574575:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788813392.574764:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788813392.574804:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e451f80 x1875706583759744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813392.574840:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583759744:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788813392.580972:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813393.596860:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813393.803576:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813393.803647:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813393.803671:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813393.803698:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813393.803722:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813393.803902:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562754176 00000100:00100000:3.0:1788813393.803915:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562754176 00000100:00100000:3.0:1788813393.804002:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562754304 00000100:00100000:3.0:1788813393.804016:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562754304 00000100:00100000:3.0:1788813393.804044:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 81 00000100:00100000:3.0:1788813393.804055:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+6:2360:x1875706562754176:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:3.0:1788813393.804150:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+6:2360:x1875706562754176:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 97us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813393.804159:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 81 00000100:00100000:3.0:1788813393.804178:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 82 00000100:00100000:3.0:1788813393.804184:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aa21be5-2246-40d3-8e20-d34501daf545+5:2360:x1875706562754304:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:3.0:1788813393.804343:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aa21be5-2246-40d3-8e20-d34501daf545+5:2360:x1875706562754304:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 157us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813393.804350:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 82 00000100:00100000:0.0:1788813393.805003:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562754432 00000100:00100000:0.0:1788813393.805015:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562754432 00000100:00100000:0.0:1788813393.805064:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562754560 00000100:00100000:0.0:1788813393.805067:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562754560 00000100:00100000:0.0:1788813393.805090:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 14 00000100:00100000:0.0:1788813393.805099:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aa21be5-2246-40d3-8e20-d34501daf545+5:2358:x1875706562754432:12345-192.168.204.47@tcp:9:kworker.0 00000020:00000080:0.0:1788813393.805132:0:8270:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb185d 00000100:00080000:0.0:1788813393.805144:0:8270:0:(import.c:65:import_set_state_nolock()) ffff9087742f4000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788813393.805194:0:8270:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788813393.805664:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aa21be5-2246-40d3-8e20-d34501daf545+2:2358:x1875706562754432:12345-192.168.204.47@tcp:9:kworker.0 Request processed in 563us (1961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813393.805673:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 14 00000100:00100000:0.0:1788813393.805693:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 15 00000100:00100000:0.0:1788813393.805700:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aa21be5-2246-40d3-8e20-d34501daf545+5:2358:x1875706562754560:12345-192.168.204.47@tcp:9:kworker.0 00000020:00000080:0.0:1788813393.805717:0:8270:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb1864 00000100:00080000:0.0:1788813393.805725:0:8270:0:(import.c:65:import_set_state_nolock()) ffff908749daa000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788813393.805763:0:8270:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788813393.805966:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1aa21be5-2246-40d3-8e20-d34501daf545+2:2358:x1875706562754560:12345-192.168.204.47@tcp:9:kworker.0 Request processed in 266us (2241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813393.805974:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 15 00000100:00080000:0.0:1788813393.805998:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788813393.806002:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788813393.806006:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788813393.806028:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813393.807032:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562754048 00000100:00100000:0.0:1788813393.807044:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562754048 00000100:00100000:0.0:1788813393.807099:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 225 00000100:00100000:0.0:1788813393.807108:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2360:x1875706562754048:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813393.807172:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2360:x1875706562754048:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 65us (3523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813393.807180:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 225 00010000:00010000:1.0:1788813393.809337:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813394.114149:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583760256:0@lo:400:kworker.0 00000100:00100000:1.0:1788813394.114255:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813394.114331:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813394.114339:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875706583760128:0@lo:400:kworker.0 00000100:00100000:1.0:1788813394.114368:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813394.114702:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583760000:0@lo:400:kworker.0 00000100:00100000:0.0:1788813394.114739:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813394.114770:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583760512:0@lo:400:kworker.0 00000100:00100000:0.0:1788813394.114790:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813394.114816:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788813394.114821:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583759872:0@lo:400:kworker.0 00000100:00100000:0.0:1788813394.114848:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813394.114867:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875706583760384:0@lo:400:kworker.0 00000100:00100000:0.0:1788813394.114885:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813394.114920:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583760256 00000100:00100000:0.0:1788813394.114930:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583760256 00000100:00100000:0.0:1788813394.114992:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583760512 00000100:00100000:0.0:1788813394.114995:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583760512 00000100:00100000:0.0:1788813394.115023:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788813394.115034:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583760256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813394.115106:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583760256:12345-0@lo:400:kworker.0 Request processed in 74us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813394.115114:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788813394.115131:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788813394.115156:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583760512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813394.115188:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583760512:12345-0@lo:400:kworker.0 Request processed in 33us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813394.115194:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788813394.115214:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583759872 00000100:00100000:0.0:1788813394.115217:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583759872 00000100:00100000:0.0:1788813394.115239:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788813394.115245:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3321:x1875706583759872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813394.115275:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3321:x1875706583759872:12345-0@lo:400:kworker.0 Request processed in 31us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813394.115281:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788813394.115310:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583760128 00000100:00100000:0.0:1788813394.115314:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583760128 00000100:00100000:0.0:1788813394.115340:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583760000 00000100:00100000:0.0:1788813394.115343:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583760000 00000100:00100000:0.0:1788813394.115354:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583760384 00000100:00100000:0.0:1788813394.115356:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583760384 00000100:00100000:0.0:1788813394.115370:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788813394.115376:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875706583760128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813394.115418:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875706583760128:12345-0@lo:400:kworker.0 Request processed in 42us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813394.115424:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788813394.115437:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788813394.115442:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583760000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813394.115468:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583760000:12345-0@lo:400:kworker.0 Request processed in 25us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813394.115474:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788813394.115495:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788813394.115501:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875706583760384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813394.115533:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875706583760384:12345-0@lo:400:kworker.0 Request processed in 32us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813394.115539:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1788813394.115556:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788813394.115562:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788813394.115564:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813394.115638:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583759872:0@lo:400:kworker.0 00000100:00100000:0.0:1788813394.115653:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875706583760384:0@lo:400:kworker.0 00000100:00100000:0.0:1788813394.115662:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583760000:0@lo:400:kworker.0 00010000:00080000:0.0:1788813394.115674:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e5e8380 x1875706583760512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813394.115686:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583760512:0@lo:400:kworker.0 00000100:00100000:0.0:1788813394.115728:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875706583760128:0@lo:400:kworker.0 00010000:00080000:0.0:1788813394.115740:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e5eb100 x1875706583760256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813394.115749:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583760256:0@lo:400:kworker.0 00000100:00100000:2.0:1788813394.620990:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813394.621033:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583760640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813394.621144:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813394.621353:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583760640 00000100:00100000:1.0:1788813394.621366:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583760640 00000100:00100000:1.0:1788813394.621551:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788813394.621565:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583760640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788813394.621643:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813394.621722:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e450e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583760640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813394.621730:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788813394.621821:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3e9f80 x1875706583760640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813394.621846:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583760640:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788813394.621891:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813395.650193:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813396.669494:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813397.692960:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1788813397.695035:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813397.695789:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583760768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813397.695903:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813397.696770:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583760768 00000100:00100000:2.0:1788813397.696786:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583760768 00000100:00100000:2.0:1788813397.696943:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788813397.696955:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583760768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813397.697008:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813397.697120:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583760768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 167us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813397.697128:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788813397.697357:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e453800 x1875706583760768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813397.697385:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583760768:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788813397.697736:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788813398.727203:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788813398.805101:0:7669:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1aa21be5-2246-40d3-8e20-d34501daf545 00000020:00000080:3.0:1788813398.805115:0:7669:0:(genops.c:885:class_export_put()) final put ffff908749dae000/1aa21be5-2246-40d3-8e20-d34501daf545 00000020:00000080:3.0:1788813398.805148:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff908749dae000/1aa21be5-2246-40d3-8e20-d34501daf545 for lustre-OST0001 00000020:00000080:3.0:1788813398.805216:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff908749daa000 for lustre-OST0001 00000001:00100000:1.0:1788813398.841156:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1aa21be5-2246-40d3-8e20-d34501daf545 00000020:00000080:1.0:1788813398.841174:0:6729:0:(genops.c:885:class_export_put()) final put ffff9087742f2000/1aa21be5-2246-40d3-8e20-d34501daf545 00000020:00000080:3.0:1788813398.841440:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9087742f2000/1aa21be5-2246-40d3-8e20-d34501daf545 for lustre-OST0000 00000020:00000080:3.0:1788813398.841517:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9087742f4000 for lustre-OST0000 00000100:00100000:3.0:1788813398.914662:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813398.914716:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813398.914759:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813398.914853:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562754816 00000100:00100000:0.0:1788813398.914878:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562754816 00000100:00100000:0.0:1788813398.914972:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562754944 00000100:00100000:0.0:1788813398.914976:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562754944 00000100:00100000:0.0:1788813398.915008:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 86 00000100:00100000:0.0:1788813398.915021:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:2361:x1875706562754816:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813398.915134:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:2361:x1875706562754816:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 115us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813398.915142:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 86 00000100:00100000:0.0:1788813398.915162:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 87 00000100:00100000:0.0:1788813398.915169:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa21be5-2246-40d3-8e20-d34501daf545+5:2362:x1875706562754944:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813398.915198:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa21be5-2246-40d3-8e20-d34501daf545+5:2362:x1875706562754944:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 30us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813398.915204:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 87 00000100:00100000:1.0:1788813398.915859:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562754688 00000100:00100000:1.0:1788813398.915867:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562754688 00000100:00100000:1.0:1788813398.915915:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 227 00000100:00100000:1.0:1788813398.915936:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2362:x1875706562754688:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813398.915989:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2362:x1875706562754688:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 65us (1270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813398.915996:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 227 00000100:00080000:3.0:1788813398.916223:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813399.232501:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583761152:0@lo:400:kworker.0 00000100:00100000:0.0:1788813399.232841:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813399.232923:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813399.232929:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583761280:0@lo:400:kworker.0 00000100:00100000:0.0:1788813399.232957:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813399.233013:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583761152 00000100:00100000:0.0:1788813399.233023:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583761152 00000100:00100000:0.0:1788813399.233094:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788813399.233520:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583760896:0@lo:400:kworker.0 00000100:00100000:2.0:1788813399.233570:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813399.233616:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875706583761408:0@lo:400:kworker.0 00000100:00100000:2.0:1788813399.233639:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813399.233658:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788813399.233664:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583761024:0@lo:400:kworker.0 00000100:00100000:2.0:1788813399.233681:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813399.233697:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583761536:0@lo:400:kworker.0 00000100:00100000:2.0:1788813399.233714:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813399.233778:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583760896 00000100:00100000:2.0:1788813399.233782:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583760896 00000100:00100000:2.0:1788813399.233812:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788813399.233819:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3320:x1875706583760896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813399.233912:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583761152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813399.233977:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583761152:12345-0@lo:400:kworker.0 Request processed in 874us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813399.233991:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788813399.234011:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583761408 00000100:00100000:0.0:1788813399.234014:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583761408 00000100:00100000:0.0:1788813399.234029:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583761024 00000100:00100000:0.0:1788813399.234031:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583761024 00000100:00100000:0.0:1788813399.234042:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788813399.234048:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875706583761408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813399.234078:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875706583761408:12345-0@lo:400:kworker.0 Request processed in 31us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813399.234084:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788813399.234093:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788813399.234098:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583761024:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788813399.234691:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813399.234712:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583761280 00000100:00100000:1.0:1788813399.234718:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583761280 00000100:00100000:1.0:1788813399.234906:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583761536 00000100:00100000:1.0:1788813399.234911:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583761536 00000100:00100000:1.0:1788813399.234936:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788813399.234943:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583761280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813399.235006:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583761280:12345-0@lo:400:kworker.0 Request processed in 63us (2048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813399.235013:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788813399.235030:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788813399.235035:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583761536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813399.235067:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583761536:12345-0@lo:400:kworker.0 Request processed in 32us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813399.235072:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788813399.235090:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788813399.235101:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813399.235227:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583761024:12345-0@lo:400:kworker.0 Request processed in 1128us (1543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813399.235235:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:0.0:1788813399.235295:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e5e9500 x1875706583761280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813399.235322:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583761280:0@lo:400:kworker.0 00000100:00100000:0.0:1788813399.235338:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583761152:0@lo:400:kworker.0 00000100:00100000:2.0:1788813399.236268:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3320:x1875706583760896:12345-0@lo:400:kworker.0 Request processed in 2441us (2689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813399.236280:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788813399.236446:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583761024:0@lo:400:kworker.0 00010000:00080000:2.0:1788813399.236464:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e5ea300 x1875706583761536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813399.236474:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583761536:0@lo:400:kworker.0 00000100:00100000:2.0:1788813399.236485:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583760896:0@lo:400:kworker.0 00000100:00100000:2.0:1788813399.236499:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875706583761408:0@lo:400:kworker.0 00010000:00010000:0.0:1788813399.741273:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813399.741543:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813399.741601:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583761664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813399.741701:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813399.742013:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583761664 00000100:00100000:1.0:1788813399.742025:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583761664 00000100:00100000:1.0:1788813399.742113:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788813399.742125:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583761664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788813399.742178:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813399.742245:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583761664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813399.742254:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788813399.742321:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3eca80 x1875706583761664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813399.742346:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583761664:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1788813400.713509:0:11045:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788813400.766139:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813401.791494:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813402.814814:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813402.814846:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e4a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583761792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813402.814930:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813402.815006:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583761792 00000100:00100000:0.0:1788813402.815013:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583761792 00000100:00100000:0.0:1788813402.815079:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788813402.815099:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583761792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813402.815137:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813402.815188:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583761792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813402.815195:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1788813402.815254:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e4a1500 x1875706583761792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813402.815275:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e4a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583761792:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788813402.815345:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788813403.836812:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813404.034960:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813404.037931:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813404.038841:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562755328 00000100:00100000:3.0:1788813404.038856:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562755328 00000100:00100000:0.0:1788813404.042569:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562755072 00000100:00100000:0.0:1788813404.042596:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562755072 00000100:00100000:0.0:1788813404.042659:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 229 00000100:00100000:0.0:1788813404.042671:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2361:x1875706562755072:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813404.042840:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2361:x1875706562755072:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 170us (7889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813404.042849:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 229 00000100:00100000:2.0:1788813404.044301:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813404.044892:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562755200 00000100:00100000:0.0:1788813404.044903:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562755200 00000100:00100000:0.0:1788813404.045529:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 91 00000100:00100000:0.0:1788813404.045544:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+6:2361:x1875706562755200:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813404.045648:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+6:2361:x1875706562755200:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 108us (1351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813404.045658:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 91 00000100:00100000:3.0:1788813404.047001:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 92 00000100:00100000:3.0:1788813404.047019:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa21be5-2246-40d3-8e20-d34501daf545+5:2361:x1875706562755328:12345-192.168.204.47@tcp:400:kworker.0 00000100:00080000:2.0:1788813404.048652:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813404.050188:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa21be5-2246-40d3-8e20-d34501daf545+5:2361:x1875706562755328:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 3165us (12257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813404.050202:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 92 00000100:00100000:2.0:1788813404.364864:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e451180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583762176:0@lo:400:kworker.0 00000100:00100000:2.0:1788813404.364937:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813404.364991:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813404.364998:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583762304:0@lo:400:kworker.0 00000100:00100000:2.0:1788813404.365024:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813404.365163:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583761920:0@lo:400:kworker.0 00000100:00100000:0.0:1788813404.365200:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813404.365260:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875706583762432:0@lo:400:kworker.0 00000100:00100000:0.0:1788813404.365287:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813404.365306:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788813404.365312:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583762048:0@lo:400:kworker.0 00000100:00100000:0.0:1788813404.365333:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813404.365349:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583762560:0@lo:400:kworker.0 00000100:00100000:0.0:1788813404.365368:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813404.365402:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583762176 00000100:00100000:0.0:1788813404.365410:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583762176 00000100:00100000:0.0:1788813404.365469:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583762432 00000100:00100000:0.0:1788813404.365472:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583762432 00000100:00100000:0.0:1788813404.365485:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583762048 00000100:00100000:0.0:1788813404.365487:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583762048 00000100:00100000:0.0:1788813404.365501:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788813404.365508:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583762176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813404.365557:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583762176:12345-0@lo:400:kworker.0 Request processed in 49us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813404.365564:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788813404.365633:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788813404.365641:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875706583762432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813404.365676:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875706583762432:12345-0@lo:400:kworker.0 Request processed in 36us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813404.365681:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788813404.365693:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788813404.365698:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583762048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813404.365725:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583762048:12345-0@lo:400:kworker.0 Request processed in 27us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813404.365754:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788813404.365786:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583762304 00000100:00100000:0.0:1788813404.365790:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583762304 00000100:00100000:0.0:1788813404.365817:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583762560 00000100:00100000:0.0:1788813404.365819:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583762560 00000100:00100000:0.0:1788813404.365839:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788813404.365846:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ad8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583762304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813404.365880:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ad8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583762304:12345-0@lo:400:kworker.0 Request processed in 34us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813404.365886:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788813404.365897:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788813404.365903:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583762560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813404.365933:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583762560:12345-0@lo:400:kworker.0 Request processed in 30us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813404.365938:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1788813404.365952:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788813404.365956:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788813404.365958:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813404.366011:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e452a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583762048:0@lo:400:kworker.0 00010000:00080000:0.0:1788813404.366023:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff908773ada300 x1875706583762560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813404.366033:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583762560:0@lo:400:kworker.0 00000100:00100000:0.0:1788813404.366042:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875706583762432:0@lo:400:kworker.0 00010000:00080000:0.0:1788813404.366079:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e450380 x1875706583762304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813404.366100:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583762304:0@lo:400:kworker.0 00000100:00100000:0.0:1788813404.366113:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e451180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583762176:0@lo:400:kworker.0 00000100:00100000:2.0:1788813404.366368:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583761920 00000100:00100000:2.0:1788813404.366373:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583761920 00000100:00100000:2.0:1788813404.366402:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788813404.366409:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3320:x1875706583761920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813404.366452:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3320:x1875706583761920:12345-0@lo:400:kworker.0 Request processed in 44us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813404.366459:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788813404.366719:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e453b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583761920:0@lo:400:kworker.0 00000020:00000080:0.0:1788813404.480838:0:11195:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd62bec570 20000000:00000080:0.0:1788813404.480859:0:11195:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff908748cdb400 uarg=0000000000000000 20000000:01000000:0.0:1788813404.480896:0:11195:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788813404.480902:0:11195:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788813404.480908:0:11195:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788813404.482328:0:11196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788813404.482489:0:11195:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788813404.490095:0:11195:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788813404.490236:0:11195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff908740030000/0x6d74dbab2ddb186b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813404.490263:0:11195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff908774368400/0x6d74dbab2ddb1810 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d05 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813404.490273:0:11195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff908750ad0c00/0x6d74dbab2ddb181e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1817 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813404.490280:0:11195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff908750ad1800/0x6d74dbab2ddb182c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1825 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813404.490287:0:11195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff908774368e00/0x6d74dbab2ddb183a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1833 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813404.490295:0:11195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff908750ad1000/0x6d74dbab2ddb184f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d3d expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813404.490303:0:11195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff908740030000/0x6d74dbab2ddb186b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813404.490369:0:11195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff908750ad1000/0x6d74dbab2ddb184f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d3d expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813404.490386:0:11195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff908750ad1000/0x6d74dbab2ddb184f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d3d expref: 12 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813404.490403:0:11195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e4a3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11195:1875706583762688:192.168.204.47@tcp:104: 00010000:00010000:0.0:1788813404.490567:0:11195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff908774368e00/0x6d74dbab2ddb183a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb1833 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813404.490614:0:11195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff908774368e00/0x6d74dbab2ddb183a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1833 expref: 18 pid: 5841 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813404.490627:0:11195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e4a0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11195:1875706583762816:0@lo:104: 00000100:00100000:0.0:1788813404.490677:0:11195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788813404.490723:0:11195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff908750ad1800/0x6d74dbab2ddb182c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb1825 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813404.490807:0:11195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff908750ad1800/0x6d74dbab2ddb182c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1825 expref: 18 pid: 5844 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813404.490817:0:11195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e453b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11195:1875706583762944:0@lo:104: 00000100:00100000:0.0:1788813404.490843:0:11195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788813404.490872:0:11195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff908750ad0c00/0x6d74dbab2ddb181e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb1817 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813404.490880:0:11195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff908750ad0c00/0x6d74dbab2ddb181e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1817 expref: 18 pid: 5844 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813404.490902:0:11195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e450380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11195:1875706583763072:0@lo:104: 00000100:00100000:0.0:1788813404.490925:0:11195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788813404.490944:0:11195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff908774368400/0x6d74dbab2ddb1810 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d05 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813404.490953:0:11195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff908774368400/0x6d74dbab2ddb1810 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d05 expref: 12 pid: 5844 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813404.490962:0:11195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5e9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11195:1875706583763200:192.168.204.47@tcp:104: 00000100:00100000:0.0:1788813404.490989:0:11195:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876e497a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813404.491101:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583762816 00000100:00100000:1.0:1788813404.491112:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583762816 00000100:00100000:1.0:1788813404.491164:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583762944 00000100:00100000:1.0:1788813404.491167:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583762944 00000100:00100000:1.0:1788813404.491176:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583763072 00000100:00100000:1.0:1788813404.491178:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583763072 00000100:00100000:1.0:1788813404.491191:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788813404.491202:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+5:11195:x1875706583762816:12345-0@lo:104: 00010000:00010000:1.0:1788813404.491229:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff908774369600/0x6d74dbab2ddb1833 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb183a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813404.491296:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788813404.491302:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+5:11195:x1875706583762816:12345-0@lo:104: Request processed in 103us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813404.491310:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788813404.491328:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788813404.491333:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e451180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+4:11195:x1875706583762944:12345-0@lo:104: 00010000:00010000:1.0:1788813404.491341:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff908774369400/0x6d74dbab2ddb1825 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb182c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813404.491373:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788813404.491379:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e451180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+4:11195:x1875706583762944:12345-0@lo:104: Request processed in 46us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813404.491385:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788813404.491397:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788813404.491403:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e452a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+3:11195:x1875706583763072:12345-0@lo:104: 00010000:00010000:1.0:1788813404.491411:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff908750ad1200/0x6d74dbab2ddb1817 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb181e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813404.491441:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788813404.491446:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e452a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+3:11195:x1875706583763072:12345-0@lo:104: Request processed in 44us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813404.491849:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788813404.491876:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788813404.491883:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908774369600/0x6d74dbab2ddb1833 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb183a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813404.491905:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369600 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:1.0:1788813404.491909:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908774369600/0x6d74dbab2ddb1833 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb183a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813404.491919:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908774369600/0x6d74dbab2ddb1833 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb183a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813404.491926:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908774369600/0x6d74dbab2ddb1833 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb183a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813404.491931:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788813404.491971:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff908774369600/0x6d74dbab2ddb1833 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb183a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813404.491979:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813404.492003:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908774369600/0x6d74dbab2ddb1833 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb183a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813404.492010:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908774369600/0x6d74dbab2ddb1833 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb183a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813404.492026:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813404.492029:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908774369400/0x6d74dbab2ddb1825 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb182c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813404.492036:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369400 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:1.0:1788813404.492038:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908774369400/0x6d74dbab2ddb1825 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb182c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813404.492056:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908774369400/0x6d74dbab2ddb1825 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb182c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813404.492063:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908774369400/0x6d74dbab2ddb1825 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb182c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813404.492069:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788813404.492083:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff908774369400/0x6d74dbab2ddb1825 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb182c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813404.492089:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813404.492096:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908774369400/0x6d74dbab2ddb1825 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb182c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813404.492102:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908774369400/0x6d74dbab2ddb1825 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb182c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813404.492112:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813404.492115:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908750ad1200/0x6d74dbab2ddb1817 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb181e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813404.492120:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1200 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:1.0:1788813404.492123:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908750ad1200/0x6d74dbab2ddb1817 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb181e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813404.492131:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908750ad1200/0x6d74dbab2ddb1817 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb181e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813404.492137:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908750ad1200/0x6d74dbab2ddb1817 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb181e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813404.492149:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788813404.492162:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff908750ad1200/0x6d74dbab2ddb1817 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb181e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813404.492168:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813404.492182:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908750ad1200/0x6d74dbab2ddb1817 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb181e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813404.492189:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908750ad1200/0x6d74dbab2ddb1817 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb181e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813404.492215:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813404.492217:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813404.492219:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813404.492225:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813404.492232:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813404.492245:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583763328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813404.492289:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813404.492316:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788813404.492322:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583763456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813404.492345:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813404.492376:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583763584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813404.492399:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813404.492434:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583763328 00000100:00100000:1.0:1788813404.492440:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583763328 00010000:00010000:1.0:1788813404.492464:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff908774368e00/0x6d74dbab2ddb183a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1833 expref: 19 pid: 5841 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813404.492498:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583763456 00000100:00100000:1.0:1788813404.492501:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583763456 00010000:00010000:1.0:1788813404.492516:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff908750ad1800/0x6d74dbab2ddb182c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1825 expref: 20 pid: 5844 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813404.492526:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583763584 00000100:00100000:1.0:1788813404.492529:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583763584 00010000:00010000:1.0:1788813404.492538:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff908750ad0c00/0x6d74dbab2ddb181e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1817 expref: 21 pid: 5844 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813404.492550:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788813404.492557:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+21:3318:x1875706583763328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813404.492568:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813404.492573:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff908774368e00/0x6d74dbab2ddb183a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1833 expref: 21 pid: 5841 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813404.492608:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff908774368e00/0x6d74dbab2ddb183a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1833 expref: 21 pid: 5841 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813404.492627:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813404.492659:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+21:3318:x1875706583763328:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813404.492665:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788813404.493044:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788813404.493056:0:8477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd1fd158-af17-4a1b-8f0b-82e57114d008+20:3318:x1875706583763456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788813404.493066:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813404.493072:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff908750ad1800/0x6d74dbab2ddb182c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1825 expref: 20 pid: 5844 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813404.493082:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff908750ad1800/0x6d74dbab2ddb182c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1825 expref: 20 pid: 5844 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813404.493093:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813404.493123:0:8477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd1fd158-af17-4a1b-8f0b-82e57114d008+20:3318:x1875706583763456:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813404.493129:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788813404.493146:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788813404.493151:0:8477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3320:x1875706583763584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788813404.493159:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813404.493163:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff908750ad0c00/0x6d74dbab2ddb181e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1817 expref: 19 pid: 5844 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813404.493171:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff908750ad0c00/0x6d74dbab2ddb181e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1817 expref: 19 pid: 5844 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813404.493187:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813404.493229:0:8477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3320:x1875706583763584:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813404.493235:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788813404.493271:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583763584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813404.493372:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583763456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813404.493379:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583763328:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813404.493876:0:11195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908774368e00/0x6d74dbab2ddb183a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb1833 expref: 18 pid: 5841 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813404.493887:0:11195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e4a0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11195:1875706583762816:0@lo:104: 00010000:00010000:0.0:1788813404.493896:0:11195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908750ad1800/0x6d74dbab2ddb182c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb1825 expref: 17 pid: 5844 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813404.493904:0:11195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e453b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11195:1875706583762944:0@lo:104: 00010000:00010000:0.0:1788813404.493912:0:11195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908750ad0c00/0x6d74dbab2ddb181e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb1817 expref: 16 pid: 5844 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813404.493919:0:11195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e450380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11195:1875706583763072:0@lo:104: 00000100:00100000:2.0:1788813404.497666:0:11195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e4a3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11195:1875706583762688:192.168.204.47@tcp:104: 00000100:00100000:2.0:1788813404.497713:0:11195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5e9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11195:1875706583763200:192.168.204.47@tcp:104: 00010000:00010000:2.0:1788813404.497761:0:11195:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff908740030000/0x6d74dbab2ddb186b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813404.499576:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813404.499710:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813404.499979:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562755584 00000100:00100000:2.0:1788813404.499989:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562755584 00010000:00010000:2.0:1788813404.500033:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff908774368400/0x6d74dbab2ddb1810 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d05 expref: 13 pid: 5844 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813404.500074:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562755456 00000100:00100000:2.0:1788813404.500078:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562755456 00010000:00010000:2.0:1788813404.500091:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff908750ad1000/0x6d74dbab2ddb184f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d3d expref: 14 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813404.500115:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 28 00000100:00100000:2.0:1788813404.500124:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+14:2359:x1875706562755584:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813404.500139:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813404.500145:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff908774368400/0x6d74dbab2ddb1810 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d05 expref: 14 pid: 5844 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813404.500155:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff908774368400/0x6d74dbab2ddb1810 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d05 expref: 14 pid: 5844 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813404.500173:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908774368400/0x6d74dbab2ddb1810 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d05 expref: 14 pid: 5844 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813404.500189:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813404.500257:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2359:x1875706562755584:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 133us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813404.500274:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 28 00000100:00100000:2.0:1788813404.500295:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 29 00000100:00100000:2.0:1788813404.500301:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+12:2360:x1875706562755456:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813404.500309:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813404.500315:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff908750ad1000/0x6d74dbab2ddb184f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d3d expref: 12 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813404.500325:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff908750ad1000/0x6d74dbab2ddb184f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d3d expref: 12 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813404.500338:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908750ad1000/0x6d74dbab2ddb184f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d3d expref: 12 pid: 5843 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813404.500351:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff908740030000/0x6d74dbab2ddb186b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813404.500360:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908740030000/0x6d74dbab2ddb186b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813404.500376:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff908740030000/0x6d74dbab2ddb186b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813404.500383:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff908740030000/0x6d74dbab2ddb186b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813404.500390:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff908740030000/0x6d74dbab2ddb186b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813404.500396:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff908740030000/0x6d74dbab2ddb186b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813404.500409:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740030000 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:2.0:1788813404.500413:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff908740030000/0x6d74dbab2ddb186b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813404.500422:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff908740030000/0x6d74dbab2ddb186b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813404.500437:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff908740030000/0x6d74dbab2ddb186b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813404.500449:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813404.500471:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+11:2360:x1875706562755456:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 169us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813404.500479:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 29 00010000:00010000:2.0:1788813404.500630:0:11195:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff908740030000/0x6d74dbab2ddb186b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813404.500638:0:11195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff908740030000/0x6d74dbab2ddb186b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813404.500644:0:11195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908740030000/0x6d74dbab2ddb186b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813404.861048:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813404.861220:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813404.861243:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583763712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813404.861317:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813404.861467:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583763712 00000100:00100000:0.0:1788813404.861479:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583763712 00000100:00100000:0.0:1788813404.861536:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788813404.861547:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583763712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788813404.861622:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813404.861693:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583763712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813404.861700:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788813404.861784:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff908773adb800 x1875706583763712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813404.861803:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583763712:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788813405.891767:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788813406.335887:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788813406.335897:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff908641187800 from 7 10000000:01000000:2.0:1788813406.335903:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788813406.335961:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908774368c00/0x6d74dbab2ddb1872 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813406.335976:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908774368c00/0x6d74dbab2ddb1872 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813406.336001:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908774368c00/0x6d74dbab2ddb1872 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813406.336034:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773adaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583763840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788813406.336118:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813406.338000:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c0b7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813406.347950:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583763840 00000100:00100000:1.0:1788813406.347966:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583763840 00000100:00100000:1.0:1788813406.348043:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788813406.348055:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:5846:x1875706583763840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813406.348073:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813406.348097:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90874148d600/0x6d74dbab2ddb1879 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb1872 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813406.348128:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90874148d600/0x6d74dbab2ddb1879 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1872 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813406.348141:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90874148d600/0x6d74dbab2ddb1879 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1872 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813406.348151:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148d600, rc 0) 00000100:00100000:1.0:1788813406.348241:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:5846:x1875706583763840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (12122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813406.348248:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788813406.348314:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773adaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583763840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813406.348334:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908774368c00/0x6d74dbab2ddb1872 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1879 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813406.348344:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908774368c00/0x6d74dbab2ddb1872 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb1879 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813406.348420:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583763968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813406.348454:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813406.348506:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90875efc9780 going to sleep for 11 seconds 00000100:00100000:1.0:1788813406.348536:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583763968 00000100:00100000:1.0:1788813406.348539:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583763968 00000100:00100000:1.0:1788813406.348563:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788813406.348571:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:5846:x1875706583763968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813406.348867:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:5846:x1875706583763968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813406.348874:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788813406.348907:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583763968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813406.348939:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583764096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813406.348982:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813406.348995:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90875efc9780 going to sleep for 11 seconds 00000100:00100000:1.0:1788813406.349007:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583764096 00000100:00100000:1.0:1788813406.349010:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583764096 00000100:00100000:1.0:1788813406.349029:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788813406.349035:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:5846:x1875706583764096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813406.349203:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:5846:x1875706583764096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813406.349209:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788813406.349247:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583764096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788813406.349896:0:11245:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788813406.349959:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788813406.349975:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788813406.349983:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908774368c00/0x6d74dbab2ddb1872 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1879 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813406.350005:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908774368c00/0x6d74dbab2ddb1872 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1879 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813406.350015:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788813406.350017:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff908774402000 from 7 10000000:01000000:1.0:1788813406.350020:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788813406.350047:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb1880 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813406.350055:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb1880 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813406.350066:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb1880 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813406.350084:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583764224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788813406.350123:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813406.350140:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876016b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813406.350157:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583764224 00000100:00100000:1.0:1788813406.350162:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583764224 00000100:00100000:1.0:1788813406.350208:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788813406.350216:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:5846:x1875706583764224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813406.350225:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813406.350235:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90874148c400/0x6d74dbab2ddb1887 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb1880 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813406.350254:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90874148c400/0x6d74dbab2ddb1887 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1880 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813406.350277:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90874148c400/0x6d74dbab2ddb1887 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1880 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813406.350287:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148c400, rc 0) 00000100:00100000:1.0:1788813406.350322:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583764224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813406.350328:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788813406.350367:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583764224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813406.350380:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb1880 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1887 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813406.350389:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb1880 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb1887 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813406.350427:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583764352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813406.350451:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813406.350466:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876016b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813406.350476:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583764352 00000100:00100000:1.0:1788813406.350479:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583764352 00000100:00100000:1.0:1788813406.350500:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788813406.350506:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90875243bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583764352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813406.350737:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90875243bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583764352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 231us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813406.353473:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813406.353511:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562755712 00000100:00100000:0.0:1788813406.353521:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562755712 00000100:00100000:0.0:1788813406.353560:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 236 00000100:00100000:0.0:1788813406.353570:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+11:5602:x1875706562755712:12345-192.168.204.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813406.353607:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813406.353625:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908740031e00/0x6d74dbab2ddb188e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x31ee63787e483d67 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813406.353653:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908740031e00/0x6d74dbab2ddb188e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d67 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813406.353666:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908740031e00/0x6d74dbab2ddb188e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d67 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813406.353675:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740031e00, rc 0) 00000100:00100000:0.0:1788813406.353736:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+12:5602:x1875706562755712:12345-192.168.204.47@tcp:101:ll_cfg_requeue.0 Request processed in 168us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813406.353744:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 236 00000100:00100000:0.0:1788813406.353975:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583764352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813406.354036:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583764480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813406.354101:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813406.354132:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876e497900 going to sleep for 11 seconds 00000100:00100000:0.0:1788813406.354152:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583764480 00000100:00100000:0.0:1788813406.354156:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583764480 00000100:00100000:0.0:1788813406.354192:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788813406.354198:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:5846:x1875706583764480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813406.354380:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:5846:x1875706583764480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813406.354386:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788813406.354428:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583764480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813406.357632:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813406.357675:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562755840 00000100:00100000:2.0:1788813406.357687:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562755840 00000100:00100000:2.0:1788813406.357736:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 238 00000100:00100000:2.0:1788813406.357747:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+12:5602:x1875706562755840:12345-192.168.204.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813406.358058:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+12:5602:x1875706562755840:12345-192.168.204.47@tcp:501:ll_cfg_requeue.0 Request processed in 311us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813406.358065:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 238 00000100:00100000:1.0:1788813406.359983:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000040:00080000:1.0:1788813406.366004:0:11246:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788813406.366429:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788813406.366455:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788813406.366467:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb1880 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1887 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813406.366479:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb1880 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1887 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813406.366490:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788813406.366494:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff908781c96000 from 7 10000000:01000000:0.0:1788813406.366497:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788813406.366536:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740030000/0x6d74dbab2ddb1895 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813406.366543:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908740030000/0x6d74dbab2ddb1895 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813406.366554:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908740030000/0x6d74dbab2ddb1895 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813406.366614:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583764608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788813406.366808:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813406.366888:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876e497840 going to sleep for 11 seconds 00000100:00100000:0.0:1788813406.368115:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813406.381659:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583764608 00000100:00100000:2.0:1788813406.381678:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583764608 00000100:00100000:3.0:1788813406.382557:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562755968 00000100:00100000:3.0:1788813406.382567:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562755968 00000100:00100000:3.0:1788813406.382648:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 239 00000100:00100000:3.0:1788813406.382671:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+12:5602:x1875706562755968:12345-192.168.204.47@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813406.383409:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+12:5602:x1875706562755968:12345-192.168.204.47@tcp:503:ll_cfg_requeue.0 Request processed in 745us (15294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813406.383419:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 239 00000100:00100000:3.0:1788813406.383763:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788813406.383773:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583764608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813406.383786:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813406.383808:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908750ad1c00/0x6d74dbab2ddb189c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb1895 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813406.383853:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908750ad1c00/0x6d74dbab2ddb189c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1895 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813406.383934:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908750ad1c00/0x6d74dbab2ddb189c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1895 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813406.383945:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad1c00, rc 0) 00000100:00100000:3.0:1788813406.384020:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:5846:x1875706583764608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 250us (17213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813406.384027:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788813406.384118:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583764608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813406.384141:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908740030000/0x6d74dbab2ddb1895 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb189c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813406.384151:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908740030000/0x6d74dbab2ddb1895 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb189c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813406.384247:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773adaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583764736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813406.384292:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813406.403551:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c0b7900 going to sleep for 11 seconds 00000100:00100000:0.0:1788813406.408297:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583764736 00000100:00100000:0.0:1788813406.408316:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583764736 00000100:00100000:0.0:1788813406.408656:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788813406.409440:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813406.409471:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562756096 00000100:00100000:3.0:1788813406.410021:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562756096 00000100:00100000:0.0:1788813406.410626:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:5846:x1875706583764736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813406.411129:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:5846:x1875706583764736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 605us (26833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813406.412555:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773adaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583764736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813406.412641:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773adaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583764864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813406.414314:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813406.414317:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 242 00000100:00100000:3.0:1788813406.414334:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+12:5602:x1875706562756096:12345-192.168.204.47@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788813406.414350:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c0b7900 going to sleep for 11 seconds 00010000:00010000:3.0:1788813406.414351:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813406.414371:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908750ad0600/0x6d74dbab2ddb18a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x31ee63787e483d6e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813406.414373:0:5844:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1788813406.414381:0:5844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00010000:00010000:3.0:1788813406.414400:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908750ad0600/0x6d74dbab2ddb18a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d6e expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813406.414411:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908750ad0600/0x6d74dbab2ddb18a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d6e expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813406.414420:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad0600, rc 0) 00000100:00100000:3.0:1788813406.414492:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781ccbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:5602:x1875706562756096:12345-192.168.204.47@tcp:101:ll_cfg_requeue.0 Request processed in 163us (5056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813406.414505:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 242 00000100:00100000:3.0:1788813406.414536:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583764864 00000100:00100000:3.0:1788813406.414545:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583764864 00000100:00100000:3.0:1788813406.414570:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788813406.414576:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+20:5846:x1875706583764864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813406.414796:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+20:5846:x1875706583764864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 219us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813406.414804:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788813406.415822:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773adaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583764864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813406.418025:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000040:00080000:2.0:1788813406.418121:0:11249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788813406.418689:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788813406.418794:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788813406.418807:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740030000/0x6d74dbab2ddb1895 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb189c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813406.418821:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908740030000/0x6d74dbab2ddb1895 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb189c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813406.422871:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813406.422920:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562756224 00000100:00100000:0.0:1788813406.422933:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562756224 00000100:00100000:0.0:1788813406.422989:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 244 00000100:00100000:0.0:1788813406.422999:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:5602:x1875706562756224:12345-192.168.204.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813406.423329:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:5602:x1875706562756224:12345-192.168.204.47@tcp:501:ll_cfg_requeue.0 Request processed in 329us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813406.423337:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 244 00000100:00100000:1.0:1788813406.427737:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813406.427821:0:11247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562756352 00000100:00100000:3.0:1788813406.427832:0:11247:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562756352 00000100:00100000:3.0:1788813406.427893:0:11247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 245 00000100:00100000:3.0:1788813406.427904:0:11247:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:5602:x1875706562756352:12345-192.168.204.47@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813406.428150:0:11247:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:5602:x1875706562756352:12345-192.168.204.47@tcp:503:ll_cfg_requeue.0 Request processed in 247us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813406.428157:0:11247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 245 00010000:00010000:1.0:1788813406.909869:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813407.932768:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583764992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813407.932840:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813407.932938:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583764992 00000100:00100000:0.0:1788813407.932948:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583764992 00000100:00100000:0.0:1788813407.933005:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788813407.933015:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583764992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813407.933053:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813407.933113:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583764992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813407.933119:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788813407.933156:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788813407.933190:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e5ea300 x1875706583764992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813407.933217:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583764992:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788813407.934391:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788813408.919274:0:11394:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg447-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788813408.958344:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813409.162237:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813409.162286:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813409.162367:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562756480 00000100:00100000:3.0:1788813409.162379:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562756480 00000100:00100000:3.0:1788813409.162440:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 246 00000100:00100000:3.0:1788813409.162451:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2360:x1875706562756480:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813409.162937:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813409.163064:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2360:x1875706562756480:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 613us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813409.163074:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 246 00000100:00100000:2.0:1788813409.171080:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562756736 00000100:00100000:2.0:1788813409.171093:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562756736 00000100:00100000:1.0:1788813409.171179:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562756608 00000100:00100000:1.0:1788813409.171184:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562756608 00000100:00100000:1.0:1788813409.171257:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 96 00000100:00100000:1.0:1788813409.171269:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+6:2360:x1875706562756608:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813409.171357:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+6:2360:x1875706562756608:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 91us (8421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813409.171364:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 96 00000100:00080000:0.0:1788813409.177622:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813409.180874:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 97 00000100:00100000:1.0:1788813409.180893:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa21be5-2246-40d3-8e20-d34501daf545+5:2360:x1875706562756736:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813409.181021:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa21be5-2246-40d3-8e20-d34501daf545+5:2360:x1875706562756736:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 133us (18734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813409.181030:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 97 00000100:00080000:0.0:1788813409.181108:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813409.469204:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908761eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583765248:0@lo:400:kworker.0 00000100:00100000:3.0:1788813409.469310:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813409.469378:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583765760:0@lo:400:kworker.0 00000100:00100000:3.0:1788813409.469406:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813409.469437:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813409.469444:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908761eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583765376:0@lo:400:kworker.0 00000100:00100000:3.0:1788813409.469464:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813409.469495:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583765248 00000100:00100000:3.0:1788813409.469502:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583765248 00000100:00100000:3.0:1788813409.469547:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583765376 00000100:00100000:3.0:1788813409.469550:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583765376 00000100:00100000:3.0:1788813409.469609:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788813409.469619:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583765248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813409.469676:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583765248:12345-0@lo:400:kworker.0 Request processed in 58us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813409.469684:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788813409.469704:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788813409.469710:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583765376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813409.469737:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583765376:12345-0@lo:400:kworker.0 Request processed in 28us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813409.469743:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788813409.469780:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908761eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583765376:0@lo:400:kworker.0 00000100:00100000:3.0:1788813409.469789:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908761eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583765248:0@lo:400:kworker.0 00000100:00100000:0.0:1788813409.469911:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583765760 00000100:00100000:0.0:1788813409.469916:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583765760 00000100:00100000:0.0:1788813409.469949:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788813409.469956:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583765760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813409.470000:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583765760:12345-0@lo:400:kworker.0 Request processed in 45us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813409.470007:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1788813409.470028:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788813409.470033:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788813409.470060:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3ef480 x1875706583765760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813409.470082:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583765760:0@lo:400:kworker.0 00000100:00100000:2.0:1788813409.470165:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583765504:0@lo:400:kworker.0 00000100:00100000:2.0:1788813409.470202:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813409.470235:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788813409.470242:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908761eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583765120:0@lo:400:kworker.0 00000100:00100000:2.0:1788813409.470270:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813409.470291:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875706583765632:0@lo:400:kworker.0 00000100:00100000:2.0:1788813409.470312:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813409.471404:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583765632 00000100:00100000:1.0:1788813409.471416:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583765632 00000100:00100000:1.0:1788813409.471472:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788813409.471481:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773adb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875706583765632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813409.471549:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773adb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875706583765632:12345-0@lo:400:kworker.0 Request processed in 70us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813409.471555:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788813409.471640:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583765504 00000100:00100000:0.0:1788813409.471645:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583765504 00000100:00100000:0.0:1788813409.471678:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788813409.471684:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583765504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813409.471718:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583765504:12345-0@lo:400:kworker.0 Request processed in 34us (1516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813409.471724:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788813409.471743:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788813409.471747:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813409.471835:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875706583765632:0@lo:400:kworker.0 00010000:00080000:2.0:1788813409.471848:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3ed500 x1875706583765504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813409.471859:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583765504:0@lo:400:kworker.0 00000100:00100000:3.0:1788813409.471976:0:11247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583765120 00000100:00100000:3.0:1788813409.471981:0:11247:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583765120 00000100:00100000:3.0:1788813409.472012:0:11247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788813409.472018:0:11247:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3318:x1875706583765120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813409.472052:0:11247:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781ccb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3318:x1875706583765120:12345-0@lo:400:kworker.0 Request processed in 35us (1781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813409.472071:0:11247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788813409.472171:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908761eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583765120:0@lo:400:kworker.0 00010000:00010000:1.0:1788813409.983293:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813409.992013:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788813409.992051:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583765888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813409.992148:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813409.992299:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583765888 00000100:00100000:1.0:1788813409.992307:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583765888 00000100:00100000:1.0:1788813409.992362:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788813409.992373:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583765888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788813409.992434:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813409.992500:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583765888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813409.992507:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788813409.993208:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff908773adb100 x1875706583765888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813409.993229:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583765888:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788813411.005209:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813412.029599:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788813412.861071:0:11493:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 16:36:51 (1788813411) === 00000100:00100000:1.0:1788813413.052801:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813413.052836:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583766016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813413.052940:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813413.053340:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583766016 00000100:00100000:0.0:1788813413.053352:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583766016 00000100:00100000:0.0:1788813413.053439:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788813413.053451:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583766016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813413.053507:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813413.053573:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583766016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813413.053618:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1788813413.053665:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e5eb100 x1875706583766016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813413.053692:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583766016:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788813413.054062:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788813413.055360:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813413.113228:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813413.114131:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813413.114281:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562756992 00000100:00100000:0.0:1788813413.114294:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562756992 00000100:00100000:0.0:1788813413.114373:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 0 00000100:00100000:0.0:1788813413.114386:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e90f6370-8c16-4659-9369-1cd146993b4c+6:9682:x1875706562756992:12345-192.168.204.47@tcp:700:mkdir.0 00000100:00100000:0.0:1788813413.114483:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e90f6370-8c16-4659-9369-1cd146993b4c+6:9682:x1875706562756992:12345-192.168.204.47@tcp:700:mkdir.0 Request processed in 100us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813413.114491:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 0 00000100:00080000:2.0:1788813413.114976:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813413.115999:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562756864 00000100:00100000:1.0:1788813413.116010:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562756864 00000100:00100000:0.0:1788813413.116655:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 14 00000100:00100000:0.0:1788813413.116667:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:2359:x1875706562756864:12345-192.168.204.47@tcp:41:mkdir.0 00000004:00000024:0.0:1788813413.116710:0:5851:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788813413.116808:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:2359:x1875706562756864:12345-192.168.204.47@tcp:41:mkdir.0 Request processed in 142us (3591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813413.116814:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 14 00000100:00100000:2.0:1788813413.117623:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813413.117722:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562757248 00000100:00100000:2.0:1788813413.117731:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562757248 00000100:00100000:2.0:1788813413.117770:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 15 00000100:00100000:2.0:1788813413.117780:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e450380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+6:9682:x1875706562757248:12345-192.168.204.47@tcp:36:mkdir.0 00010000:00010000:2.0:1788813413.117827:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813413.117894:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb178b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483cf0 expref: 6 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.117913:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908743ce0300) 00010000:00010000:2.0:1788813413.117925:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813413.118277:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb18aa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.118291:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb18aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.118302:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb18aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.118333:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb18b1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.118353:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb18b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.118360:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb18b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813413.119866:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788813413.119888:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb18aa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.119898:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb18aa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.119905:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb18aa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.119911:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813413.119916:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb18aa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.119923:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb18aa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.119938:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908743ce0500) 00010000:00010000:2.0:1788813413.119941:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813413.119946:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb18aa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.119951:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb18aa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788813413.119981:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7f2ea93 reply state 00000000689cc5e7 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb18b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813413.119990:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788813413.120119:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e450380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+7:9682:x1875706562757248:12345-192.168.204.47@tcp:36:mkdir.0 Request processed in 2337us (2496us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788813413.120127:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 15 00010000:00010000:1.0:1788813413.124835:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb18b1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.124856:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb18b1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.124865:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb18b1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.124872:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368e00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813413.124877:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb18b1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.124885:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb18b1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.124906:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff908743ce0f00) 00010000:00010000:1.0:1788813413.124909:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813413.124921:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb18b1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.124928:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb18b1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813413.141806:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813413.142268:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562757376 00000100:00100000:0.0:1788813413.142283:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562757376 00000100:00100000:0.0:1788813413.142365:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 16 00000100:00100000:0.0:1788813413.142377:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:9683:x1875706562757376:12345-192.168.204.47@tcp:101:chmod.0 00010000:00010000:0.0:1788813413.142402:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813413.142437:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb18b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483d75 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.142519:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb18bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.142537:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb18bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.142906:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb18bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813413.142949:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788813413.142952:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788813413.142989:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb18bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.143015:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb18b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d75 expref: 8 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.144170:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb18bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d75 expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.144186:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90874a4cb600) 00010000:00010000:0.0:1788813413.144189:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788813413.144193:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740031000, rc 0) 00000100:00100000:0.0:1788813413.144281:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e453b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+7:9683:x1875706562757376:12345-192.168.204.47@tcp:101:chmod.0 Request processed in 1905us (2488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813413.144290:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 16 00000100:00100000:2.0:1788813413.153971:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813413.154024:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562757632 00000100:00100000:3.0:1788813413.154033:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562757632 00000100:00100000:3.0:1788813413.154119:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 17 00000100:00100000:3.0:1788813413.154130:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+7:9683:x1875706562757632:12345-192.168.204.47@tcp:36:chmod.0 00010000:00010000:3.0:1788813413.154311:0:8269:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813413.154353:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb18bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d75 expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.154376:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90874a4cb600) 00010000:00010000:3.0:1788813413.154389:0:8269:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813413.154416:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb18c6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.154430:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb18c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.154440:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb18c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813413.156767:0:8269:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ff2c88f reply state 0000000092d24027 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb18c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813413.156787:0:8269:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788813413.156802:0:8269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788813413.156928:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+8:9683:x1875706562757632:12345-192.168.204.47@tcp:36:chmod.0 Request processed in 2795us (2963us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788813413.156938:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 17 00010000:00010000:2.0:1788813413.162199:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb18c6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.162221:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb18c6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.162229:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb18c6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.162234:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813413.162239:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb18c6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.162247:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb18c6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.162268:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908745acaa00) 00010000:00010000:2.0:1788813413.162271:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788813413.162276:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb18c6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.162302:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb18c6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813413.201091:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813413.201622:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562757760 00000100:00100000:0.0:1788813413.201635:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562757760 00000100:00100000:0.0:1788813413.201715:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 18 00000100:00100000:0.0:1788813413.201726:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+7:9684:x1875706562757760:12345-192.168.204.47@tcp:101:chown.0 00010000:00010000:0.0:1788813413.201755:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813413.201779:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb18cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483d7c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.201871:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb18d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.201884:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb18d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.201894:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb18d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813413.201928:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788813413.201931:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788813413.201970:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb18d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.201996:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb18cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d7c expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.202012:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb18d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d7c expref: 8 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.202020:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90874a4cb100) 00010000:00010000:0.0:1788813413.202023:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788813413.202045:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740031000, rc 0) 00000100:00100000:0.0:1788813413.202121:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+8:9684:x1875706562757760:12345-192.168.204.47@tcp:101:chown.0 Request processed in 396us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813413.202128:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 18 00000100:00100000:0.0:1788813413.222897:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813413.222996:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562757888 00000100:00100000:2.0:1788813413.223007:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562757888 00000100:00100000:2.0:1788813413.223087:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 19 00000100:00100000:2.0:1788813413.223098:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+8:9684:x1875706562757888:12345-192.168.204.47@tcp:101:chown.0 00010000:00010000:2.0:1788813413.223123:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813413.223160:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb18db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483d83 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.223232:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb18e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.223249:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb18e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.223260:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb18e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.223275:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb18e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.223281:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb18e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.223287:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb18e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.223395:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb18f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.223403:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb18f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.223409:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb18f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813413.223440:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788813413.223444:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788813413.223466:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb18f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.223477:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb18e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.223484:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb18e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.223490:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb18e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.223497:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813413.223502:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb18e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.223509:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb18e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.223520:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90874a4cb100) 00010000:00010000:2.0:1788813413.223528:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813413.223534:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb18e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.223540:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb18e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.223554:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb18e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.223560:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb18e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.223566:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb18e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.223571:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813413.223574:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb18e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.223630:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb18e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.223640:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff908743ce0500) 00010000:00010000:2.0:1788813413.223642:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813413.223645:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb18e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.223651:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb18e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.223690:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb18db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d83 expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.223717:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb18f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d83 expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.223724:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff908743ce0300) 00010000:00010000:2.0:1788813413.223726:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813413.223745:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369e00, rc 0) 00000100:00100000:2.0:1788813413.223805:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+9:9684:x1875706562757888:12345-192.168.204.47@tcp:101:chown.0 Request processed in 709us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813413.223812:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 19 00000100:00100000:1.0:1788813413.228384:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813413.228518:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562758144 00000100:00100000:0.0:1788813413.233745:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562758144 00000100:00100000:0.0:1788813413.233852:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 20 00000100:00100000:0.0:1788813413.233863:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c233100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+9:9684:x1875706562758144:12345-192.168.204.47@tcp:36:chown.0 00010000:00010000:0.0:1788813413.233922:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813413.233950:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb18f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d83 expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.233970:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff908743ce0300) 00010000:00010000:0.0:1788813413.233983:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813413.234012:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb18f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.234025:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb18f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.234054:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb18f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788813413.278343:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1788813413.278433:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f20dfa6e reply state 0000000019df4bc0 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb18f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813413.278446:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788813413.278461:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1788813413.278921:0:5849:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788813413.278947:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c233100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+7:9684:x1875706562758144:12345-192.168.204.47@tcp:36:chown.0 Request processed in 45082us (50569us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788813413.278956:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 20 00010000:00010000:1.0:1788813413.279108:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb18f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.279118:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb18f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.279127:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb18f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.279133:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813413.279137:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb18f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.279144:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb18f7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.279159:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:1.0:1788813413.279162:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788813413.279167:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb18f7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.279173:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb18f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813413.294765:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813413.294825:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562758272 00000100:00100000:3.0:1788813413.294851:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562758272 00000100:00100000:3.0:1788813413.294920:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 21 00000100:00100000:3.0:1788813413.294930:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+6:9685:x1875706562758272:12345-192.168.204.47@tcp:101:touch.500 00010000:00010000:3.0:1788813413.294957:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813413.294979:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb18fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483d8a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788813413.297883:0:5850:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2848us 00010000:00010000:3.0:1788813413.312570:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1e00/0x6d74dbab2ddb1905 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.312629:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1e00/0x6d74dbab2ddb1905 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.312642:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1e00/0x6d74dbab2ddb1905 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.312656:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb190c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.312662:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb190c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.312668:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb190c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.313283:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1913 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.313293:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.313309:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813413.313336:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788813413.313340:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813413.313377:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.313390:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1e00/0x6d74dbab2ddb1905 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.313396:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1e00/0x6d74dbab2ddb1905 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.313403:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1e00/0x6d74dbab2ddb1905 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.313409:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1e00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813413.313413:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1e00/0x6d74dbab2ddb1905 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.313421:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1e00/0x6d74dbab2ddb1905 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.313433:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90874a4cb100) 00010000:00010000:3.0:1788813413.313436:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813413.313441:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1e00/0x6d74dbab2ddb1905 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.313447:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1e00/0x6d74dbab2ddb1905 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.313469:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb190c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.313475:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb190c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.313481:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb190c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.313486:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813413.313488:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb190c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.313494:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb190c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.313503:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff908745aca600) 00010000:00010000:3.0:1788813413.313505:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813413.313508:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb190c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.313513:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb190c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.313551:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb18fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d8a expref: 8 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.313567:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1913 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d8a expref: 7 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.313609:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff908745acac00) 00010000:00010000:3.0:1788813413.313612:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788813413.313615:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad1000, rc 0) 00000100:00100000:3.0:1788813413.313706:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+7:9685:x1875706562758272:12345-192.168.204.47@tcp:101:touch.500 Request processed in 18776us (18952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813413.313715:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 21 00000100:00100000:2.0:1788813413.325171:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813413.325320:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562758528 00000100:00100000:1.0:1788813413.325361:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562758528 00000100:00100000:1.0:1788813413.325425:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 22 00000100:00100000:1.0:1788813413.327775:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+7:9685:x1875706562758528:12345-192.168.204.47@tcp:101:touch.500 00010000:00010000:1.0:1788813413.327806:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813413.328096:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ca00/0x6d74dbab2ddb191a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483d91 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.328784:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c600/0x6d74dbab2ddb1921 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.328803:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c600/0x6d74dbab2ddb1921 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.328818:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c600/0x6d74dbab2ddb1921 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.328916:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c000/0x6d74dbab2ddb1928 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.328926:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c000/0x6d74dbab2ddb1928 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.328932:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c000/0x6d74dbab2ddb1928 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788813413.330826:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788813413.331964:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb192f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.331985:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb192f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.332022:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb192f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.332076:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c600/0x6d74dbab2ddb1921 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.332084:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c600/0x6d74dbab2ddb1921 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.332102:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c600/0x6d74dbab2ddb1921 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.332108:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148c600 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813413.332113:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c600/0x6d74dbab2ddb1921 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.332121:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c600/0x6d74dbab2ddb1921 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.332136:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff908745acac00) 00010000:00010000:1.0:1788813413.332139:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813413.332144:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c600/0x6d74dbab2ddb1921 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.332150:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c600/0x6d74dbab2ddb1921 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788813413.332163:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd845a06 reply state 0000000031e35fa6 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c000/0x6d74dbab2ddb1928 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813413.332174:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788813413.332221:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ca00/0x6d74dbab2ddb191a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d91 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.332237:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb192f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d91 expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.332244:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff908746516800) 00010000:00010000:1.0:1788813413.332246:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813413.332249:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148d200, rc 0) 00000100:00100000:1.0:1788813413.332879:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+10:9685:x1875706562758528:12345-192.168.204.47@tcp:101:touch.500 Request processed in 7441us (7715us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788813413.332888:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 22 00010000:00010000:1.0:1788813413.336237:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c000/0x6d74dbab2ddb1928 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.336256:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c000/0x6d74dbab2ddb1928 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.336264:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c000/0x6d74dbab2ddb1928 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.336269:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148c000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813413.336287:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c000/0x6d74dbab2ddb1928 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.336296:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c000/0x6d74dbab2ddb1928 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.336314:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbcdd3602 (ffff908746516600) 00010000:00010000:1.0:1788813413.336317:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813413.336490:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c000/0x6d74dbab2ddb1928 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.336499:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c000/0x6d74dbab2ddb1928 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813413.346687:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813413.347133:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562758784 00000100:00100000:0.0:1788813413.347143:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562758784 00000100:00100000:0.0:1788813413.347297:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 23 00000100:00100000:0.0:1788813413.347323:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+9:9685:x1875706562758784:12345-192.168.204.47@tcp:36:touch.500 00010000:00010000:0.0:1788813413.347389:0:8269:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813413.347417:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb192f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d91 expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.347447:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff908746516800) 00010000:00010000:0.0:1788813413.347458:0:8269:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813413.347498:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb193d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.347513:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb193d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.347524:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb193d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813413.347714:0:8269:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062d11ccd reply state 00000000a552aa32 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb193d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813413.347724:0:8269:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788813413.347816:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+10:9685:x1875706562758784:12345-192.168.204.47@tcp:36:touch.500 Request processed in 495us (1139us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788813413.347824:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 23 00000100:00100000:0.0:1788813413.353633:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813413.355704:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562758912 00000100:00100000:1.0:1788813413.355724:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562758912 00000100:00100000:1.0:1788813413.355814:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 24 00000100:00100000:1.0:1788813413.355839:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+10:9685:x1875706562758912:12345-192.168.204.47@tcp:101:touch.500 00010000:00010000:1.0:1788813413.355872:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813413.355897:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ca00/0x6d74dbab2ddb1944 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483d98 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.355979:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ca00/0x6d74dbab2ddb1944 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d98 expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.356202:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ca00/0x6d74dbab2ddb1944 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d98 expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.356226:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90874a4cb800) 00010000:00010000:1.0:1788813413.356230:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788813413.356234:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148ca00, rc 0) 00000100:00100000:1.0:1788813413.356441:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+11:9685:x1875706562758912:12345-192.168.204.47@tcp:101:touch.500 Request processed in 614us (2820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813413.356448:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 24 00010000:00010000:2.0:1788813413.359519:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb193d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.359538:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb193d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.359547:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb193d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.359561:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740030a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813413.359568:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb193d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.359575:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb193d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.359617:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90874a4cb800) 00010000:00010000:2.0:1788813413.359640:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813413.359646:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb193d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.359652:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb193d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813413.365169:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813413.365336:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562759040 00000100:00100000:0.0:1788813413.365351:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562759040 00000100:00100000:0.0:1788813413.365415:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 16 00000100:00100000:0.0:1788813413.365424:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1875706562759040:12345-192.168.204.47@tcp:8:touch.500 00010000:00080000:0.0:1788813413.365464:0:6706:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e90f6370-8c16-4659-9369-1cd146993b4c@192.168.204.47@tcp t0 exp 0000000000000000 cur 355 last 0 00000020:00000080:0.0:1788813413.365521:0:6706:0:(genops.c:1384:class_connect()) connect: client e90f6370-8c16-4659-9369-1cd146993b4c, cookie 0x6d74dbab2ddb194b 00002000:00100000:0.0:1788813413.365536:0:6706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e90f6370-8c16-4659-9369-1cd146993b4c/ffff908749daa800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788813413.365569:0:6706:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788813413.366083:0:6706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788813413.366339:0:6706:0:(import.c:65:import_set_state_nolock()) ffff908749da9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788813413.366436:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:2358:x1875706562759040:12345-192.168.204.47@tcp:8:touch.500 Request processed in 1010us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813413.366446:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 16 00000100:00100000:3.0:1788813413.373821:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813413.373937:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562759168 00000100:00100000:0.0:1788813413.373949:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562759168 00000100:00100000:0.0:1788813413.374115:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 17 00000100:00100000:0.0:1788813413.374125:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+6:0:x1875706562759168:12345-192.168.204.47@tcp:2:touch.500 00000100:00080000:2.0:1788813413.376097:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788813413.439011:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:2.0:1788813413.439043:0:7669:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e90f6370-8c16-4659-9369-1cd146993b4c 00000100:00100000:2.0:1788813413.443061:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+5:0:x1875706562759168:12345-192.168.204.47@tcp:2:touch.500 Request processed in 68924us (69241us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788813413.443075:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 17 00000100:00100000:3.0:1788813413.449358:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813413.455234:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562759424 00000100:00100000:0.0:1788813413.455253:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562759424 00000100:00100000:0.0:1788813413.455340:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 2 00000100:00100000:3.0:1788813413.456742:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+10:9685:x1875706562759424:12345-192.168.204.47@tcp:35:touch.500 00000100:00100000:3.0:1788813413.457498:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+11:9685:x1875706562759424:12345-192.168.204.47@tcp:35:touch.500 Request processed in 2142us (8149us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788813413.457514:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 2 00000100:00100000:1.0:1788813413.490627:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813413.491752:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562759552 00000100:00100000:3.0:1788813413.491767:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562759552 00000100:00100000:3.0:1788813413.491842:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 25 00000100:00100000:3.0:1788813413.491855:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+11:9686:x1875706562759552:12345-192.168.204.47@tcp:101:rm.0 00010000:00010000:3.0:1788813413.491881:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813413.491903:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1952 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483d9f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.491978:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1959 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.491991:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.492047:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813413.492086:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788813413.492090:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813413.492136:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.492167:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1952 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d9f expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.492186:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1959 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d9f expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.492195:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff908745acac00) 00010000:00010000:3.0:1788813413.492197:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788813413.492202:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad1a00, rc 0) 00000100:00100000:3.0:1788813413.492281:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+12:9686:x1875706562759552:12345-192.168.204.47@tcp:101:rm.0 Request processed in 430us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813413.492289:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 25 00000100:00100000:3.0:1788813413.497881:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813413.498338:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562759808 00000100:00100000:0.0:1788813413.498353:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562759808 00000100:00100000:0.0:1788813413.498428:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 26 00000100:00100000:0.0:1788813413.498439:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+12:9686:x1875706562759808:12345-192.168.204.47@tcp:101:rm.0 00010000:00010000:0.0:1788813413.498461:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813413.498490:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031800/0x6d74dbab2ddb1960 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483da6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813413.498632:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788813413.498816:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031800/0x6d74dbab2ddb1960 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483da6 expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.498844:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90874a4cb100) 00010000:00010000:0.0:1788813413.498847:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788813413.498853:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031800/0x6d74dbab2ddb1960 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483da6 expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.498866:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740031800, rc 0) 00000100:00100000:0.0:1788813413.498953:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+13:9686:x1875706562759808:12345-192.168.204.47@tcp:101:rm.0 Request processed in 515us (1084us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1788813413.498961:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 26 00000100:00100000:0.0:1788813413.517906:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813413.518038:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562759936 00000100:00100000:2.0:1788813413.518049:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562759936 00000100:00100000:2.0:1788813413.518107:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 3 00000100:00100000:2.0:1788813413.518117:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+13:9686:x1875706562759936:12345-192.168.204.47@tcp:37:rm.0 00000100:00100000:2.0:1788813413.524750:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+13:9686:x1875706562759936:12345-192.168.204.47@tcp:37:rm.0 Request processed in 6617us (6849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813413.524766:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 3 00000100:00100000:0.0:1788813413.542505:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813413.542669:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562760192 00000100:00100000:3.0:1788813413.542685:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562760192 00000100:00100000:3.0:1788813413.542769:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 4 00000100:00100000:3.0:1788813413.542783:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874adadc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+13:9686:x1875706562760192:12345-192.168.204.47@tcp:35:rm.0 00000100:00100000:3.0:1788813413.543789:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874adadc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+14:9686:x1875706562760192:12345-192.168.204.47@tcp:35:rm.0 Request processed in 1000us (1290us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788813413.543824:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 4 00000100:00100000:1.0:1788813413.561517:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813413.563894:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562760448 00000100:00100000:0.0:1788813413.563921:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562760448 00000100:00100000:0.0:1788813413.564040:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 27 00000100:00100000:0.0:1788813413.564056:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c231c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+14:9686:x1875706562760448:12345-192.168.204.47@tcp:101:rm.0 00010000:00010000:0.0:1788813413.564090:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813413.564120:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031800/0x6d74dbab2ddb196e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483dad expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.564268:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1975 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.564288:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1975 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.564304:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1975 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813413.564353:0:8269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788813413.564516:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031800/0x6d74dbab2ddb196e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dad expref: 17 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.564539:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1975 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dad expref: 16 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.564547:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff908745acac00) 00010000:00010000:0.0:1788813413.564550:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788813413.564556:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740030a00, rc 0) 00000100:00100000:0.0:1788813413.564711:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c231c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+16:9686:x1875706562760448:12345-192.168.204.47@tcp:101:rm.0 Request processed in 656us (3205us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788813413.564721:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 27 00000100:00100000:1.0:1788813413.574275:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813413.578714:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562760576 00000100:00100000:0.0:1788813413.578733:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562760576 00000100:00100000:2.0:1788813413.584558:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 28 00000100:00100000:2.0:1788813413.584576:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+16:9686:x1875706562760576:12345-192.168.204.47@tcp:41:rm.0 00000004:00000024:2.0:1788813413.584670:0:5851:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1788813413.584785:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+16:9686:x1875706562760576:12345-192.168.204.47@tcp:41:rm.0 Request processed in 210us (10519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813413.584792:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 28 00000100:00100000:1.0:1788813413.594263:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813413.596881:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562760704 00000100:00100000:3.0:1788813413.596898:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562760704 00000100:00100000:2.0:1788813413.597139:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 29 00000100:00100000:2.0:1788813413.597167:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+16:9686:x1875706562760704:12345-192.168.204.47@tcp:101:rm.0 00010000:00010000:2.0:1788813413.597188:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813413.597210:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb1983 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483db4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.597280:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb198a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.597309:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb198a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.597321:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb198a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.597337:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1991 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.597344:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1991 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.597350:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1991 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.597455:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1998 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.597464:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.597471:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813413.597513:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788813413.597517:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788813413.597537:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.597549:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.597558:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb198a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.597565:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb198a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.597572:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb198a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.597577:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368e00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813413.597603:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb198a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.597611:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb198a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.597623:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff908745acac00) 00010000:00010000:2.0:1788813413.597626:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813413.597631:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb198a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.597637:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb198a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.597662:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1991 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.597668:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1991 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.597674:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1991 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.597679:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813413.597681:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1991 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.597687:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1991 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.597695:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbcdd3602 (ffff908743ce0200) 00010000:00010000:2.0:1788813413.597697:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813413.597700:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1991 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.597706:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1991 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.597750:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb1983 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483db4 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.597766:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1998 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483db4 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.597785:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90874a4cb800) 00010000:00010000:2.0:1788813413.597787:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813413.597790:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369600, rc 0) 00000100:00100000:2.0:1788813413.597870:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+17:9686:x1875706562760704:12345-192.168.204.47@tcp:101:rm.0 Request processed in 706us (3619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813413.597878:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 29 00000100:00100000:3.0:1788813413.605676:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813413.605933:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562760960 00000100:00100000:1.0:1788813413.605945:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562760960 00000100:00100000:1.0:1788813413.606014:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 30 00000100:00100000:1.0:1788813413.606037:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+17:9686:x1875706562760960:12345-192.168.204.47@tcp:36:rm.0 00010000:00010000:1.0:1788813413.606107:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788813413.606141:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1998 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483db4 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.606165:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ca00/0x6d74dbab2ddb1944 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d98 expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.606177:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff90874a4cb800) 00010000:00010000:1.0:1788813413.606192:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1959 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d9f expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.606201:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff908745acac00) 00010000:00010000:1.0:1788813413.606204:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788813413.606227:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c000/0x6d74dbab2ddb199f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.606241:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c000/0x6d74dbab2ddb199f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.606253:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c000/0x6d74dbab2ddb199f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.606271:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb19a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.606294:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb19a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.606435:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb19a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.607201:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c600/0x6d74dbab2ddb19ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.607216:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c600/0x6d74dbab2ddb19ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.607226:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c600/0x6d74dbab2ddb19ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788813413.613024:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788813413.614004:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 355856421223ns, next at 356855476353ns, rc = 0 00010000:00010000:1.0:1788813413.614144:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb19b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.614165:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb19b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.614179:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb19b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.614189:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb19b4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.614195:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb19b4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.614221:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb19b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.614248:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813413.614282:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c600/0x6d74dbab2ddb19ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.614288:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c600/0x6d74dbab2ddb19ad lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.614295:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c600/0x6d74dbab2ddb19ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.614300:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148c600 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813413.614306:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c600/0x6d74dbab2ddb19ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.614313:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c600/0x6d74dbab2ddb19ad lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.614329:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff908746516600) 00010000:00010000:1.0:1788813413.614332:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788813413.614337:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c600/0x6d74dbab2ddb19ad lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.614342:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c600/0x6d74dbab2ddb19ad lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.614364:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c000/0x6d74dbab2ddb199f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.614370:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c000/0x6d74dbab2ddb199f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.614383:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c000/0x6d74dbab2ddb199f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.614387:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148c000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813413.614390:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c000/0x6d74dbab2ddb199f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.614396:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c000/0x6d74dbab2ddb199f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813413.614405:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff908745acac00) 00010000:00010000:1.0:1788813413.614408:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813413.614412:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c000/0x6d74dbab2ddb199f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.614416:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813413.614419:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c000/0x6d74dbab2ddb199f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.614426:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb19b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788813413.614432:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e8cf6b52 reply state 00000000421c4d09 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb19a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813413.614443:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788813413.614447:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148d800 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813413.614454:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb19b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.614462:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb19b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.614473:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff908746516600) 00010000:00010000:0.0:1788813413.614476:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788813413.614500:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb19b4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.614507:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb19b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813413.614525:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813413.614527:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813413.614529:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813413.614572:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+16:9686:x1875706562760960:12345-192.168.204.47@tcp:36:rm.0 Request processed in 8530us (8891us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788813413.614601:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 30 00010000:00010000:2.0:1788813413.623393:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb19a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.623418:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb19a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.623426:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb19a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.623432:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148d200 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813413.623438:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb19a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.623446:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb19a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.623468:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbcdd3602 (ffff908746516e00) 00010000:00010000:2.0:1788813413.623471:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813413.623478:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb19a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.623484:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb19a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813413.627842:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813413.628141:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562761216 00000100:00100000:2.0:1788813413.628152:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562761216 00000100:00100000:2.0:1788813413.628207:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 5 00000100:00100000:2.0:1788813413.628217:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+15:9686:x1875706562761216:12345-192.168.204.47@tcp:35:rm.0 00000100:00100000:2.0:1788813413.628449:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+16:9686:x1875706562761216:12345-192.168.204.47@tcp:35:rm.0 Request processed in 232us (617us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788813413.628457:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 5 00000100:00100000:2.0:1788813413.638989:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813413.639155:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562761472 00000100:00100000:3.0:1788813413.639169:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562761472 00000100:00100000:3.0:1788813413.639276:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 31 00000100:00100000:3.0:1788813413.639288:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+16:9686:x1875706562761472:12345-192.168.204.47@tcp:36:rm.0 00010000:00010000:3.0:1788813413.639355:0:8269:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788813413.639384:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1975 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dad expref: 16 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.639408:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1913 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d8a expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.639419:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff908745acac00) 00010000:00010000:3.0:1788813413.639434:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb18d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d7c expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.639443:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90874a4cb100) 00010000:00010000:3.0:1788813413.639450:0:8269:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813413.639471:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1e00/0x6d74dbab2ddb19bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.639483:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1e00/0x6d74dbab2ddb19bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.639510:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1e00/0x6d74dbab2ddb19bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.639523:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb19c2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.639530:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb19c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.639537:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb19c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.640190:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb19c9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.640202:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb19c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.640210:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb19c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813413.641342:0:8269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788813413.641365:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb19c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.641375:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb19c9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.641382:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb19c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.641389:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad0c00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813413.641403:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb19c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.641412:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb19c9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.641426:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff908745aca100) 00010000:00010000:3.0:1788813413.641430:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788813413.641435:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb19c9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.641442:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb19c9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.641468:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1e00/0x6d74dbab2ddb19bb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.641480:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1e00/0x6d74dbab2ddb19bb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.641485:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1e00/0x6d74dbab2ddb19bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.641490:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1e00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813413.641493:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1e00/0x6d74dbab2ddb19bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.641500:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1e00/0x6d74dbab2ddb19bb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.641507:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908745aca900) 00010000:00010000:3.0:1788813413.641510:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813413.641519:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1e00/0x6d74dbab2ddb19bb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813413.641524:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1e00/0x6d74dbab2ddb19bb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813413.641538:0:8269:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085ce2fc6 reply state 000000008e63c7ed transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb19c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813413.641547:0:8269:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788813413.642160:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+15:9686:x1875706562761472:12345-192.168.204.47@tcp:36:rm.0 Request processed in 2869us (3178us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788813413.642170:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 31 00010000:00010000:2.0:1788813413.647795:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb19c2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.647817:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb19c2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.647827:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb19c2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.647834:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad0000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813413.647839:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb19c2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.647847:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb19c2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.647863:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff908745aca600) 00010000:00010000:2.0:1788813413.647867:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813413.647873:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb19c2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813413.647898:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb19c2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813414.076832:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813414.281494:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813414.282056:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813414.282095:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813414.282130:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813414.282242:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562761728 00000100:00100000:2.0:1788813414.282253:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562761728 00000100:00100000:2.0:1788813414.282302:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562761984 00000100:00100000:2.0:1788813414.282305:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562761984 00000100:00100000:2.0:1788813414.282334:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 101 00000100:00100000:2.0:1788813414.282344:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+14:2361:x1875706562761728:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813414.282434:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+14:2361:x1875706562761728:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 91us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813414.282441:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 101 00000100:00100000:2.0:1788813414.282460:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 102 00000100:00100000:2.0:1788813414.282467:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa21be5-2246-40d3-8e20-d34501daf545+5:2361:x1875706562761984:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813414.282490:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa21be5-2246-40d3-8e20-d34501daf545+5:2361:x1875706562761984:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 25us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813414.282497:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 102 00000100:00080000:2.0:1788813414.282524:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813414.283575:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562761856 00000100:00100000:0.0:1788813414.283609:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562761856 00000100:00100000:0.0:1788813414.283672:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 57 00000100:00100000:0.0:1788813414.283683:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+5:2362:x1875706562761856:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813414.283752:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+5:2362:x1875706562761856:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 71us (1697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813414.283759:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 57 00000100:00100000:3.0:1788813414.284349:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562761600 00000100:00100000:3.0:1788813414.284357:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562761600 00000100:00100000:3.0:1788813414.284402:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 248 00000100:00100000:3.0:1788813414.284410:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2362:x1875706562761600:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:3.0:1788813414.284447:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2362:x1875706562761600:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 38us (2966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813414.284454:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 248 00000100:00100000:1.0:1788813414.588891:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583766272:0@lo:400:kworker.0 00000100:00100000:3.0:1788813414.588899:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583766528:0@lo:400:kworker.0 00000100:00100000:2.0:1788813414.588996:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd1fd158-af17-4a1b-8f0b-82e57114d008:3319:1875706583766144:0@lo:400:kworker.0 00000100:00100000:1.0:1788813414.594089:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813414.594152:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583766784:0@lo:400:kworker.0 00000100:00100000:1.0:1788813414.594184:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813414.594860:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813414.594874:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583766400:0@lo:400:kworker.0 00000100:00100000:1.0:1788813414.594918:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813414.594992:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583766784 00000100:00100000:1.0:1788813414.595003:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583766784 00000100:00100000:1.0:1788813414.595085:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788813414.595097:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583766784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813414.595156:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583766784:12345-0@lo:400:kworker.0 Request processed in 62us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813414.595163:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1788813414.595187:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788813414.595198:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583766272 00000100:00100000:1.0:1788813414.595201:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583766272 00000100:00100000:1.0:1788813414.596501:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583766400 00000100:00100000:1.0:1788813414.596513:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583766400 00000100:00100000:1.0:1788813414.596662:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788813414.596674:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583766272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813414.596741:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583766272:12345-0@lo:400:kworker.0 Request processed in 69us (2658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813414.596748:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788813414.596768:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788813414.596775:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583766400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813414.596804:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583766400:12345-0@lo:400:kworker.0 Request processed in 30us (1885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813414.596809:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1788813414.596829:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813414.596862:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583766400:0@lo:400:kworker.0 00000100:00100000:1.0:1788813414.596894:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583766272:0@lo:400:kworker.0 00000100:00100000:3.0:1788813414.596898:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788813414.596909:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3f2680 x1875706583766784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813414.596920:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583766784:0@lo:400:kworker.0 00000100:00100000:3.0:1788813414.596970:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583766528 00000100:00100000:3.0:1788813414.596975:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583766528 00000100:00100000:1.0:1788813414.597023:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788813414.597031:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583766528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813414.597073:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583766528:12345-0@lo:400:kworker.0 Request processed in 43us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813414.597079:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1788813414.598197:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3f1c00 x1875706583766528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813414.598216:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583766528:0@lo:400:kworker.0 00000100:00100000:2.0:1788813414.599672:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813414.599745:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875706583766656:0@lo:400:kworker.0 00000100:00100000:2.0:1788813414.599802:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813414.599972:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583766656 00000100:00100000:1.0:1788813414.599984:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583766656 00000100:00100000:1.0:1788813414.600072:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788813414.600082:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875706583766656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813414.600141:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875706583766656:12345-0@lo:400:kworker.0 Request processed in 62us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813414.600149:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788813414.600192:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875706583766656:0@lo:400:kworker.0 00000100:00100000:3.0:1788813414.600286:0:11247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583766144 00000100:00100000:3.0:1788813414.600299:0:11247:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583766144 00000100:00100000:3.0:1788813414.600413:0:11247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788813414.600422:0:11247:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3319:x1875706583766144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813414.600469:0:11247:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781ccb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3319:x1875706583766144:12345-0@lo:400:kworker.0 Request processed in 48us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813414.600475:0:11247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788813414.600514:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd1fd158-af17-4a1b-8f0b-82e57114d008:3319:1875706583766144:0@lo:400:kworker.0 00000100:00080000:0.0:1788813414.601959:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1788813415.100803:0:8118:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 357343220008ns, next at 358343217436ns, rc = 0 00000100:00100000:1.0:1788813415.100839:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583766912:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788813415.101241:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813415.101497:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813415.102669:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583766912 00000100:00100000:0.0:1788813415.102682:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583766912 00000100:00100000:0.0:1788813415.102735:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788813415.102745:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583766912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788813415.102783:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813415.103085:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583766912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 340us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813415.103103:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788813415.104833:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877fbcb480 x1875706583766912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813415.104993:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583766912:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788813416.128142:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813417.152130:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813418.172693:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813418.175429:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813418.175456:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583767040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813418.175531:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813418.175628:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583767040 00000100:00100000:3.0:1788813418.175636:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583767040 00000100:00100000:3.0:1788813418.175685:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788813418.175694:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583767040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813418.175730:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813418.175774:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583767040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813418.175780:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1788813418.175814:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876eb71c00 x1875706583767040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813418.175832:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583767040:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788813418.176126:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1788813418.206147:0:11644:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:2.0:1788813418.744133:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967305 is committed 00000001:00080000:2.0:1788813418.744154:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:2.0:1788813418.744159:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:2.0:1788813418.744183:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788813418.744188:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:2.0:1788813418.744193:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1788813418.744989:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908643b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583767168:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788813418.745065:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813418.745786:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583767168 00000100:00100000:1.0:1788813418.745970:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583767168 00000100:00080000:2.0:1788813418.746135:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813418.746187:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788813418.746201:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583767168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788813418.746240:0:6705:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1788813418.746288:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9f2066, atime: 0x6a9f2066, ctime: 0x6a9f2066, blocks: 0x1 00010000:00010000:3.0:1788813418.746297:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c33b0b37/0x6d74dbab2ddb19d0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813418.746314:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=360s v=(0 0) 00010000:00010000:3.0:1788813418.746318:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813418.746325:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c33b0b37/0x6d74dbab2ddb19d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813418.746343:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c33b0b37/0x6d74dbab2ddb19d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813418.746353:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c33b0b37/0x6d74dbab2ddb19d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813418.746361:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c33b0b37/0x6d74dbab2ddb19d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813418.746380:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813418.747409:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813418.747419:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c33b0b37/0x6d74dbab2ddb19d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813418.747534:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad0c00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:2.0:1788813418.747539:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c33b0b37/0x6d74dbab2ddb19d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813418.747550:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c33b0b37/0x6d74dbab2ddb19d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813418.747573:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c33b0b37/0x6d74dbab2ddb19d0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813418.747607:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c33b0b37/0x6d74dbab2ddb19d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813418.747632:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813418.747641:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813418.747643:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813418.748793:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1875706583767168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2592us (3723us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788813418.748814:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:1.0:1788813418.748977:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff908643b4e300/2, rc 0, transno 4294967300 00000100:00100000:1.0:1788813418.748985:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908643b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583767168:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788813419.208784:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788813419.283497:0:11694:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd71f58f00 20000000:00000080:0.0:1788813419.283515:0:11694:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90876e5ffc00 uarg=0000000000000000 20000000:01000000:0.0:1788813419.283550:0:11694:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788813419.283556:0:11694:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788813419.283561:0:11694:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788813419.291282:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788813419.291534:0:11694:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788813419.296716:0:11694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788813419.296779:0:11694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788813419.296836:0:11694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788813419.296860:0:11694:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788813419.296885:0:11694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff908740031800/0x6d74dbab2ddb19d7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813419.296906:0:11694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90874148d600/0x6d74dbab2ddb1879 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1872 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813419.296925:0:11694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90874148c400/0x6d74dbab2ddb1887 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1880 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813419.296935:0:11694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff908740031e00/0x6d74dbab2ddb188e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d67 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813419.296943:0:11694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff908750ad1c00/0x6d74dbab2ddb189c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb1895 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813419.296950:0:11694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff908750ad0600/0x6d74dbab2ddb18a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d6e expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813419.296974:0:11694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff908740031800/0x6d74dbab2ddb19d7 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813419.297030:0:11694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff908750ad0600/0x6d74dbab2ddb18a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d6e expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813419.297046:0:11694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff908750ad0600/0x6d74dbab2ddb18a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d6e expref: 12 pid: 5841 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813419.297063:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ef480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11694:1875706583767296:192.168.204.47@tcp:104: 00010000:00010000:0.0:1788813419.297189:0:11694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff908750ad1c00/0x6d74dbab2ddb189c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb1895 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813419.297198:0:11694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff908750ad1c00/0x6d74dbab2ddb189c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1895 expref: 18 pid: 5841 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813419.297207:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ed500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11694:1875706583767424:0@lo:104: 00000100:00100000:0.0:1788813419.297268:0:11694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788813419.297314:0:11694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff908740031e00/0x6d74dbab2ddb188e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d67 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813419.297318:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583767424 00010000:00010000:0.0:1788813419.297323:0:11694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff908740031e00/0x6d74dbab2ddb188e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d67 expref: 12 pid: 5841 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813419.297327:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583767424 00000100:00100000:0.0:1788813419.297332:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9087739c9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11694:1875706583767552:192.168.204.47@tcp:104: 00010000:00010000:0.0:1788813419.297364:0:11694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90874148c400/0x6d74dbab2ddb1887 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb1880 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813419.297382:0:11694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90874148c400/0x6d74dbab2ddb1887 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1880 expref: 18 pid: 5843 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813419.297386:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788813419.297390:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9087739cb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11694:1875706583767680:0@lo:104: 00000100:00100000:3.0:1788813419.297395:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+3:11694:x1875706583767424:12345-0@lo:104: 00010000:00010000:3.0:1788813419.297408:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff908740030000/0x6d74dbab2ddb1895 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb189c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813419.297413:0:11694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788813419.297430:0:11694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90874148d600/0x6d74dbab2ddb1879 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb1872 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813419.297439:0:11694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90874148d600/0x6d74dbab2ddb1879 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1872 expref: 18 pid: 5844 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813419.297447:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9087739cb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11694:1875706583767808:0@lo:104: 00000100:00100000:0.0:1788813419.297468:0:11694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813419.297477:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876faa0480 going to sleep for 11 seconds 00010000:00010000:3.0:1788813419.297979:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788813419.297987:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+3:11694:x1875706583767424:12345-0@lo:104: Request processed in 593us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813419.297995:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788813419.298023:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788813419.298033:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583767680 00000100:00100000:3.0:1788813419.298036:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583767680 00000100:00100000:3.0:1788813419.298052:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583767808 00000100:00100000:3.0:1788813419.298055:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583767808 00000100:00100000:3.0:1788813419.298066:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788813419.298071:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+4:11694:x1875706583767680:12345-0@lo:104: 00010000:00010000:3.0:1788813419.298080:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb1880 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb1887 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.298120:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813419.298126:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1788813419.298130:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908740030000/0x6d74dbab2ddb1895 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb189c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813419.298131:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+4:11694:x1875706583767680:12345-0@lo:104: Request processed in 60us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813419.298137:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788813419.298138:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740030000 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:2.0:1788813419.298142:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908740030000/0x6d74dbab2ddb1895 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb189c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813419.298149:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1788813419.298151:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908740030000/0x6d74dbab2ddb1895 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb189c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813419.298154:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e70bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+3:11694:x1875706583767808:12345-0@lo:104: 10000000:00010000:2.0:1788813419.298159:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908740030000/0x6d74dbab2ddb1895 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb189c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813419.298162:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff908774368c00/0x6d74dbab2ddb1872 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb1879 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813419.298166:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788813419.298189:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788813419.298194:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e70bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+3:11694:x1875706583767808:12345-0@lo:104: Request processed in 40us (725us total) trans 0 rc 0/0 00010000:00010000:2.0:1788813419.298194:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff908740030000/0x6d74dbab2ddb1895 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb189c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813419.298199:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1788813419.298201:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813419.298221:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908740030000/0x6d74dbab2ddb1895 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb189c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.298227:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908740030000/0x6d74dbab2ddb1895 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb189c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.298239:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788813419.298242:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb1880 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb1887 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.298258:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148d400 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:2.0:1788813419.298261:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb1880 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb1887 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.298268:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb1880 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb1887 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813419.298274:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb1880 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb1887 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813419.298279:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788813419.298294:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb1880 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1887 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.298299:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813419.298305:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb1880 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1887 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.298311:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff90874148d400/0x6d74dbab2ddb1880 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1887 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.298320:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813419.298323:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908774368c00/0x6d74dbab2ddb1872 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb1879 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.298329:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368c00 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:2.0:1788813419.298332:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908774368c00/0x6d74dbab2ddb1872 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb1879 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.298352:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908774368c00/0x6d74dbab2ddb1872 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb1879 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813419.298358:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908774368c00/0x6d74dbab2ddb1872 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb1879 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813419.298363:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788813419.298387:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff908774368c00/0x6d74dbab2ddb1872 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1879 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.298394:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788813419.298420:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908774368c00/0x6d74dbab2ddb1872 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1879 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.298428:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908774368c00/0x6d74dbab2ddb1872 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb1879 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.298444:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813419.298446:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813419.298448:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813419.298454:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813419.298468:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583767936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813419.298500:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813419.298531:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813419.298537:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583768064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813419.298557:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813419.298610:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813419.298619:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd1fd158-af17-4a1b-8f0b-82e57114d008:3319:1875706583768192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813419.298652:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813419.298679:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583767936 00000100:00100000:2.0:1788813419.298683:0:8477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583767936 00010000:00010000:2.0:1788813419.298704:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff908750ad1c00/0x6d74dbab2ddb189c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1895 expref: 19 pid: 5841 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813419.298723:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583768064 00000100:00100000:2.0:1788813419.298726:0:8477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583768064 00010000:00010000:2.0:1788813419.298734:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90874148c400/0x6d74dbab2ddb1887 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1880 expref: 20 pid: 5843 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813419.298743:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583768192 00000100:00100000:2.0:1788813419.298745:0:8477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583768192 00010000:00010000:2.0:1788813419.298751:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90874148d600/0x6d74dbab2ddb1879 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1872 expref: 21 pid: 5844 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813419.298762:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788813419.298768:0:8477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c0c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd1fd158-af17-4a1b-8f0b-82e57114d008+21:3320:x1875706583767936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813419.298777:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813419.298781:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff908750ad1c00/0x6d74dbab2ddb189c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1895 expref: 21 pid: 5841 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.298789:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff908750ad1c00/0x6d74dbab2ddb189c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1895 expref: 21 pid: 5841 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.298822:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813419.298851:0:8477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c0c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd1fd158-af17-4a1b-8f0b-82e57114d008+21:3320:x1875706583767936:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813419.298858:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788813419.298872:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788813419.298885:0:8477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c0caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd1fd158-af17-4a1b-8f0b-82e57114d008+20:3320:x1875706583768064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813419.298893:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813419.298897:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90874148c400/0x6d74dbab2ddb1887 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1880 expref: 20 pid: 5843 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.298905:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90874148c400/0x6d74dbab2ddb1887 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1880 expref: 20 pid: 5843 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.298925:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813419.298948:0:8477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c0caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd1fd158-af17-4a1b-8f0b-82e57114d008+20:3320:x1875706583768064:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813419.298954:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788813419.298969:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788813419.298975:0:8477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3319:x1875706583768192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813419.298982:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813419.298986:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90874148d600/0x6d74dbab2ddb1879 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1872 expref: 19 pid: 5844 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.298994:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90874148d600/0x6d74dbab2ddb1879 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb1872 expref: 19 pid: 5844 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.299002:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813419.299026:0:8477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3319:x1875706583768192:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813419.299031:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788813419.299115:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd1fd158-af17-4a1b-8f0b-82e57114d008:3319:1875706583768192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813419.299138:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583768064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813419.299145:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583767936:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813419.299259:0:11694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908750ad1c00/0x6d74dbab2ddb189c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb1895 expref: 18 pid: 5841 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813419.299270:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ed500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11694:1875706583767424:0@lo:104: 00010000:00010000:0.0:1788813419.299280:0:11694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90874148c400/0x6d74dbab2ddb1887 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb1880 expref: 17 pid: 5843 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813419.299289:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9087739cb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11694:1875706583767680:0@lo:104: 00010000:00010000:0.0:1788813419.299297:0:11694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90874148d600/0x6d74dbab2ddb1879 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb1872 expref: 16 pid: 5844 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813419.299305:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9087739cb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11694:1875706583767808:0@lo:104: 00010000:00010000:1.0:1788813419.301289:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813419.304899:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813419.304949:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813419.304978:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562762112 00000100:00100000:2.0:1788813419.304987:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562762112 00010000:00010000:2.0:1788813419.305027:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff908750ad0600/0x6d74dbab2ddb18a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d6e expref: 13 pid: 5841 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813419.305071:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562762240 00000100:00100000:2.0:1788813419.305074:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562762240 00010000:00010000:2.0:1788813419.305087:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff908740031e00/0x6d74dbab2ddb188e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d67 expref: 14 pid: 5841 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813419.305106:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 33 00000100:00100000:2.0:1788813419.305115:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c0c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+14:2359:x1875706562762112:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813419.305130:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813419.305136:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff908750ad0600/0x6d74dbab2ddb18a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d6e expref: 14 pid: 5841 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.305149:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff908750ad0600/0x6d74dbab2ddb18a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d6e expref: 14 pid: 5841 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.305172:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813419.305234:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c0c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+14:2359:x1875706562762112:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 119us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813419.305241:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 33 00000100:00100000:2.0:1788813419.305259:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 34 00000100:00100000:2.0:1788813419.305266:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c0c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2359:x1875706562762240:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813419.305273:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813419.305292:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff908740031e00/0x6d74dbab2ddb188e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d67 expref: 13 pid: 5841 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.305302:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff908740031e00/0x6d74dbab2ddb188e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d67 expref: 13 pid: 5841 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.305315:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff908740031800/0x6d74dbab2ddb19d7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.305325:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908740031800/0x6d74dbab2ddb19d7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.305341:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff908740031800/0x6d74dbab2ddb19d7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.305350:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff908740031800/0x6d74dbab2ddb19d7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.305357:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff908740031800/0x6d74dbab2ddb19d7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.305364:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff908740031800/0x6d74dbab2ddb19d7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.305371:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031800 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:2.0:1788813419.305375:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff908740031800/0x6d74dbab2ddb19d7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.305384:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff908740031800/0x6d74dbab2ddb19d7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.305394:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff908740031800/0x6d74dbab2ddb19d7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813419.305409:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813419.305430:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c0c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2359:x1875706562762240:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 163us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813419.305436:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 34 00010000:00010000:0.0:1788813419.309188:0:11694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908750ad0600/0x6d74dbab2ddb18a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d6e expref: 12 pid: 5841 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813419.309238:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ef480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11694:1875706583767296:192.168.204.47@tcp:104: 00010000:00010000:0.0:1788813419.309256:0:11694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908740031e00/0x6d74dbab2ddb188e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d67 expref: 11 pid: 5841 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813419.309265:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9087739c9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11694:1875706583767552:192.168.204.47@tcp:104: 00010000:00010000:0.0:1788813419.309307:0:11694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff908740031800/0x6d74dbab2ddb19d7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813419.309321:0:11694:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff908740031800/0x6d74dbab2ddb19d7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813419.309327:0:11694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff908740031800/0x6d74dbab2ddb19d7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813419.309333:0:11694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908740031800/0x6d74dbab2ddb19d7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813419.394873:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813419.394963:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562762368 00000100:00100000:1.0:1788813419.394973:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562762368 00000100:00100000:1.0:1788813419.395051:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 106 00000100:00100000:1.0:1788813419.395063:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+5:2359:x1875706562762368:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813419.395145:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+5:2359:x1875706562762368:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 84us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813419.395152:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 106 00000100:00080000:3.0:1788813419.395391:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813419.397649:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813419.397783:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813419.397812:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562762496 00000100:00100000:1.0:1788813419.397821:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562762496 00000100:00100000:1.0:1788813419.397882:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 60 00000100:00100000:1.0:1788813419.397896:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+5:2360:x1875706562762496:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813419.397975:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+5:2360:x1875706562762496:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 83us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813419.397983:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 60 00000100:00100000:1.0:1788813419.398009:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562762624 00000100:00100000:1.0:1788813419.398013:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562762624 00000100:00100000:1.0:1788813419.398040:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 107 00000100:00100000:1.0:1788813419.398047:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa21be5-2246-40d3-8e20-d34501daf545+5:2360:x1875706562762624:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813419.398093:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa21be5-2246-40d3-8e20-d34501daf545+5:2360:x1875706562762624:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 47us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813419.398101:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 107 00000100:00080000:1.0:1788813419.398126:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788813419.398131:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788813419.709024:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583768448:0@lo:400:kworker.0 00000100:00100000:1.0:1788813419.709106:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813419.709190:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813419.709197:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583768576:0@lo:400:kworker.0 00000100:00100000:1.0:1788813419.709220:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813419.709252:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583768448 00000100:00100000:1.0:1788813419.709259:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583768448 00000100:00100000:1.0:1788813419.709314:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788813419.709325:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583768448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813419.709378:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583768448:12345-0@lo:400:kworker.0 Request processed in 56us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813419.709385:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788813419.709421:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583768576 00000100:00100000:1.0:1788813419.709425:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583768576 00000100:00100000:3.0:1788813419.709537:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875706583768704:0@lo:400:kworker.0 00000100:00100000:3.0:1788813419.709569:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813419.709619:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788813419.709624:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908643b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875706583768320:0@lo:400:kworker.0 00000100:00100000:3.0:1788813419.709645:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813419.709663:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583768832:0@lo:400:kworker.0 00000100:00100000:3.0:1788813419.709681:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813419.709710:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583768704 00000100:00100000:3.0:1788813419.709714:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583768704 00000100:00100000:3.0:1788813419.709741:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583768320 00000100:00100000:3.0:1788813419.709743:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583768320 00000100:00100000:3.0:1788813419.709756:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788813419.709762:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875706583768704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813419.709797:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875706583768704:12345-0@lo:400:kworker.0 Request processed in 35us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813419.709803:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788813419.709815:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788813419.709821:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875706583768320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813419.709846:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875706583768320:12345-0@lo:400:kworker.0 Request processed in 25us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813419.709852:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788813419.709873:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583768832 00000100:00100000:3.0:1788813419.709876:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583768832 00000100:00100000:3.0:1788813419.709900:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788813419.709919:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1875706583768832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813419.709969:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1875706583768832:12345-0@lo:400:kworker.0 Request processed in 63us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813419.709975:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788813419.710017:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908643b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875706583768320:0@lo:400:kworker.0 00000100:00100000:3.0:1788813419.710027:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583768832:0@lo:400:kworker.0 00000100:00100000:3.0:1788813419.710035:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875706583768704:0@lo:400:kworker.0 00000100:00080000:3.0:1788813419.710208:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813419.710237:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583768448:0@lo:400:kworker.0 00000100:00100000:1.0:1788813419.713936:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788813419.713958:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583768576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813419.714087:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583768576:12345-0@lo:400:kworker.0 Request processed in 131us (4857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813419.714095:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1788813419.714668:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c3f1180 x1875706583768576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813419.714686:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583768576:0@lo:400:kworker.0 00010000:00010000:2.0:1788813420.221107:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813420.221404:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813420.221442:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583768960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813420.221545:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813420.221823:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583768960 00000100:00100000:3.0:1788813420.221832:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583768960 00000100:00100000:3.0:1788813420.221922:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788813420.221932:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1875706583768960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813420.221979:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813420.222031:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1875706583768960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813420.222038:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1788813420.222746:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788813420.222805:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583768960:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1788813420.860708:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788813420.860717:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff908641187800 from 7 10000000:01000000:0.0:1788813420.860723:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788813420.860798:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb19de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813420.860812:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb19de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813420.860841:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb19de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813420.860870:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9087739c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583769088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788813420.860960:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813420.861037:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876faa0480 going to sleep for 11 seconds 00000100:00100000:1.0:1788813420.861123:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583769088 00000100:00100000:1.0:1788813420.861132:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583769088 00000100:00100000:1.0:1788813420.861187:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788813420.861197:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:5846:x1875706583769088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813420.861210:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813420.861223:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90874148ca00/0x6d74dbab2ddb19e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb19de expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813420.861247:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90874148ca00/0x6d74dbab2ddb19e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb19de expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813420.861258:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90874148ca00/0x6d74dbab2ddb19e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb19de expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813420.861267:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148ca00, rc 0) 00000100:00100000:1.0:1788813420.861316:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:5846:x1875706583769088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813420.861323:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788813420.861859:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9087739c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583769088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813420.861876:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb19de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb19e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813420.861894:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb19de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb19e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813420.861956:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9087739c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583769216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813420.861995:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813420.862038:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876faa0480 going to sleep for 11 seconds 00000100:00100000:1.0:1788813420.862099:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583769216 00000100:00100000:1.0:1788813420.862104:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583769216 00000100:00100000:1.0:1788813420.862141:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788813420.862149:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:5846:x1875706583769216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813420.862679:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:5846:x1875706583769216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 529us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813420.862703:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788813420.871727:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9087739c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583769216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813420.871826:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583769344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813420.871918:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813420.871972:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff908641365000 going to sleep for 11 seconds 00000100:00100000:1.0:1788813420.872390:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583769344 00000100:00100000:1.0:1788813420.872406:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583769344 00000100:00100000:1.0:1788813420.872480:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788813420.872490:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908760094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:5846:x1875706583769344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813420.872759:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908760094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:5846:x1875706583769344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 270us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813420.872767:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788813420.873069:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583769344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813420.877868:0:11707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9087739cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:11707:1875706583769472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813420.877994:0:11707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813420.878048:0:11707:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876faa0300 going to sleep for 11 seconds 00000100:00100000:1.0:1788813420.878455:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583769472 00000100:00100000:1.0:1788813420.878465:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583769472 00000100:00100000:1.0:1788813420.878526:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788813420.878536:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908760094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:11707:x1875706583769472:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813420.879231:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908760094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:11707:x1875706583769472:12345-0@lo:502:llog_process_th.0 Request processed in 693us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813420.879242:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788813420.879367:0:11707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9087739cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:11707:1875706583769472:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788813420.879429:0:11707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813420.879440:0:11707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813420.879443:0:11707:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788813420.879453:0:11707:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff908641187800 00000020:00000080:0.0:1788813420.879465:0:11707:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788813420.879570:0:11707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9087739cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:11707:1875706583769600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813420.879638:0:11707:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813420.879679:0:11707:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876faa0300 going to sleep for 11 seconds 00000100:00100000:1.0:1788813420.882360:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583769600 00000100:00100000:1.0:1788813420.882387:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583769600 00000100:00100000:1.0:1788813420.882478:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788813420.882489:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908760095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:11707:x1875706583769600:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813420.883177:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908760095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:11707:x1875706583769600:12345-0@lo:502:llog_process_th.0 Request processed in 686us (3535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813420.883188:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788813420.883304:0:11707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9087739cb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:11707:1875706583769600:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788813420.883341:0:11707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813420.883349:0:11707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813420.883351:0:11707:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788813420.883357:0:11707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788813420.883975:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788813420.884000:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788813420.884011:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb19de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb19e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813420.884023:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb19de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb19e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813420.884035:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788813420.884038:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff908774402000 from 7 10000000:01000000:0.0:1788813420.884040:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788813420.884071:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031e00/0x6d74dbab2ddb19ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813420.884079:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908740031e00/0x6d74dbab2ddb19ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813420.884088:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908740031e00/0x6d74dbab2ddb19ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813420.884109:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9087739cb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583769728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788813420.884157:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813420.884190:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876faa06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813420.884424:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583769728 00000100:00100000:1.0:1788813420.884431:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583769728 00000100:00100000:1.0:1788813420.884475:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788813420.884483:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908760097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:5846:x1875706583769728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813420.885101:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813420.885122:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90874148c600/0x6d74dbab2ddb19f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb19ec expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813420.885156:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90874148c600/0x6d74dbab2ddb19f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb19ec expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813420.885168:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90874148c600/0x6d74dbab2ddb19f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb19ec expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813420.885179:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148c600, rc 0) 00000100:00100000:1.0:1788813420.885241:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908760097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583769728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 758us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813420.885247:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788813420.885490:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9087739cb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583769728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813420.885598:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908740031e00/0x6d74dbab2ddb19ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb19f3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813420.885619:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908740031e00/0x6d74dbab2ddb19ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb19f3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813420.885684:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9087739cb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583769856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813420.885717:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813420.885754:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876faa06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813420.886862:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583769856 00000100:00100000:2.0:1788813420.886874:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583769856 00000100:00100000:2.0:1788813420.886949:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788813420.886959:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583769856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813420.887313:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583769856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 354us (1593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813420.887320:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788813420.888031:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9087739cb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583769856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813420.888089:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9087739cb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583769984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813420.888144:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813420.888223:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876faa06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813420.892973:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583769984 00000100:00100000:1.0:1788813420.892993:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583769984 00000100:00100000:1.0:1788813420.893058:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788813420.893067:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583769984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813420.893407:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583769984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 340us (5262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813420.893415:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788813420.899638:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9087739cb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583769984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813420.901064:0:11709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9087739cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:11709:1875706583770112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813420.901182:0:11709:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813420.901240:0:11709:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876faa0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788813420.901312:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583770112 00000100:00100000:1.0:1788813420.901323:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583770112 00000100:00100000:1.0:1788813420.901396:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788813420.901407:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:11709:x1875706583770112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813420.901832:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:11709:x1875706583770112:12345-0@lo:502:llog_process_th.0 Request processed in 426us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813420.901849:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788813420.901937:0:11709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9087739cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:11709:1875706583770112:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788813420.901973:0:11709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813420.901986:0:11709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813420.901988:0:11709:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788813420.901996:0:11709:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff908774402000 00000020:00000080:3.0:1788813420.902015:0:11709:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788813420.902097:0:11709:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb73800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:11709:1875706583770240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813420.902134:0:11709:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813420.902172:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583770240 00000100:00100000:3.0:1788813420.902177:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583770240 00000100:00100000:3.0:1788813420.902203:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788813420.902209:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:11709:x1875706583770240:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813420.902336:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:11709:x1875706583770240:12345-0@lo:502:llog_process_th.0 Request processed in 126us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813420.902342:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788813420.902383:0:11709:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fab1300 going to sleep for 11 seconds 00000100:00100000:3.0:1788813420.902603:0:11709:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb73800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:11709:1875706583770240:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788813420.902626:0:11709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813420.902631:0:11709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813420.902633:0:11709:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788813420.902637:0:11709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788813420.902754:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788813420.902775:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788813420.902786:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031e00/0x6d74dbab2ddb19ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb19f3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813420.902798:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908740031e00/0x6d74dbab2ddb19ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb19f3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813420.902808:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788813420.902811:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff908781c96000 from 7 10000000:01000000:1.0:1788813420.902814:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788813420.902840:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb19fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813420.902848:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb19fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813420.902858:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb19fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813420.902874:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583770368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788813420.902917:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813420.902944:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fa35900 going to sleep for 11 seconds 00000100:00100000:3.0:1788813420.903164:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583770368 00000100:00100000:3.0:1788813420.903170:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583770368 00000100:00100000:3.0:1788813420.903204:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788813420.903214:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:5846:x1875706583770368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813420.903227:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813420.903240:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908750ad1e00/0x6d74dbab2ddb1a01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb19fa expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813420.903264:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908750ad1e00/0x6d74dbab2ddb1a01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb19fa expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813420.903274:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908750ad1e00/0x6d74dbab2ddb1a01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb19fa expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813420.903282:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad1e00, rc 0) 00000100:00100000:3.0:1788813420.903321:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:5846:x1875706583770368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813420.903337:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788813420.906039:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583770368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813420.906071:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb19fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1a01 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813420.906085:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb19fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb1a01 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813420.906192:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583770496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813420.906251:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813420.907067:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fa35900 going to sleep for 11 seconds 00000100:00100000:0.0:1788813420.910635:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583770496 00000100:00100000:0.0:1788813420.910655:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583770496 00000100:00100000:0.0:1788813420.910720:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788813420.910731:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:5846:x1875706583770496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813420.912900:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:5846:x1875706583770496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2151us (6628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813420.912918:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000040:00080000:0.0:1788813420.918485:0:11711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788813420.924093:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583770496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813420.924160:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583770624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813420.924242:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813420.924273:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fa35900 going to sleep for 11 seconds 00000100:00100000:0.0:1788813420.924902:0:11247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583770624 00000100:00100000:0.0:1788813420.924912:0:11247:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583770624 00000100:00100000:0.0:1788813420.924974:0:11247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788813420.924983:0:11247:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:5846:x1875706583770624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813420.925225:0:11247:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:5846:x1875706583770624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 243us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813420.925233:0:11247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788813420.927624:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd1fd158-af17-4a1b-8f0b-82e57114d008:5846:1875706583770624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813420.943237:0:11713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:11713:1875706583770752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813420.943329:0:11713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813420.943384:0:11713:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fa353c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813420.943474:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583770752 00000100:00100000:0.0:1788813420.943482:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583770752 00000100:00100000:0.0:1788813420.943537:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788813420.943548:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:11713:x1875706583770752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813420.943808:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:11713:x1875706583770752:12345-0@lo:502:llog_process_th.0 Request processed in 261us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813420.943816:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788813420.943929:0:11713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:11713:1875706583770752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788813420.943959:0:11713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813420.943969:0:11713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813420.943972:0:11713:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788813420.943980:0:11713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff908781c96000 00000020:00000080:1.0:1788813420.943982:0:11713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788813420.944083:0:11713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:11713:1875706583770880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813420.944119:0:11713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813420.944132:0:11713:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fa353c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813420.945378:0:11247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583770880 00000100:00100000:0.0:1788813420.945394:0:11247:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583770880 00000100:00100000:0.0:1788813420.945462:0:11247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788813420.945472:0:11247:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:11713:x1875706583770880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813420.945731:0:11247:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:11713:x1875706583770880:12345-0@lo:502:llog_process_th.0 Request processed in 260us (1611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813420.945740:0:11247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788813420.945852:0:11713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd1fd158-af17-4a1b-8f0b-82e57114d008:11713:1875706583770880:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788813420.945895:0:11713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813420.945903:0:11713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813420.945910:0:11713:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788813420.945915:0:11713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788813420.946089:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788813420.946109:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788813420.946120:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb19fa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1a01 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813420.946133:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb19fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1a01 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813421.125186:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813421.125250:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562762752 00000100:00100000:0.0:1788813421.125262:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562762752 00000100:00100000:0.0:1788813421.125331:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 265 00000100:00100000:0.0:1788813421.125341:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+11:5602:x1875706562762752:12345-192.168.204.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813421.125363:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813421.125397:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908740030c00/0x6d74dbab2ddb1a08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x31ee63787e483dbb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813421.125434:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908740030c00/0x6d74dbab2ddb1a08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dbb expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813421.125445:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908740030c00/0x6d74dbab2ddb1a08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dbb expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813421.125454:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740030c00, rc 0) 00000100:00100000:0.0:1788813421.125543:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+12:5602:x1875706562762752:12345-192.168.204.47@tcp:101:ll_cfg_requeue.0 Request processed in 203us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813421.125550:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 265 00000100:00100000:3.0:1788813421.132999:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813421.133112:0:11247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562762880 00000100:00100000:0.0:1788813421.133124:0:11247:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562762880 00000100:00100000:0.0:1788813421.133399:0:11247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 266 00000100:00100000:0.0:1788813421.133419:0:11247:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+12:5602:x1875706562762880:12345-192.168.204.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813421.133793:0:11247:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+12:5602:x1875706562762880:12345-192.168.204.47@tcp:501:ll_cfg_requeue.0 Request processed in 382us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813421.133802:0:11247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 266 00000100:00100000:3.0:1788813421.141975:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813421.142253:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562763008 00000100:00100000:0.0:1788813421.142282:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562763008 00000100:00100000:0.0:1788813421.142355:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 267 00000100:00100000:0.0:1788813421.142366:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+12:5602:x1875706562763008:12345-192.168.204.47@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813421.142708:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+12:5602:x1875706562763008:12345-192.168.204.47@tcp:503:ll_cfg_requeue.0 Request processed in 343us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813421.142717:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 267 00000100:00100000:2.0:1788813421.152569:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813421.152723:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562763136 00000100:00100000:1.0:1788813421.152737:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562763136 00000100:00100000:1.0:1788813421.152813:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 268 00000100:00100000:1.0:1788813421.152824:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+12:9958:x1875706562763136:12345-192.168.204.47@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788813421.153116:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+12:9958:x1875706562763136:12345-192.168.204.47@tcp:502:llog_process_th.0 Request processed in 292us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813421.153124:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 268 00000100:00100000:3.0:1788813421.155565:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813421.155863:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562763264 00000100:00100000:0.0:1788813421.155877:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562763264 00000100:00100000:0.0:1788813421.155950:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 269 00000100:00100000:0.0:1788813421.155961:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+12:9958:x1875706562763264:12345-192.168.204.47@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788813421.156228:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+12:9958:x1875706562763264:12345-192.168.204.47@tcp:502:llog_process_th.0 Request processed in 267us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813421.156236:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 269 00000100:00100000:3.0:1788813421.163120:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813421.163278:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562763392 00000100:00100000:1.0:1788813421.163291:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562763392 00000100:00100000:1.0:1788813421.163354:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 270 00000100:00100000:1.0:1788813421.163364:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+12:5602:x1875706562763392:12345-192.168.204.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813421.163393:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813421.163417:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90874148d200/0x6d74dbab2ddb1a0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x31ee63787e483dc2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813421.163460:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90874148d200/0x6d74dbab2ddb1a0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dc2 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813421.163472:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90874148d200/0x6d74dbab2ddb1a0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dc2 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813421.163482:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148d200, rc 0) 00000100:00100000:1.0:1788813421.163543:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:5602:x1875706562763392:12345-192.168.204.47@tcp:101:ll_cfg_requeue.0 Request processed in 179us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813421.163550:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 270 00000100:00100000:2.0:1788813421.177004:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813421.180129:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562763520 00000100:00100000:1.0:1788813421.180147:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562763520 00000100:00100000:1.0:1788813421.180230:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 271 00000100:00100000:1.0:1788813421.180242:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:5602:x1875706562763520:12345-192.168.204.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788813421.180647:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749138450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:5602:x1875706562763520:12345-192.168.204.47@tcp:501:ll_cfg_requeue.0 Request processed in 404us (3651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813421.180656:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 271 00000100:00100000:3.0:1788813421.186029:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813421.187949:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562763648 00000100:00100000:1.0:1788813421.187966:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562763648 00000100:00100000:1.0:1788813421.188043:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 272 00000100:00100000:1.0:1788813421.188054:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:5602:x1875706562763648:12345-192.168.204.47@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788813421.188338:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:5602:x1875706562763648:12345-192.168.204.47@tcp:503:ll_cfg_requeue.0 Request processed in 284us (2318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813421.188347:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 272 00000100:00100000:3.0:1788813421.193040:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813421.196275:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562763776 00000100:00100000:1.0:1788813421.196293:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562763776 00000100:00100000:1.0:1788813421.196371:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 273 00000100:00100000:1.0:1788813421.196385:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:9961:x1875706562763776:12345-192.168.204.47@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788813421.197676:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:9961:x1875706562763776:12345-192.168.204.47@tcp:502:llog_process_th.0 Request processed in 1287us (4645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813421.197688:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 273 00000100:00100000:2.0:1788813421.208905:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813421.209253:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562763904 00000100:00100000:1.0:1788813421.209264:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562763904 00000100:00100000:1.0:1788813421.209317:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 274 00000100:00100000:1.0:1788813421.209328:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:9961:x1875706562763904:12345-192.168.204.47@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788813421.209953:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:9961:x1875706562763904:12345-192.168.204.47@tcp:502:llog_process_th.0 Request processed in 624us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813421.209962:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 274 00010000:00010000:2.0:1788813421.244970:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788813421.949423:0:11711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788813422.270227:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813423.293648:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583771008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813423.293831:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813423.293969:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583771008 00000100:00100000:3.0:1788813423.293978:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583771008 00000100:00100000:3.0:1788813423.294056:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788813423.294066:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583771008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813423.294102:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813423.294161:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583771008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813423.294169:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1788813423.294207:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876eb73800 x1875706583771008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813423.294238:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583771008:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788813423.294342:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788813423.294397:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788813423.857790:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:2.0:1788813424.318785:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813424.522193:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813424.522241:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813424.522288:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813424.522335:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813424.522382:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562764160 00000100:00100000:2.0:1788813424.522392:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562764160 00000100:00100000:2.0:1788813424.522449:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562764416 00000100:00100000:2.0:1788813424.522452:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562764416 00000100:00100000:2.0:1788813424.522474:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 111 00000100:00100000:2.0:1788813424.522485:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c0c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+5:2359:x1875706562764160:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813424.522558:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c0c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+5:2359:x1875706562764160:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 75us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813424.522567:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 111 00000100:00100000:2.0:1788813424.522619:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 112 00000100:00100000:2.0:1788813424.522627:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c0cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa21be5-2246-40d3-8e20-d34501daf545+5:2359:x1875706562764416:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813424.522653:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c0cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa21be5-2246-40d3-8e20-d34501daf545+5:2359:x1875706562764416:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 27us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813424.522660:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 112 00000100:00100000:1.0:1788813424.523637:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562764032 00000100:00100000:1.0:1788813424.523647:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562764032 00000100:00100000:1.0:1788813424.523713:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 275 00000100:00100000:1.0:1788813424.523723:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2360:x1875706562764032:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813424.523788:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2360:x1875706562764032:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 67us (1546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813424.523794:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 275 00000100:00080000:1.0:1788813424.523836:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813424.524476:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562764288 00000100:00100000:0.0:1788813424.524483:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562764288 00000100:00100000:0.0:1788813424.524547:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 63 00000100:00100000:0.0:1788813424.524557:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c0c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+5:2360:x1875706562764288:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813424.524661:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c0c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+5:2360:x1875706562764288:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 106us (2372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813424.524668:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 63 00000100:00080000:1.0:1788813424.526911:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813424.830319:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583771136:0@lo:400:kworker.0 00000100:00100000:3.0:1788813424.830400:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813424.830727:0:11247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583771136 00000100:00100000:0.0:1788813424.830766:0:11247:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583771136 00000100:00100000:0.0:1788813424.830829:0:11247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788813424.830839:0:11247:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3318:x1875706583771136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813424.831158:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875706583771264:0@lo:400:kworker.0 00000100:00100000:1.0:1788813424.831196:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813424.831237:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583771264 00000100:00100000:1.0:1788813424.831242:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583771264 00000100:00100000:1.0:1788813424.831280:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788813424.831287:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875706583771264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813424.831326:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875706583771264:12345-0@lo:400:kworker.0 Request processed in 39us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813424.831333:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788813424.831385:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875706583771264:0@lo:400:kworker.0 00000100:00100000:0.0:1788813424.838140:0:11247:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3318:x1875706583771136:12345-0@lo:400:kworker.0 Request processed in 7288us (7726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813424.838159:0:11247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788813424.838502:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583771776:0@lo:400:kworker.0 00000100:00100000:2.0:1788813424.838596:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813424.838626:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813424.838632:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875706583771648:0@lo:400:kworker.0 00000100:00100000:2.0:1788813424.838656:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813424.838689:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583771648 00000100:00100000:2.0:1788813424.838697:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583771648 00000100:00100000:1.0:1788813424.839096:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583771520:0@lo:400:kworker.0 00000100:00100000:1.0:1788813424.839131:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813424.839156:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813424.839162:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875706583771392:0@lo:400:kworker.0 00000100:00100000:1.0:1788813424.839199:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813424.839232:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583771776 00000100:00100000:1.0:1788813424.839237:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583771776 00000100:00100000:2.0:1788813424.839303:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583771392 00000100:00100000:2.0:1788813424.839308:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583771392 00000100:00100000:0.0:1788813424.839376:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583771520 00000100:00100000:0.0:1788813424.839381:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583771520 00000100:00100000:0.0:1788813424.839409:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788813424.839418:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583771520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813424.839473:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583771520:12345-0@lo:400:kworker.0 Request processed in 56us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813424.839480:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788813424.839500:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788813424.839508:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c0c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875706583771648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813424.839560:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c0c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875706583771648:12345-0@lo:400:kworker.0 Request processed in 53us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813424.839565:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788813424.841031:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788813424.841044:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c0c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583771776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813424.841124:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c0c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583771776:12345-0@lo:400:kworker.0 Request processed in 84us (2545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813424.841311:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1788813424.841376:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c0ca680 x1875706583771520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813424.841393:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583771520:0@lo:400:kworker.0 00000100:00100000:3.0:1788813424.847357:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583771136:0@lo:400:kworker.0 00000100:00100000:3.0:1788813424.847451:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875706583771648:0@lo:400:kworker.0 00000100:00100000:3.0:1788813424.847465:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1788813424.847470:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff908643b4e300, transno 4294967300 00000100:00100000:3.0:1788813424.847498:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583771776:0@lo:400:kworker.0 00000100:00100000:2.0:1788813424.849701:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788813424.849729:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874457aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875706583771392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813424.849845:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874457aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875706583771392:12345-0@lo:400:kworker.0 Request processed in 132us (10644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813424.849853:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1788813424.850562:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788813424.850891:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813424.851094:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875706583771392:0@lo:400:kworker.0 00000100:00100000:3.0:1788813425.341149:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788813425.341189:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583771904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813425.341258:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813425.341330:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583771904 00000100:00100000:3.0:1788813425.341338:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583771904 00000100:00100000:3.0:1788813425.341385:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788813425.341394:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583771904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813425.341430:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813425.341473:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583771904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813425.341480:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788813425.341527:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583771904:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788813425.341610:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813426.365560:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813427.388844:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813428.412824:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813428.413114:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813428.413966:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583772032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813428.414047:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813428.414656:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583772032 00000100:00100000:3.0:1788813428.414665:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583772032 00000100:00100000:3.0:1788813428.414753:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788813428.414764:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874457b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583772032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813428.414804:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813428.414874:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874457b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583772032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813428.414881:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1788813428.415028:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876eb73100 x1875706583772032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813428.415049:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583772032:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788813428.415219:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788813429.438306:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813429.639833:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813429.639944:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562764672 00000100:00100000:0.0:1788813429.639955:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562764672 00000100:00100000:0.0:1788813429.640049:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 116 00000100:00100000:0.0:1788813429.640060:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+5:2359:x1875706562764672:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813429.640149:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c0c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+5:2359:x1875706562764672:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 92us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813429.640157:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 116 00000100:00080000:1.0:1788813429.640552:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813429.640776:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813429.640819:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813429.641249:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562764544 00000100:00100000:1.0:1788813429.641257:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562764544 00000100:00100000:1.0:1788813429.641303:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 277 00000100:00100000:1.0:1788813429.641319:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2360:x1875706562764544:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813429.641390:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2360:x1875706562764544:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 72us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813429.641397:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 277 00000100:00100000:0.0:1788813429.642359:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562764800 00000100:00100000:0.0:1788813429.642366:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562764800 00000100:00100000:0.0:1788813429.642434:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 66 00000100:00100000:0.0:1788813429.642442:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+5:2360:x1875706562764800:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813429.642493:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+5:2360:x1875706562764800:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 52us (1673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813429.642500:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 66 00000100:00100000:3.0:1788813429.644103:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813429.644206:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562764928 00000100:00100000:0.0:1788813429.644228:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562764928 00000100:00100000:0.0:1788813429.644291:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 117 00000100:00100000:0.0:1788813429.644301:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa21be5-2246-40d3-8e20-d34501daf545+5:2359:x1875706562764928:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813429.644373:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa21be5-2246-40d3-8e20-d34501daf545+5:2359:x1875706562764928:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 73us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813429.644381:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 117 00000100:00080000:1.0:1788813429.647113:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788813429.647125:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813429.953250:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583772160:0@lo:400:kworker.0 00000100:00100000:3.0:1788813429.953324:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813429.953373:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875706583772672:0@lo:400:kworker.0 00000100:00100000:3.0:1788813429.953401:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813429.953439:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788813429.953446:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875706583772288:0@lo:400:kworker.0 00000100:00100000:3.0:1788813429.953469:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813429.953487:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583772800:0@lo:400:kworker.0 00000100:00100000:3.0:1788813429.953509:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813429.953537:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908643b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583772416:0@lo:400:kworker.0 00000100:00100000:3.0:1788813429.953560:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813429.953596:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813429.953602:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908643b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583772544:0@lo:400:kworker.0 00000100:00100000:3.0:1788813429.953623:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813429.953654:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583772160 00000100:00100000:3.0:1788813429.953662:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583772160 00000100:00100000:3.0:1788813429.953704:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788813429.953729:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3318:x1875706583772160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813429.953783:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3318:x1875706583772160:12345-0@lo:400:kworker.0 Request processed in 55us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813429.953790:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788813429.953821:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583772672 00000100:00100000:3.0:1788813429.953826:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583772672 00000100:00100000:3.0:1788813429.953859:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583772288 00000100:00100000:3.0:1788813429.953862:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583772288 00000100:00100000:3.0:1788813429.953874:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583772416 00000100:00100000:3.0:1788813429.953876:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583772416 00000100:00100000:3.0:1788813429.953888:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788813429.953893:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875706583772672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813429.953923:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875706583772672:12345-0@lo:400:kworker.0 Request processed in 30us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813429.953929:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788813429.953951:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788813429.953957:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875706583772288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813429.953986:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875706583772288:12345-0@lo:400:kworker.0 Request processed in 29us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813429.953991:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788813429.954013:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788813429.954019:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583772416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813429.954049:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583772416:12345-0@lo:400:kworker.0 Request processed in 31us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813429.954055:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788813429.954079:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583772800 00000100:00100000:3.0:1788813429.954083:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583772800 00000100:00100000:3.0:1788813429.954107:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583772544 00000100:00100000:3.0:1788813429.954110:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583772544 00000100:00100000:3.0:1788813429.954127:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788813429.954133:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e452a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583772800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813429.954163:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e452a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583772800:12345-0@lo:400:kworker.0 Request processed in 30us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813429.954168:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788813429.954180:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788813429.954186:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583772544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813429.954211:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583772544:12345-0@lo:400:kworker.0 Request processed in 25us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813429.954216:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788813429.954262:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875706583772288:0@lo:400:kworker.0 00000100:00100000:3.0:1788813429.954272:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583772800:0@lo:400:kworker.0 00000100:00100000:3.0:1788813429.954290:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583772160:0@lo:400:kworker.0 00000100:00100000:3.0:1788813429.954301:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875706583772672:0@lo:400:kworker.0 00000100:00080000:3.0:1788813429.954324:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788813429.954329:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788813429.954349:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff908643b4fb80 x1875706583772544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813429.954358:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908643b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583772544:0@lo:400:kworker.0 00000100:00100000:3.0:1788813429.954367:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908643b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583772416:0@lo:400:kworker.0 00000100:00100000:1.0:1788813430.462993:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813430.463019:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583772928:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788813430.463048:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813430.463301:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813430.463808:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583772928 00000100:00100000:0.0:1788813430.463817:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583772928 00000100:00100000:0.0:1788813430.463896:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788813430.463908:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908744579500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583772928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788813430.463953:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813430.464025:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908744579500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583772928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813430.464032:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788813430.464371:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583772928:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788813431.166279:0:11711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788813431.484807:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813432.509510:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813433.532826:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583773056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813433.532903:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813433.532958:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583773056 00000100:00100000:3.0:1788813433.532968:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583773056 00010000:00010000:0.0:1788813433.533010:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813433.533034:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1788813433.533038:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813433.533043:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908744579180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583773056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813433.533082:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813433.537501:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908744579180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583773056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4448us (4587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813433.537517:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1788813433.538647:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c0cad80 x1875706583773056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813433.538697:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583773056:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788813434.556867:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813434.755736:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813434.755799:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813434.756238:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562765056 00000100:00100000:2.0:1788813434.756251:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562765056 00000100:00100000:2.0:1788813434.756325:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 279 00000100:00100000:2.0:1788813434.756336:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2360:x1875706562765056:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813434.756443:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2360:x1875706562765056:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 109us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813434.756451:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 279 00000100:00100000:0.0:1788813434.756946:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562765184 00000100:00100000:0.0:1788813434.756952:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562765184 00000100:00100000:0.0:1788813434.757013:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 121 00000100:00100000:0.0:1788813434.757021:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+5:2360:x1875706562765184:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813434.757075:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+5:2360:x1875706562765184:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 55us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813434.757082:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 121 00000100:00080000:1.0:1788813434.757168:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813434.781805:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813434.781869:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813434.782046:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562765440 00000100:00100000:1.0:1788813434.782047:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562765312 00000100:00100000:1.0:1788813434.782060:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562765312 00000100:00100000:0.0:1788813434.782060:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562765440 00000100:00100000:1.0:1788813434.782136:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 19 00000100:00100000:0.0:1788813434.782136:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 122 00000100:00100000:1.0:1788813434.782156:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+5:2358:x1875706562765312:12345-192.168.204.47@tcp:9:kworker.0 00000100:00100000:0.0:1788813434.782156:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa21be5-2246-40d3-8e20-d34501daf545+5:2360:x1875706562765440:12345-192.168.204.47@tcp:400:kworker.0 00000020:00000080:1.0:1788813434.782192:0:8270:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb194b 00000100:00080000:1.0:1788813434.782205:0:8270:0:(import.c:65:import_set_state_nolock()) ffff908749da9800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788813434.782238:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa21be5-2246-40d3-8e20-d34501daf545+5:2360:x1875706562765440:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 94us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813434.782246:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 122 00000001:00000004:1.0:1788813434.782248:0:8270:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:0.0:1788813434.782287:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788813434.782465:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813434.782471:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813434.782540:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+2:2358:x1875706562765312:12345-192.168.204.47@tcp:9:kworker.0 Request processed in 395us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813434.782548:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 19 00000100:00100000:3.0:1788813435.069006:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583773184:0@lo:400:kworker.0 00000100:00100000:3.0:1788813435.069092:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813435.069166:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875706583773696:0@lo:400:kworker.0 00000100:00100000:3.0:1788813435.069193:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813435.069193:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583773440:0@lo:400:kworker.0 00000100:00100000:0.0:1788813435.069228:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583773696 00000100:00100000:0.0:1788813435.069236:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583773696 00000100:00100000:3.0:1788813435.069241:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788813435.069247:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875706583773312:0@lo:400:kworker.0 00000100:00100000:3.0:1788813435.069269:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813435.069365:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583773568:0@lo:400:kworker.0 00000100:00100000:1.0:1788813435.069422:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788813435.069461:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813435.069512:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583773184 00000100:00100000:2.0:1788813435.069517:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583773184 00000100:00100000:2.0:1788813435.069550:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788813435.069560:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3318:x1875706583773184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813435.069648:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3318:x1875706583773184:12345-0@lo:400:kworker.0 Request processed in 90us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813435.069656:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788813435.069697:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583773568 00000100:00100000:2.0:1788813435.069701:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583773568 00000100:00100000:2.0:1788813435.069734:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788813435.069740:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874457b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583773568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813435.069777:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874457b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583773568:12345-0@lo:400:kworker.0 Request processed in 36us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813435.069783:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788813435.069925:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583773824:0@lo:400:kworker.0 00000100:00100000:3.0:1788813435.069950:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813435.069982:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583773184:0@lo:400:kworker.0 00000100:00100000:3.0:1788813435.070016:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583773824 00000100:00100000:3.0:1788813435.070020:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583773824 00000100:00100000:3.0:1788813435.070048:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788813435.070051:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583773312 00000100:00100000:3.0:1788813435.070055:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583773824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813435.070055:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583773312 00000100:00100000:0.0:1788813435.070080:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788813435.070086:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875706583773696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813435.070090:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583773824:12345-0@lo:400:kworker.0 Request processed in 36us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813435.070095:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788813435.070121:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875706583773696:12345-0@lo:400:kworker.0 Request processed in 35us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813435.070146:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788813435.070161:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788813435.070167:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875706583773312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813435.070195:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875706583773312:12345-0@lo:400:kworker.0 Request processed in 29us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813435.070201:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1788813435.070230:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788813435.070233:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788813435.070253:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c0c9880 x1875706583773568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813435.070264:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583773568:0@lo:400:kworker.0 00000100:00100000:0.0:1788813435.070286:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813435.070311:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583773440 00000100:00100000:0.0:1788813435.070314:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583773440 00000100:00100000:0.0:1788813435.070338:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788813435.070343:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583773440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813435.070375:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583773440:12345-0@lo:400:kworker.0 Request processed in 32us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813435.070380:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:0.0:1788813435.070394:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813435.070424:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583773440:0@lo:400:kworker.0 00000100:00100000:3.0:1788813435.070443:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875706583773312:0@lo:400:kworker.0 00000100:00100000:3.0:1788813435.070453:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583773824:0@lo:400:kworker.0 00000100:00100000:3.0:1788813435.070463:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875706583773696:0@lo:400:kworker.0 00010000:00010000:0.0:1788813435.581083:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813435.583926:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813435.583952:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583773952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813435.584028:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813435.584377:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583773952 00000100:00100000:2.0:1788813435.584387:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583773952 00000100:00100000:2.0:1788813435.584441:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788813435.584452:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908744578700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583773952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813435.584489:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813435.584548:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908744578700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583773952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813435.584556:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788813435.584698:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583773952:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788813436.605344:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813437.628837:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813438.653041:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583774080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813438.653138:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788813438.653418:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813438.653466:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583774080 00000100:00100000:2.0:1788813438.653476:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583774080 00000100:00100000:2.0:1788813438.653553:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788813438.653563:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874457b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583774080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813438.653620:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813438.653679:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874457b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583774080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813438.653685:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1788813438.653824:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c0cb480 x1875706583774080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813438.653842:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583774080:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788813438.653926:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1788813439.301058:0:7669:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e90f6370-8c16-4659-9369-1cd146993b4c 00000020:00000080:0.0:1788813439.301070:0:7669:0:(genops.c:885:class_export_put()) final put ffff908749daa800/e90f6370-8c16-4659-9369-1cd146993b4c 00000020:00000080:3.0:1788813439.301239:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff908749daa800/e90f6370-8c16-4659-9369-1cd146993b4c for lustre-OST0001 00000020:00000080:3.0:1788813439.301311:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff908749da9800 for lustre-OST0001 00010000:00010000:1.0:1788813439.676885:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813439.875450:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813439.875485:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813439.875512:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813439.875548:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562765696 00000100:00100000:0.0:1788813439.875548:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562765824 00000100:00100000:2.0:1788813439.875557:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562765696 00000100:00100000:0.0:1788813439.875557:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562765824 00000100:00100000:0.0:1788813439.875632:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 126 00000100:00100000:3.0:1788813439.875695:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562765568 00000100:00100000:3.0:1788813439.875700:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562765568 00000100:00100000:3.0:1788813439.875727:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 281 00000100:00100000:3.0:1788813439.875735:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2362:x1875706562765568:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:3.0:1788813439.875814:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2362:x1875706562765568:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 80us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813439.875840:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 281 00000100:00100000:2.0:1788813439.884453:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 127 00000100:00100000:2.0:1788813439.884468:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+5:2362:x1875706562765696:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813439.884505:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa21be5-2246-40d3-8e20-d34501daf545+5:2362:x1875706562765824:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813439.884601:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+5:2362:x1875706562765696:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 116us (9066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813439.884610:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 127 00000100:00080000:0.0:1788813439.885497:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813439.886921:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa21be5-2246-40d3-8e20-d34501daf545+5:2362:x1875706562765824:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 11269us (11424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813439.886933:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 126 00000100:00100000:0.0:1788813440.189382:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583774464:0@lo:400:kworker.0 00000100:00100000:0.0:1788813440.189465:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813440.189538:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788813440.189544:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583774592:0@lo:400:kworker.0 00000100:00100000:0.0:1788813440.189571:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813440.189865:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583774592 00000100:00100000:0.0:1788813440.189877:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583774592 00000100:00100000:0.0:1788813440.189955:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788813440.189966:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583774592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813440.190030:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583774592:12345-0@lo:400:kworker.0 Request processed in 65us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813440.190036:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1788813440.190062:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788813440.190097:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90877c0c8700 x1875706583774592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813440.190112:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583774592:0@lo:400:kworker.0 00000100:00100000:3.0:1788813440.190397:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583774208:0@lo:400:kworker.0 00000100:00100000:3.0:1788813440.190439:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813440.190480:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875706583774720:0@lo:400:kworker.0 00000100:00100000:3.0:1788813440.190506:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813440.190544:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788813440.190551:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875706583774336:0@lo:400:kworker.0 00000100:00100000:3.0:1788813440.190574:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813440.190620:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583774848:0@lo:400:kworker.0 00000100:00100000:3.0:1788813440.190644:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813440.191480:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583774208 00000100:00100000:0.0:1788813440.191491:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583774208 00000100:00100000:0.0:1788813440.191560:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788813440.191603:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874913b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3318:x1875706583774208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813440.191669:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874913b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3318:x1875706583774208:12345-0@lo:400:kworker.0 Request processed in 91us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813440.191676:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788813440.192306:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583774464 00000100:00100000:3.0:1788813440.192313:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583774464 00000100:00100000:3.0:1788813440.192408:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583774720 00000100:00100000:3.0:1788813440.192413:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583774720 00000100:00100000:1.0:1788813440.192932:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583774336 00000100:00100000:1.0:1788813440.192938:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583774336 00000100:00100000:1.0:1788813440.192965:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788813440.192974:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583774464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813440.193047:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583774464:12345-0@lo:400:kworker.0 Request processed in 74us (3582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813440.193054:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788813440.193071:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788813440.193077:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875706583774336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813440.193133:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875706583774336:12345-0@lo:400:kworker.0 Request processed in 57us (2558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813440.193140:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788813440.193257:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583774464:0@lo:400:kworker.0 00000100:00080000:0.0:1788813440.200662:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813440.201137:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788813440.201151:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875706583774720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813440.201446:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875706583774720:12345-0@lo:400:kworker.0 Request processed in 299us (10937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813440.201455:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788813440.201486:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583774848 00000100:00100000:3.0:1788813440.201495:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583774848 00000100:00100000:3.0:1788813440.201548:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788813440.201554:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583774848:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788813440.201641:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813440.201674:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583774848:12345-0@lo:400:kworker.0 Request processed in 119us (11028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813440.201690:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788813440.201748:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875706583774336:0@lo:400:kworker.0 00000100:00100000:3.0:1788813440.201761:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583774848:0@lo:400:kworker.0 00000100:00100000:3.0:1788813440.201770:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583774208:0@lo:400:kworker.0 00000100:00100000:3.0:1788813440.201779:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875706583774720:0@lo:400:kworker.0 00000100:00100000:1.0:1788813440.705496:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90874457a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583774976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813440.705595:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813440.705713:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583774976 00000100:00100000:1.0:1788813440.705722:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583774976 00000100:00100000:1.0:1788813440.705772:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788813440.705781:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874457a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583774976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788813440.705815:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813440.705860:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874457a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583774976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813440.705866:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788813440.705908:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90874457a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583774976:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788813440.706907:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788813441.419620:0:11711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788813441.726386:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813442.749198:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813443.773096:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813443.773212:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813443.773235:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908761eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583775104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813443.773501:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813443.773574:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583775104 00000100:00100000:3.0:1788813443.773597:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583775104 00000100:00100000:3.0:1788813443.773654:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788813443.773663:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583775104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813443.773706:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813443.773757:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e424380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583775104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813443.773764:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1788813443.773785:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788813443.773814:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff908761eb4000 x1875706583775104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813443.773833:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908761eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583775104:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788813443.914762:0:11874:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 16:37:23 (1788813443) 00010000:00010000:1.0:1788813444.802396:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813444.997468:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813444.997525:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813444.997719:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562766080 00000100:00100000:2.0:1788813444.997733:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562766080 00000100:00080000:3.0:1788813444.997879:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813444.998895:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562766208 00000100:00100000:2.0:1788813444.998908:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562766208 00000100:00080000:3.0:1788813444.999071:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813444.999686:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 131 00000100:00100000:0.0:1788813444.999707:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+5:2362:x1875706562766080:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813444.999850:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+5:2362:x1875706562766080:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 152us (2398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813444.999859:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 131 00000100:00100000:0.0:1788813444.999887:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 132 00000100:00100000:0.0:1788813444.999895:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa21be5-2246-40d3-8e20-d34501daf545+5:2362:x1875706562766208:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813444.999924:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa21be5-2246-40d3-8e20-d34501daf545+5:2362:x1875706562766208:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 29us (2398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813445.003289:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813445.004162:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 132 00000100:00100000:0.0:1788813445.004282:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562765952 00000100:00100000:0.0:1788813445.004296:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562765952 00000100:00100000:0.0:1788813445.004359:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 283 00000100:00100000:0.0:1788813445.004370:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2361:x1875706562765952:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813445.004483:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2361:x1875706562765952:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 113us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813445.004512:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 283 00000100:00100000:0.0:1788813445.309138:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583775232:0@lo:400:kworker.0 00000100:00100000:0.0:1788813445.309262:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813445.309609:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583775232 00000100:00100000:2.0:1788813445.309624:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583775232 00000100:00100000:2.0:1788813445.309689:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788813445.309701:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3318:x1875706583775232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813445.310077:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875706583775360:0@lo:400:kworker.0 00000100:00100000:1.0:1788813445.310124:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813445.310190:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583775360 00000100:00100000:1.0:1788813445.310195:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583775360 00000100:00100000:1.0:1788813445.310235:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788813445.310242:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874457a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875706583775360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813445.310329:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874457a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875706583775360:12345-0@lo:400:kworker.0 Request processed in 86us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813445.310337:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788813445.310390:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875706583775360:0@lo:400:kworker.0 00000100:00100000:2.0:1788813445.310900:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3318:x1875706583775232:12345-0@lo:400:kworker.0 Request processed in 1198us (1635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813445.310910:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788813445.311152:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583775872:0@lo:400:kworker.0 00000100:00100000:3.0:1788813445.311215:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813445.311246:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813445.311251:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875706583775744:0@lo:400:kworker.0 00000100:00100000:3.0:1788813445.311275:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813445.311304:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583775872 00000100:00100000:3.0:1788813445.311310:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583775872 00000100:00100000:3.0:1788813445.311364:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788813445.311374:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583775872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813445.311435:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e425500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583775872:12345-0@lo:400:kworker.0 Request processed in 63us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813445.311443:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1788813445.311479:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813445.311511:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583775872:0@lo:400:kworker.0 00000100:00100000:1.0:1788813445.311804:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583775616:0@lo:400:kworker.0 00000100:00100000:1.0:1788813445.311856:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813445.311891:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813445.311898:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875706583775488:0@lo:400:kworker.0 00000100:00100000:1.0:1788813445.311923:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813445.311956:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583775744 00000100:00100000:1.0:1788813445.311961:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583775744 00000100:00100000:1.0:1788813445.311999:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583775488 00000100:00100000:1.0:1788813445.312003:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583775488 00000100:00100000:1.0:1788813445.312026:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788813445.312033:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875706583775744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813445.312077:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875706583775744:12345-0@lo:400:kworker.0 Request processed in 44us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813445.312083:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788813445.312097:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788813445.312103:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874457bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875706583775488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813445.312134:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874457bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875706583775488:12345-0@lo:400:kworker.0 Request processed in 32us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813445.312140:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788813445.312170:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875706583775488:0@lo:400:kworker.0 00000100:00100000:3.0:1788813445.312380:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583775616 00000100:00100000:3.0:1788813445.312385:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583775616 00000100:00100000:3.0:1788813445.312435:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788813445.312442:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908744579880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583775616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813445.312496:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908744579880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583775616:12345-0@lo:400:kworker.0 Request processed in 54us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813445.312502:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1788813445.312520:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788813445.312525:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788813445.312555:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e425c00 x1875706583775616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788813461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813445.312624:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583775616:0@lo:400:kworker.0 00000100:00100000:3.0:1788813445.312655:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875706583775744:0@lo:400:kworker.0 00000100:00100000:0.0:1788813445.313060:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583775232:0@lo:400:kworker.0 00000100:00100000:3.0:1788813445.691141:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813445.691397:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562766336 00000100:00100000:1.0:1788813445.691440:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562766336 00000100:00100000:1.0:1788813445.691528:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 32 00000100:00100000:1.0:1788813445.691542:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+5:10230:x1875706562766336:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788813445.691619:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813445.691655:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb1a16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483dc9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.691743:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d400/0x6d74dbab2ddb1a1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.691760:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d400/0x6d74dbab2ddb1a1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.691776:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d400/0x6d74dbab2ddb1a1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813445.691823:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788813445.691827:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813445.691878:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d400/0x6d74dbab2ddb1a1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.691912:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb1a16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dc9 expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.692162:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d400/0x6d74dbab2ddb1a1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dc9 expref: 6 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.692681:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908746516600) 00010000:00010000:1.0:1788813445.692686:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813445.692691:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148d400, rc 0) 00000100:00100000:1.0:1788813445.692799:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:10230:x1875706562766336:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 1258us (1672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813445.692808:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 32 00000100:00100000:3.0:1788813445.706305:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813445.706421:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562766464 00000100:00100000:1.0:1788813445.706430:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562766464 00000100:00100000:1.0:1788813445.706503:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 33 00000100:00100000:1.0:1788813445.706513:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+6:10231:x1875706562766464:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788813445.706536:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813445.706556:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb1a24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483dd0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.706655:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb1a2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.706671:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb1a2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.706682:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb1a2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.706696:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb1a32 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.706702:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb1a32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.706709:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb1a32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.706972:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72c00/0x6d74dbab2ddb1a39 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.706987:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72c00/0x6d74dbab2ddb1a39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.706994:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72c00/0x6d74dbab2ddb1a39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813445.707025:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788813445.707028:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813445.707045:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72c00/0x6d74dbab2ddb1a39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.707056:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb1a2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.707063:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb1a2b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.707071:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb1a2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.707076:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148c400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813445.707081:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb1a2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.707089:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb1a2b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.707102:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908746516600) 00010000:00010000:1.0:1788813445.707105:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813445.707112:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb1a2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.707126:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb1a2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.707140:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb1a32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.707145:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb1a32 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.707152:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb1a32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.707157:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148d600 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813445.707160:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb1a32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.707165:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb1a32 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.707171:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff908746516800) 00010000:00010000:1.0:1788813445.707173:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813445.707176:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb1a32 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.707181:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb1a32 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.707213:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb1a24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dd0 expref: 8 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.707227:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72c00/0x6d74dbab2ddb1a39 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dd0 expref: 7 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813445.707238:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff908746516400) 00010000:00010000:1.0:1788813445.707241:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813445.707243:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908749d72c00, rc 0) 00000100:00100000:1.0:1788813445.707320:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+7:10231:x1875706562766464:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 808us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813445.707328:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 33 00000100:00100000:0.0:1788813445.711299:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813445.711420:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562766720 00000100:00100000:2.0:1788813445.711431:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562766720 00000100:00100000:2.0:1788813445.711505:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 34 00000100:00100000:2.0:1788813445.711517:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+7:10231:x1875706562766720:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813445.711538:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813445.711560:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1a40 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483dd7 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813445.711683:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1a47 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813445.711712:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1a47 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813445.711725:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1a47 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813445.711791:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1a4e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813445.711799:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1a4e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813445.711806:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1a4e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813445.712183:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb1a55 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813445.712193:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb1a55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813445.712200:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb1a55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813445.712211:0:8269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788813445.712365:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1a47 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813445.712375:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1a47 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813445.712382:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1a47 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813445.712396:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813445.712400:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1a47 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813445.712420:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1a47 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813445.712433:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff908746516400) 00010000:00010000:2.0:1788813445.712436:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813445.712441:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1a47 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813445.712447:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1a47 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813445.712460:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1a4e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813445.712466:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1a4e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813445.712472:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1a4e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813445.712477:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368c00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813445.712480:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1a4e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813445.712486:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1a4e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813445.712504:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff908743ce0e00) 00010000:00010000:2.0:1788813445.712507:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813445.712510:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1a4e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813445.712516:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1a4e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813445.713003:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1a40 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dd7 expref: 10 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813445.713020:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb1a55 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dd7 expref: 9 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813445.713027:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff908743ce0800) 00010000:00010000:2.0:1788813445.713029:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813445.713031:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368400, rc 0) 00000100:00100000:2.0:1788813445.713118:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+9:10231:x1875706562766720:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 1603us (1829us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788813445.713130:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 34 00000100:00100000:3.0:1788813445.718390:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813445.718508:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562766848 00000100:00100000:1.0:1788813445.718519:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562766848 00000100:00100000:1.0:1788813445.718617:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 35 00000100:00100000:1.0:1788813445.718628:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+9:10231:x1875706562766848:12345-192.168.204.47@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788813445.718725:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+9:10231:x1875706562766848:12345-192.168.204.47@tcp:59:lhsmtool_posix.0 Request processed in 99us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813445.718731:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 35 00010000:00010000:1.0:1788813445.820838:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813445.821032:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583776000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813445.821378:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813445.825125:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583776000 00000100:00100000:1.0:1788813445.825141:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583776000 00000100:00100000:1.0:1788813445.825415:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788813445.825429:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583776000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788813445.825490:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813445.825607:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e427800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583776000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 180us (4229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813445.825614:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788813445.825702:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583776000:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788813446.528770:0:11711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788813446.849904:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813447.869450:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813447.873785:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813447.873914:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562766976 00000100:00100000:2.0:1788813447.873924:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562766976 00000100:00100000:2.0:1788813447.873997:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 36 00000100:00100000:2.0:1788813447.874008:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+9:10273:x1875706562766976:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:2.0:1788813447.874029:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813447.874047:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1a63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483dde expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.874147:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1a6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.874163:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1a6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.874174:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1a6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.874189:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1a71 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.874195:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1a71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.874201:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1a71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.874398:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1a6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.874406:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1a6a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.874413:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1a6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.874419:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813447.874423:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1a6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.874438:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1a6a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.874450:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908746516600) 00010000:00010000:2.0:1788813447.874452:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813447.874458:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1a6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.874465:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1a6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.874477:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1a71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.874482:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1a71 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.874487:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1a71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.874491:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813447.874494:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1a71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.874499:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1a71 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.874504:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff908743ce0500) 00010000:00010000:2.0:1788813447.874507:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813447.874509:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1a71 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.874524:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1a71 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.874557:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1a63 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dde expref: 10 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.874567:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908746516600) 00010000:00010000:2.0:1788813447.874569:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813447.874572:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1a63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dde expref: 10 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.874605:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369e00, rc 0) 00000100:00100000:2.0:1788813447.874667:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+9:10273:x1875706562766976:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 660us (892us total) trans 0 rc 301/301 00000100:00100000:2.0:1788813447.874675:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 36 00000100:00080000:1.0:1788813447.875063:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813447.889440:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813447.889518:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562767232 00000100:00100000:2.0:1788813447.889530:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562767232 00000100:00100000:2.0:1788813447.889626:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 37 00000100:00100000:2.0:1788813447.889637:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+9:10273:x1875706562767232:12345-192.168.204.47@tcp:36:lfs.0 00010000:00010000:2.0:1788813447.889695:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813447.889728:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d400/0x6d74dbab2ddb1a1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dc9 expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.889748:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908746516600) 00010000:00010000:2.0:1788813447.889758:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813447.890004:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1a78 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.890025:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1a78 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.890035:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1a78 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.890048:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1a7f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.890054:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1a7f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.890060:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1a7f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813447.891691:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788813447.891710:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1a78 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.891721:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1a78 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.891730:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1a78 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.891736:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369600 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813447.891742:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1a78 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.891750:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1a78 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.891780:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908743ce0400) 00010000:00010000:2.0:1788813447.891783:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813447.891789:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1a78 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813447.891795:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1a78 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788813447.891819:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a539dc46 reply state 000000005f1d75b8 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1a7f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813447.891828:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788813447.892115:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+10:10273:x1875706562767232:12345-192.168.204.47@tcp:36:lfs.0 Request processed in 2474us (2681us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788813447.892124:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 37 00010000:00010000:3.0:1788813447.911901:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1a7f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813447.911920:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1a7f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813447.911928:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1a7f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813447.911934:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813447.911939:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1a7f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813447.911948:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1a7f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813447.911963:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff908743ce0d00) 00010000:00010000:3.0:1788813447.911966:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813447.911972:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1a7f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813447.911990:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1a7f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813448.038758:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813448.038937:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562767360 00000100:00100000:1.0:1788813448.038960:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562767360 00000100:00100000:1.0:1788813448.039027:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 38 00000100:00100000:1.0:1788813448.039037:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+9:10281:x1875706562767360:12345-192.168.204.47@tcp:101:lctl.0 00010000:00010000:1.0:1788813448.039061:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813448.039084:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1a86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483de5 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813448.039158:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb1a8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813448.039174:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb1a8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813448.039186:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb1a8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813448.039224:0:8269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788813448.039228:0:8269:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813448.039268:0:8269:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb1a8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813448.039293:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1a86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483de5 expref: 11 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813448.039310:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb1a8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483de5 expref: 10 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813448.039319:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908746516a00) 00010000:00010000:1.0:1788813448.039322:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813448.039326:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908749d72e00, rc 0) 00000100:00100000:1.0:1788813448.039414:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+10:10281:x1875706562767360:12345-192.168.204.47@tcp:101:lctl.0 Request processed in 377us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813448.039422:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 38 00000100:00100000:2.0:1788813448.114723:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813448.114834:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562767488 00000100:00100000:3.0:1788813448.114844:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562767488 00000100:00100000:3.0:1788813448.114905:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 39 00000100:00100000:3.0:1788813448.114915:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c0c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+10:10287:x1875706562767488:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:3.0:1788813448.114937:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813448.114961:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1a94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483dec expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.115028:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1a9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.115042:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1a9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.115054:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1a9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.115070:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1aa2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.115077:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.115271:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.115385:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0600/0x6d74dbab2ddb1aa9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.115407:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0600/0x6d74dbab2ddb1aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.115415:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0600/0x6d74dbab2ddb1aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813448.115445:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788813448.115448:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813448.115487:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0600/0x6d74dbab2ddb1aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.115499:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1a9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.115507:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1a9b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.115513:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1a9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.115518:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813448.115523:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1a9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.115530:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1a9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.115541:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908746516a00) 00010000:00010000:3.0:1788813448.115544:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813448.115549:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1a9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.115566:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1a9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.115626:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.115633:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1aa2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.115638:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1aa2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.115642:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813448.115645:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1aa2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.115650:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1aa2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.115658:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff908745acab00) 00010000:00010000:3.0:1788813448.115660:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813448.115662:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1aa2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.115668:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1aa2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.115701:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1a94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dec expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.115716:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0600/0x6d74dbab2ddb1aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dec expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.115730:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:3.0:1788813448.115733:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788813448.115735:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad0600, rc 0) 00000100:00100000:3.0:1788813448.115800:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c0c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+11:10287:x1875706562767488:12345-192.168.204.47@tcp:101:bash.0 Request processed in 886us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813448.115808:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 39 00000100:00100000:0.0:1788813448.119794:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813448.120026:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562767744 00000100:00100000:2.0:1788813448.120036:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562767744 00000100:00100000:2.0:1788813448.120098:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 40 00000100:00100000:2.0:1788813448.120108:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+11:10287:x1875706562767744:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:2.0:1788813448.120131:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813448.120150:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1ab0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483df3 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.120282:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1ab7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.120297:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1ab7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.120324:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1ab7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.120340:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1abe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.120347:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1abe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.120354:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1abe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788813448.122562:0:8269:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788813448.122958:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1ac5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813448.122977:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813448.122991:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813448.123034:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1ab7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813448.123041:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1ab7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813448.123048:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1ab7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813448.123067:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813448.123072:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1ab7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813448.123079:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1ab7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813448.123276:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:0.0:1788813448.123281:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813448.123286:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1ab7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813448.123293:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1ab7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813448.123309:0:8269:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008becfe0b reply state 0000000022f0067b transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1abe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813448.123317:0:8269:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788813448.123366:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1ab0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483df3 expref: 14 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813448.123383:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483df3 expref: 13 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813448.123390:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90874a4cb200) 00010000:00010000:0.0:1788813448.123392:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813448.123395:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740031400, rc 0) 00000100:00100000:0.0:1788813448.123542:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+14:10287:x1875706562767744:12345-192.168.204.47@tcp:101:bash.0 Request processed in 3435us (3758us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788813448.123559:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 40 00000100:00100000:0.0:1788813448.130511:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813448.130740:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562767872 00000100:00100000:3.0:1788813448.130750:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562767872 00000100:00100000:3.0:1788813448.130795:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 20 00000100:00100000:3.0:1788813448.130803:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1875706562767872:12345-192.168.204.47@tcp:8:bash.0 00010000:00080000:3.0:1788813448.130835:0:6704:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e90f6370-8c16-4659-9369-1cd146993b4c@192.168.204.47@tcp t0 exp 0000000000000000 cur 390 last 0 00000020:00000080:3.0:1788813448.130872:0:6704:0:(genops.c:1384:class_connect()) connect: client e90f6370-8c16-4659-9369-1cd146993b4c, cookie 0x6d74dbab2ddb1ad3 00002000:00100000:3.0:1788813448.130895:0:6704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e90f6370-8c16-4659-9369-1cd146993b4c/ffff9087739c0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788813448.130920:0:6704:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788813448.131148:0:6704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788813448.131179:0:6704:0:(import.c:65:import_set_state_nolock()) ffff9087739c6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788813448.131258:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+6:2358:x1875706562767872:12345-192.168.204.47@tcp:8:bash.0 Request processed in 454us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813448.131266:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 20 00010000:00010000:2.0:1788813448.132847:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1abe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.132875:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1abe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.132889:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1abe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.132895:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813448.132900:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1abe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.132907:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1abe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.132924:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff908743ce0400) 00010000:00010000:2.0:1788813448.132928:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813448.132954:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1abe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.132961:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1abe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813448.134100:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813448.134185:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562768000 00000100:00100000:3.0:1788813448.134196:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562768000 00000100:00100000:3.0:1788813448.134269:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 21 00000100:00100000:3.0:1788813448.134279:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+6:0:x1875706562768000:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:3.0:1788813448.134299:0:8270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813448.134334:0:8270:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a579d66/0x6d74dbab2ddb1ada lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483dfa expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788813448.134374:0:8270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788813448.134394:0:8270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1788813448.134399:0:8270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813448.134408:0:8270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a579d66/0x6d74dbab2ddb1ada lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dfa expref: 7 pid: 8270 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.134428:0:8270:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004a579d66/0x6d74dbab2ddb1ada lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dfa expref: 7 pid: 8270 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.134441:0:8270:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad1200, rc 0) 00000100:00100000:3.0:1788813448.134504:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+7:0:x1875706562768000:12345-192.168.204.47@tcp:101:bash.0 Request processed in 226us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813448.134511:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 21 00000100:00080000:1.0:1788813448.134618:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813448.137400:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813448.137476:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562768128 00000100:00100000:3.0:1788813448.137486:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562768128 00000100:00100000:3.0:1788813448.137545:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 22 00000100:00100000:3.0:1788813448.137556:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908744578380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+7:10287:x1875706562768128:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:3.0:1788813448.137573:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813448.137625:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006df35e6/0x6d74dbab2ddb1ae1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483e01 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.137659:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004a579d66/0x6d74dbab2ddb1ada lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dfa expref: 8 pid: 8270 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.137687:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813448.137692:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813448.137697:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006df35e6/0x6d74dbab2ddb1ae1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e01 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.137733:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004a579d66/0x6d74dbab2ddb1ada lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dfa expref: 8 pid: 8270 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.137747:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004a579d66/0x6d74dbab2ddb1ada lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dfa expref: 8 pid: 8270 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813448.137761:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e427100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1875706583776128:192.168.204.47@tcp:104: 00000100:00100000:3.0:1788813448.137917:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fab1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788813448.143300:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e427100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1875706583776128:192.168.204.47@tcp:104: 00010000:00010000:3.0:1788813448.143340:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000006df35e6/0x6d74dbab2ddb1ae1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e01 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.143371:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad1000, rc 0) 00000100:00100000:3.0:1788813448.143441:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908744578380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+8:10287:x1875706562768128:12345-192.168.204.47@tcp:101:bash.0 Request processed in 5886us (6048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813448.143451:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 22 00000100:00100000:1.0:1788813448.144465:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813448.144554:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562768256 00000100:00100000:2.0:1788813448.144563:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562768256 00010000:00010000:2.0:1788813448.144634:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004a579d66/0x6d74dbab2ddb1ada lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dfa expref: 8 pid: 8270 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813448.144665:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 35 00000100:00100000:2.0:1788813448.144674:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908744578a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+8:2360:x1875706562768256:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813448.144690:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813448.144716:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004a579d66/0x6d74dbab2ddb1ada lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dfa expref: 8 pid: 8270 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.144729:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004a579d66/0x6d74dbab2ddb1ada lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dfa expref: 8 pid: 8270 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.144757:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a579d66/0x6d74dbab2ddb1ada lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dfa expref: 8 pid: 8270 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.144775:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813448.144779:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813448.144787:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000006df35e6/0x6d74dbab2ddb1ae1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e01 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.144817:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006df35e6/0x6d74dbab2ddb1ae1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e01 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.144870:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000006df35e6/0x6d74dbab2ddb1ae1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e01 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813448.144895:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5834:1875706583776256:192.168.204.47@tcp:105: 00000100:00100000:2.0:1788813448.144975:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff908643a95480 going to sleep for 11 seconds 00000100:00100000:2.0:1788813448.149277:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0c9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5834:1875706583776256:192.168.204.47@tcp:105: 00010000:00010000:2.0:1788813448.149304:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813448.149372:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908744578a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+7:2360:x1875706562768256:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 4697us (4911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813448.149384:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 35 00000100:00100000:3.0:1788813448.151739:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813448.152039:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562768512 00000100:00100000:2.0:1788813448.152050:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562768512 00000100:00100000:2.0:1788813448.152154:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 6 00000100:00100000:2.0:1788813448.152165:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+13:10287:x1875706562768512:12345-192.168.204.47@tcp:35:bash.0 00000100:00100000:2.0:1788813448.152557:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+14:10287:x1875706562768512:12345-192.168.204.47@tcp:35:bash.0 Request processed in 392us (825us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788813448.152565:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 6 00000100:00100000:0.0:1788813448.233726:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813448.233830:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562768768 00000100:00100000:2.0:1788813448.233842:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562768768 00000100:00100000:2.0:1788813448.233910:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 41 00000100:00100000:2.0:1788813448.233920:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+14:10297:x1875706562768768:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:2.0:1788813448.233961:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813448.233984:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1ae8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483e08 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813448.234072:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788813448.234211:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1ae8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e08 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.234224:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908746516a00) 00010000:00010000:2.0:1788813448.234228:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813448.234233:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1ae8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e08 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.234248:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369a00, rc 0) 00000100:00100000:2.0:1788813448.234315:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+15:10297:x1875706562768768:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 396us (598us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788813448.234323:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 41 00000100:00100000:2.0:1788813448.237191:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813448.237328:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562769024 00000100:00100000:0.0:1788813448.237339:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562769024 00000100:00100000:0.0:1788813448.237407:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 7 00000100:00100000:0.0:1788813448.237417:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+15:10297:x1875706562769024:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:0.0:1788813448.237689:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+16:10297:x1875706562769024:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 271us (506us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788813448.237696:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 7 00000100:00100000:0.0:1788813448.307330:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813448.307617:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562769152 00000100:00100000:3.0:1788813448.307627:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562769152 00000100:00100000:3.0:1788813448.307701:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 42 00000100:00100000:3.0:1788813448.307711:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+16:10303:x1875706562769152:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:3.0:1788813448.307737:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813448.307757:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1af6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483e0f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.307823:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1afd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.307837:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1afd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.307848:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1afd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813448.308005:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788813448.308009:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813448.308035:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1afd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.308063:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1af6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e0f expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.308083:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1afd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e0f expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.308099:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:3.0:1788813448.308102:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788813448.308106:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad1c00, rc 0) 00000100:00100000:3.0:1788813448.308170:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+17:10303:x1875706562769152:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 461us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813448.308183:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 42 00000100:00100000:3.0:1788813448.312537:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813448.312784:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562769408 00000100:00100000:2.0:1788813448.312794:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562769408 00000100:00100000:2.0:1788813448.312861:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 43 00000100:00100000:2.0:1788813448.312871:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+17:10303:x1875706562769408:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:2.0:1788813448.313019:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813448.313041:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1b04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483e16 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.313146:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1b0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.313172:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1b0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.313184:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1b0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813448.313196:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788813448.313338:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1b04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e16 expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.313368:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1b0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e16 expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.313376:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90874a4cb200) 00010000:00010000:2.0:1788813448.313379:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813448.313382:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369a00, rc 0) 00000100:00100000:2.0:1788813448.313505:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+19:10303:x1875706562769408:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 634us (976us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788813448.313512:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 43 00000100:00100000:2.0:1788813448.320099:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813448.320402:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562769664 00000100:00100000:0.0:1788813448.320411:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562769664 00000100:00100000:0.0:1788813448.320472:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 44 00000100:00100000:0.0:1788813448.320483:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c0cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+19:10303:x1875706562769664:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:0.0:1788813448.320510:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813448.320532:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1b19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483e1d expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813448.320662:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1b20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813448.320678:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1b20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813448.320691:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1b20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813448.320718:0:8269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788813448.320840:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1b19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e1d expref: 22 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813448.320872:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1b20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e1d expref: 21 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813448.321000:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90874a4cb200) 00010000:00010000:0.0:1788813448.321002:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788813448.321006:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740031000, rc 0) 00000100:00100000:0.0:1788813448.321194:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c0cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+21:10303:x1875706562769664:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 713us (1111us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788813448.321203:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 44 00000100:00100000:0.0:1788813448.324493:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813448.324622:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562769792 00000100:00100000:1.0:1788813448.324632:0:8477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562769792 00000100:00100000:1.0:1788813448.324704:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 2 00000100:00100000:1.0:1788813448.324715:0:8477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+21:2360:x1875706562769792:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813448.324731:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813448.324757:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1b0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e16 expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813448.324776:0:8477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90874a4cb200) 00010000:00010000:1.0:1788813448.324781:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813448.324843:0:8477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+20:2360:x1875706562769792:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 130us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813448.324859:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 2 00000100:00100000:1.0:1788813448.332799:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813448.332906:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562769920 00000100:00100000:3.0:1788813448.332916:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562769920 00000100:00100000:3.0:1788813448.332976:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 23 00000100:00100000:3.0:1788813448.332985:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908744579f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+7:2359:x1875706562769920:12345-192.168.204.47@tcp:1:lfs.0 00010000:00010000:3.0:1788813448.333031:0:8270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016258b30/0x6d74dbab2ddb1b2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.333052:0:8270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000006df35e6/0x6d74dbab2ddb1ae1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e01 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.333062:0:8270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813448.333066:0:8270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788813448.333071:0:8270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016258b30/0x6d74dbab2ddb1b2e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.333106:0:8270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000006df35e6/0x6d74dbab2ddb1ae1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e01 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.333120:0:8270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000006df35e6/0x6d74dbab2ddb1ae1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e01 expref: 7 pid: 6704 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813448.333134:0:8270:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e426680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8270:1875706583776384:192.168.204.47@tcp:104: 00000100:00100000:3.0:1788813448.333233:0:8270:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fab1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788813448.337132:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813448.337246:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562770048 00000100:00100000:1.0:1788813448.337256:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562770048 00002000:00100000:1.0:1788813448.337308:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff90876e425880 x1875706562770048/t0(0) o4->e90f6370-8c16-4659-9369-1cd146993b4c@192.168.204.47@tcp:264/0 lens 504/0 e 0 to 0 dl 1788813459 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788813448.337320:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90876e425880 with x1875706562770048 ext(0->12) 00010000:00010000:1.0:1788813448.337329:0:6710:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000006df35e6/0x6d74dbab2ddb1ae1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e01 expref: 8 pid: 6704 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813448.337378:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000006df35e6/0x6d74dbab2ddb1ae1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e01 expref: 8 pid: 6704 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788813448.337387:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90876e425880 00000100:00100000:1.0:1788813448.337426:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 0 00000100:00100000:1.0:1788813448.337438:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e90f6370-8c16-4659-9369-1cd146993b4c+8:2360:x1875706562770048:12345-192.168.204.47@tcp:4:lfs.0 00000100:00100000:0.0:1788813448.341654:0:8270:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e426680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8270:1875706583776384:192.168.204.47@tcp:104: 00010000:00010000:0.0:1788813448.341685:0:8270:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000016258b30/0x6d74dbab2ddb1b2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1788813448.377770:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e90f6370-8c16-4659-9369-1cd146993b4c 00000001:00080000:1.0:1788813448.403131:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1788813448.403367:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e90f6370-8c16-4659-9369-1cd146993b4c+7:2360:x1875706562770048:12345-192.168.204.47@tcp:4:lfs.0 Request processed in 65917us (66230us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788813448.403384:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 0 00002000:00100000:2.0:1788813448.403397:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff90876e425880 x1875706562770048/t4294967299(0) o4->e90f6370-8c16-4659-9369-1cd146993b4c@192.168.204.47@tcp:264/0 lens 504/448 e 0 to 0 dl 1788813459 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788813448.403407:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90876e425880 with x1875706562770048 ext(0->12) 00010000:00010000:2.0:1788813448.403430:0:6710:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000006df35e6/0x6d74dbab2ddb1ae1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e01 expref: 7 pid: 6704 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.403450:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000006df35e6/0x6d74dbab2ddb1ae1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e01 expref: 7 pid: 6704 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788813448.403457:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90876e425880 00000100:00100000:0.0:1788813448.407051:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813448.407160:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562770176 00000100:00100000:2.0:1788813448.407171:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562770176 00010000:00010000:2.0:1788813448.407211:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000006df35e6/0x6d74dbab2ddb1ae1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e01 expref: 7 pid: 6704 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813448.407254:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 36 00000100:00100000:2.0:1788813448.407264:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+7:2360:x1875706562770176:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813448.407278:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788813448.407295:0:5835:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788813448.407298:0:5835:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788813448 00002000:00010000:2.0:1788813448.407300:0:5835:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788813449 00002000:00010000:2.0:1788813448.407303:0:5835:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788813448 00002000:00010000:2.0:1788813448.407306:0:5835:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1788813448.407311:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000006df35e6/0x6d74dbab2ddb1ae1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e01 expref: 7 pid: 6704 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.407324:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000006df35e6/0x6d74dbab2ddb1ae1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e01 expref: 7 pid: 6704 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.407346:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006df35e6/0x6d74dbab2ddb1ae1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e01 expref: 7 pid: 6704 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.407385:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813448.407388:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813448.407394:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000016258b30/0x6d74dbab2ddb1b2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.407405:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016258b30/0x6d74dbab2ddb1b2e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.407436:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813448.407491:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+6:2360:x1875706562770176:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 228us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813448.407498:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 36 00010000:00010000:3.0:1788813448.408274:0:8270:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000016258b30/0x6d74dbab2ddb1b2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.408288:0:8270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016258b30/0x6d74dbab2ddb1b2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.408318:0:8270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016258b30/0x6d74dbab2ddb1b2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.408326:0:8270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016258b30/0x6d74dbab2ddb1b2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.408334:0:8270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016258b30/0x6d74dbab2ddb1b2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.408342:0:8270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1800 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:3.0:1788813448.408347:0:8270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016258b30/0x6d74dbab2ddb1b2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.408367:0:8270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016258b30/0x6d74dbab2ddb1b2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.408382:0:8270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016258b30/0x6d74dbab2ddb1b2e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.408406:0:8270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016258b30/0x6d74dbab2ddb1b2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813448.408488:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908744579f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+5:2359:x1875706562769920:12345-192.168.204.47@tcp:1:lfs.0 Request processed in 75502us (75700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813448.408497:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 23 00000100:00100000:0.0:1788813448.411704:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813448.411872:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562770432 00000100:00100000:2.0:1788813448.411893:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562770432 00000100:00100000:2.0:1788813448.411948:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 8 00000100:00100000:2.0:1788813448.411959:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+20:10303:x1875706562770432:12345-192.168.204.47@tcp:35:lfs.0 00000004:00010000:2.0:1788813448.412026:0:5852:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1b20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e1d expref: 20 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788813448.412303:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1788813448.412371:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788813448.412910:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1788813448.412969:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1b35 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.412987:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1ac5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483df3 expref: 24 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.413002:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1b35 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.413042:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483df3 expref: 24 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.413058:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1ac5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483df3 expref: 24 pid: 8269 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813448.413071:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0cbb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5852:1875706583776512:192.168.204.47@tcp:104: 00000100:00100000:2.0:1788813448.413158:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff908643a95480 going to sleep for 11 seconds 00000100:00100000:0.0:1788813448.416903:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813448.417212:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562770560 00000100:00100000:1.0:1788813448.417221:0:8477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562770560 00010000:00010000:1.0:1788813448.417265:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1ac5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483df3 expref: 25 pid: 8269 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813448.417311:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 37 00000100:00100000:1.0:1788813448.417321:0:8477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+25:2359:x1875706562770560:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813448.417338:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813448.417345:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1ac5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483df3 expref: 25 pid: 8269 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813448.417370:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1ac5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483df3 expref: 25 pid: 8269 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813448.417392:0:8477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90874a4cb200) 00010000:00010000:1.0:1788813448.417398:0:8477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1b35 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813448.417426:0:8477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1b35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813448.417434:0:8477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1b35 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813448.417454:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813448.417518:0:8477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+25:2359:x1875706562770560:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 197us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813448.417525:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 37 00010000:00010000:2.0:1788813448.419260:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1ac5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483df3 expref: 24 pid: 8269 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813448.419283:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0cbb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5852:1875706583776512:192.168.204.47@tcp:104: 00010000:00010000:2.0:1788813448.419311:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1b35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.419321:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1b35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.419326:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1b35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788813448.419493:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788813448.419926:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1788813448.420050:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0cbb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1875706583776640:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788813448.420138:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813448.420176:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c1c7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813448.420363:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583776640 00000100:00100000:3.0:1788813448.420372:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583776640 00000100:00100000:3.0:1788813448.420442:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788813448.420450:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c0ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875706583776640:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788813448.420548:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c0ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875706583776640:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 98us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813448.420555:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788813448.421050:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0cbb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1875706583776640:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:1.0:1788813448.421823:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788813448.422100:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1788813448.422182:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9087739c8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1875706583776768:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788813448.422255:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813448.422292:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876e497c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813448.422466:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583776768 00000100:00100000:2.0:1788813448.422473:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583776768 00000100:00100000:2.0:1788813448.422521:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813448.422530:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875706583776768:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788813448.423182:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5852:x1875706583776768:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 650us (924us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788813448.423192:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788813448.423272:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9087739c8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1875706583776768:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788813448.423328:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1788813448.423404:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1b35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813448.423415:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1b35 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813448.423422:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1b35 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813448.423428:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368e00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813448.423433:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1b35 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813448.423441:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1b35 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813448.423457:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90874a4cb200) 00010000:00010000:0.0:1788813448.423460:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788813448.423465:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1b35 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813448.423472:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1b35 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788813448.426303:0:5852:0:(mdd_object.c:4181:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788813448.428217:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788813448.428241:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 390670659656ns, next at 391670654269ns, rc = 0 00000001:00080000:0.0:1788813448.428257:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1788813448.428347:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90874a4cb200) 00010000:00010000:0.0:1788813448.428363:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788813448.428375:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1b20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e1d expref: 28 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813448.428502:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+27:10303:x1875706562770432:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 16544us (16820us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788813448.428512:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 8 00000020:00080000:0.0:1788813448.428517:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788813448.433918:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813448.434258:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562770688 00000100:00100000:3.0:1788813448.434268:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562770688 00000100:00100000:3.0:1788813448.434333:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 45 00000100:00100000:3.0:1788813448.434344:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+27:10303:x1875706562770688:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:3.0:1788813448.434380:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813448.434405:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1b3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483e24 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.434471:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1b3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e24 expref: 28 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.434486:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1b3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e24 expref: 28 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.434524:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745acab00) 00010000:00010000:3.0:1788813448.434528:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813448.434532:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad1800, rc 0) 00000100:00100000:3.0:1788813448.434615:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+28:10303:x1875706562770688:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 273us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813448.434622:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 45 00000100:00100000:1.0:1788813448.439950:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813448.440250:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562770944 00000100:00100000:0.0:1788813448.440261:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562770944 00000100:00100000:0.0:1788813448.440322:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 9 00000100:00100000:0.0:1788813448.440333:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874adad450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+28:10303:x1875706562770944:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:0.0:1788813448.440574:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874adad450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+29:10303:x1875706562770944:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 243us (634us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1788813448.440606:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 9 00000100:00100000:0.0:1788813448.527266:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813448.527495:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562771200 00000100:00100000:3.0:1788813448.527504:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562771200 00000100:00100000:3.0:1788813448.527566:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 46 00000100:00100000:3.0:1788813448.527577:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+29:10313:x1875706562771200:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:3.0:1788813448.527634:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813448.527657:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1b43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483e2b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813448.527755:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788813448.527900:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1b43 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e2b expref: 31 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.527915:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908746516a00) 00010000:00010000:3.0:1788813448.527918:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788813448.527924:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1b43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e2b expref: 31 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.527938:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad0c00, rc 0) 00000100:00100000:3.0:1788813448.527991:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+30:10313:x1875706562771200:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 416us (735us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1788813448.528013:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 46 00000100:00100000:1.0:1788813448.535164:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813448.535292:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562771328 00000100:00100000:3.0:1788813448.535302:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562771328 00000100:00100000:3.0:1788813448.535373:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 47 00000100:00100000:3.0:1788813448.535382:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908744578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+30:10313:x1875706562771328:12345-192.168.204.47@tcp:34:lfs.0 00010000:00010000:3.0:1788813448.535461:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1b51 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535479:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1b51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535491:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1b51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535507:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1b58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535514:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535520:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535638:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1b5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535647:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535654:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813448.535713:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535724:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1b51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535731:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1b51 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535738:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1b51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535744:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad0000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813448.535748:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1b51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535755:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1b51 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535767:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:3.0:1788813448.535770:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813448.535775:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1b51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535782:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1b51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535795:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535802:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1b58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535814:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1b58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535820:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813448.535823:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1b58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535829:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1b58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535838:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff908745aca700) 00010000:00010000:3.0:1788813448.535855:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813448.535859:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1b58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535865:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1b58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535887:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535894:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1b5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535900:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1b5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535905:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813448.535907:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1b5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535923:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1b5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535931:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745acab00) 00010000:00010000:3.0:1788813448.535933:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813448.535936:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1b5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.535941:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1b5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813448.536005:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908744578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+30:10313:x1875706562771328:12345-192.168.204.47@tcp:34:lfs.0 Request processed in 623us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813448.536012:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 47 00000100:00100000:1.0:1788813448.539151:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813448.539468:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562771584 00000100:00100000:0.0:1788813448.539478:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562771584 00000100:00100000:0.0:1788813448.539647:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 10 00000100:00100000:0.0:1788813448.539660:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874457ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+30:10313:x1875706562771584:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:0.0:1788813448.540008:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874457ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+31:10313:x1875706562771584:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 349us (863us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788813448.540016:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 10 00000100:00100000:0.0:1788813448.586107:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813448.586299:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562771840 00000100:00100000:3.0:1788813448.586309:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562771840 00000100:00100000:3.0:1788813448.586404:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 48 00000100:00100000:3.0:1788813448.586414:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+31:10316:x1875706562771840:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:3.0:1788813448.586439:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813448.586461:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1b66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483e32 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.586542:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1b6d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.586556:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1b6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.586567:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1b6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.586635:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1b74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.586642:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1b74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.586649:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1b74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.586768:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1b7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.586777:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1b7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.586784:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1b7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813448.586794:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788813448.586923:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1b6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.586931:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1b6d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.586939:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1b6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.586945:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813448.586950:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1b6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.586967:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1b6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.586978:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:3.0:1788813448.586981:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813448.586986:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1b6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.586992:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1b6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.587005:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1b74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.587011:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1b74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.587016:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1b74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.587021:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad0000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813448.587023:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1b74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.587029:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1b74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.587035:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff908745aca700) 00010000:00010000:3.0:1788813448.587038:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813448.587040:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1b74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.587055:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1b74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.587097:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1b66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e32 expref: 34 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.587110:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1b7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e32 expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.587117:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745acab00) 00010000:00010000:3.0:1788813448.587119:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813448.587122:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad0c00, rc 0) 00000100:00100000:2.0:1788813448.587613:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+33:10316:x1875706562771840:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 1198us (1517us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1788813448.587622:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 48 00000100:00100000:1.0:1788813448.592356:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813448.592462:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562771968 00000100:00100000:2.0:1788813448.592473:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562771968 00000100:00100000:2.0:1788813448.592566:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 49 00000100:00100000:2.0:1788813448.592577:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908744578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+33:10316:x1875706562771968:12345-192.168.204.47@tcp:54:lfs.0 00010000:00010000:2.0:1788813448.592680:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1b89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.592699:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1b89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.592712:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1b89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.592740:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1b89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.592747:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1b89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.592768:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1b89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.592775:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369600 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813448.592779:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1b89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.592788:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1b89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.592799:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745acab00) 00010000:00010000:2.0:1788813448.592802:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813448.592807:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1b89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813448.592812:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1b89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813448.592891:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908744578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+33:10316:x1875706562771968:12345-192.168.204.47@tcp:54:lfs.0 Request processed in 315us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813448.592898:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 49 00000100:00100000:1.0:1788813448.597889:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813448.598364:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562772224 00000100:00100000:2.0:1788813448.598375:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562772224 00000100:00100000:2.0:1788813448.598431:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 11 00000100:00100000:2.0:1788813448.598441:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908744579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+33:10316:x1875706562772224:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:2.0:1788813448.598816:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908744579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+34:10316:x1875706562772224:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 375us (934us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788813448.598824:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 11 00010000:00010000:2.0:1788813448.893132:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813448.893199:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788813448.893236:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583776896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813448.893320:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813448.893549:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583776896 00000100:00100000:3.0:1788813448.893559:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583776896 00000100:00100000:3.0:1788813448.893689:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788813448.893700:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1875706583776896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813448.893725:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1788813448.893783:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1875706583776896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813448.893790:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788813448.893887:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583776896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813448.904187:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813448.904295:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562772480 00000100:00100000:1.0:1788813448.904306:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562772480 00000100:00100000:1.0:1788813448.904380:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 50 00000100:00100000:1.0:1788813448.904392:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+34:10347:x1875706562772480:12345-192.168.204.47@tcp:101:cat.0 00010000:00010000:1.0:1788813448.904416:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813448.904438:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1b90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483e39 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813448.904544:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72400/0x6d74dbab2ddb1b97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813448.904559:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72400/0x6d74dbab2ddb1b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813448.904623:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72400/0x6d74dbab2ddb1b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813448.904637:0:8269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788813448.904777:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1b90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e39 expref: 37 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813448.904794:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72400/0x6d74dbab2ddb1b97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e39 expref: 36 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813448.904803:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745acab00) 00010000:00010000:1.0:1788813448.904806:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813448.904810:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908749d72400, rc 0) 00000100:00100000:1.0:1788813448.904869:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+36:10347:x1875706562772480:12345-192.168.204.47@tcp:101:cat.0 Request processed in 480us (694us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788813448.904876:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 50 00000100:00100000:1.0:1788813448.909316:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813448.909404:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562772736 00000100:00100000:2.0:1788813448.909415:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562772736 00000100:00100000:2.0:1788813448.909479:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 12 00000100:00100000:2.0:1788813448.909491:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+36:10347:x1875706562772736:12345-192.168.204.47@tcp:35:cat.0 00000100:00100000:2.0:1788813448.910056:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+37:10347:x1875706562772736:12345-192.168.204.47@tcp:35:cat.0 Request processed in 566us (748us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788813448.910064:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 12 00000100:00100000:3.0:1788813448.910154:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813448.910522:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562772864 00000100:00100000:1.0:1788813448.910529:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562772864 00000100:00100000:1.0:1788813448.910613:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 3 00000100:00100000:1.0:1788813448.910623:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600e1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+37:2361:x1875706562772864:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813448.910637:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813448.910663:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72400/0x6d74dbab2ddb1b97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e39 expref: 37 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813448.910681:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745acab00) 00010000:00010000:1.0:1788813448.910694:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813448.910731:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600e1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+36:2361:x1875706562772864:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 110us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813448.932326:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 3 00000100:00100000:0.0:1788813448.974423:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813448.974746:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562773120 00000100:00100000:3.0:1788813448.974756:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562773120 00000100:00100000:3.0:1788813448.974825:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 51 00000100:00100000:3.0:1788813448.974845:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+36:10353:x1875706562773120:12345-192.168.204.47@tcp:101:dd.0 00010000:00010000:3.0:1788813448.974881:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813448.974902:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788813448.974938:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1afd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e0f expref: 36 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.974959:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:3.0:1788813448.974964:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813448.974978:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1ba5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483e40 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.975202:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1bac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.975217:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1b7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e32 expref: 36 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.975227:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1bac lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.975263:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1b7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e32 expref: 36 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.975278:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1b7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e32 expref: 36 pid: 5851 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813448.975293:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e427b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1875706583777024:192.168.204.47@tcp:104: 00000100:00100000:3.0:1788813448.976015:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fab1600 going to sleep for 11 seconds 00000100:00100000:3.0:1788813448.984759:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e427b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1875706583777024:192.168.204.47@tcp:104: 00010000:00010000:3.0:1788813448.984790:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1bac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813448.985429:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813448.985511:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562773248 00000100:00100000:1.0:1788813448.985522:0:8477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562773248 00010000:00010000:1.0:1788813448.985571:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1b7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e32 expref: 37 pid: 5851 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813448.985658:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 38 00000100:00100000:1.0:1788813448.985671:0:8477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+37:2359:x1875706562773248:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813448.985690:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813448.985699:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1b7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e32 expref: 37 pid: 5851 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813448.985713:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1b7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e32 expref: 37 pid: 5851 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813448.985734:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1b7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e32 expref: 37 pid: 5851 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813448.985753:0:8477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745acab00) 00010000:00010000:1.0:1788813448.985758:0:8477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1bac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813448.985767:0:8477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1bac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813448.985776:0:8477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1bac lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813448.985810:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813448.985882:0:8477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+36:2359:x1875706562773248:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 213us (455us total) trans 0 rc 0/0 00010000:00010000:3.0:1788813448.985889:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1bac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813448.985893:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 38 00010000:00010000:3.0:1788813448.985902:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1bac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813448.985923:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788813448.986116:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1ba5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e40 expref: 37 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.986132:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1bac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e40 expref: 36 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.986140:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745acab00) 00010000:00010000:3.0:1788813448.986143:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788813448.986145:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad0000, rc 0) 00000100:00100000:3.0:1788813448.986172:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+36:10353:x1875706562773120:12345-192.168.204.47@tcp:101:dd.0 Request processed in 11339us (11765us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788813448.986179:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 51 00000100:00100000:2.0:1788813448.988868:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813448.988972:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562773504 00000100:00100000:1.0:1788813448.988983:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562773504 00000100:00100000:1.0:1788813448.989077:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 52 00000100:00100000:1.0:1788813448.989098:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c0caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+36:10353:x1875706562773504:12345-192.168.204.47@tcp:36:dd.0 00010000:00010000:1.0:1788813448.989422:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1bba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813448.989440:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1bba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813448.989451:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1bba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788813448.989510:0:8269:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1788813448.989537:0:8269:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f37f8d85 reply state 00000000ced2c7da transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1bba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813448.989545:0:8269:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788813448.989680:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c0caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+39:10353:x1875706562773504:12345-192.168.204.47@tcp:36:dd.0 Request processed in 593us (820us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1788813448.989687:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 52 00000020:00080000:1.0:1788813448.989691:0:8269:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788813448.991764:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1bba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.991781:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1bba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.991790:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1bba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.991796:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d72800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813448.991810:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1bba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.991824:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1bba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.991840:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745acab00) 00010000:00010000:3.0:1788813448.991843:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813448.991849:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1bba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813448.991856:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1bba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813449.256416:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813449.256573:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562773632 00000100:00100000:1.0:1788813449.256626:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562773632 00000100:00100000:1.0:1788813449.256699:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 53 00000100:00100000:1.0:1788813449.256724:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c0ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+38:10368:x1875706562773632:12345-192.168.204.47@tcp:101:stat.0 00010000:00010000:1.0:1788813449.256749:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813449.256770:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb1bc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483e47 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813449.256838:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73000/0x6d74dbab2ddb1bc8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813449.256871:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73000/0x6d74dbab2ddb1bc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813449.256883:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73000/0x6d74dbab2ddb1bc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813449.256898:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72000/0x6d74dbab2ddb1bcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813449.256905:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72000/0x6d74dbab2ddb1bcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813449.256912:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72000/0x6d74dbab2ddb1bcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813449.256999:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb1bd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813449.257010:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1bac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e40 expref: 39 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813449.257018:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb1bd6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813449.257063:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1bac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e40 expref: 39 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813449.257077:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1bac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e40 expref: 39 pid: 5849 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813449.257090:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876f9a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875706583777152:192.168.204.47@tcp:104: 00000100:00100000:1.0:1788813449.257182:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087486e4240 going to sleep for 11 seconds 00000100:00080000:3.0:1788813449.257531:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813449.266759:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813449.266869:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562773888 00000100:00100000:0.0:1788813449.266879:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562773888 00000100:00100000:0.0:1788813449.266939:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 13 00000100:00100000:0.0:1788813449.266949:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c0cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+40:5599:x1875706562773888:12345-192.168.204.47@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788813449.267486:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c0cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+41:5599:x1875706562773888:12345-192.168.204.47@tcp:35:ldlm_bl.0 Request processed in 536us (734us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1788813449.267495:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 13 00000100:00100000:1.0:1788813449.268050:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876f9a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875706583777152:192.168.204.47@tcp:104: 00010000:00010000:1.0:1788813449.268081:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb1bd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813449.270300:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813449.270390:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562774016 00000100:00100000:2.0:1788813449.270401:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562774016 00010000:00010000:2.0:1788813449.270442:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1bac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e40 expref: 41 pid: 5849 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813449.270498:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 39 00000100:00100000:2.0:1788813449.270508:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+41:2362:x1875706562774016:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813449.270523:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813449.270531:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1bac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e40 expref: 41 pid: 5849 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.270544:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1bac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e40 expref: 41 pid: 5849 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.270566:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1bac lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e40 expref: 41 pid: 5849 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.270622:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745acab00) 00010000:00010000:2.0:1788813449.270629:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb1bd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.270639:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb1bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.270647:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb1bd6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.270682:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813449.270740:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+40:2362:x1875706562774016:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 232us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813449.270747:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 39 00010000:00010000:3.0:1788813449.270865:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb1bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.270873:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb1bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813449.270919:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788813449.270924:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813449.270968:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb1bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.270981:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb1bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.270989:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73000/0x6d74dbab2ddb1bc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.270995:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73000/0x6d74dbab2ddb1bc8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.271007:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73000/0x6d74dbab2ddb1bc8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.271013:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813449.271016:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73000/0x6d74dbab2ddb1bc8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.271025:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73000/0x6d74dbab2ddb1bc8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.271034:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:3.0:1788813449.271037:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813449.271041:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73000/0x6d74dbab2ddb1bc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.271047:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73000/0x6d74dbab2ddb1bc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.271057:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72000/0x6d74dbab2ddb1bcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.271062:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72000/0x6d74dbab2ddb1bcf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.271068:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72000/0x6d74dbab2ddb1bcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.271073:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d72000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813449.271076:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72000/0x6d74dbab2ddb1bcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.271094:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72000/0x6d74dbab2ddb1bcf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.271102:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff908746516b00) 00010000:00010000:3.0:1788813449.271104:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813449.271108:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72000/0x6d74dbab2ddb1bcf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.271113:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72000/0x6d74dbab2ddb1bcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.271151:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb1bc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e47 expref: 40 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.271165:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb1bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e47 expref: 39 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.271172:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745acab00) 00010000:00010000:3.0:1788813449.271174:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813449.271176:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908749d72a00, rc 0) 00000100:00100000:3.0:1788813449.271204:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c0ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+39:10368:x1875706562773632:12345-192.168.204.47@tcp:101:stat.0 Request processed in 14484us (14799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813449.271223:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 53 00000100:00100000:2.0:1788813449.356112:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813449.356233:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562774272 00000100:00100000:0.0:1788813449.356244:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562774272 00000100:00100000:0.0:1788813449.356495:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 54 00000100:00100000:0.0:1788813449.356508:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c0cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+39:10374:x1875706562774272:12345-192.168.204.47@tcp:36:truncate.0 00010000:00010000:0.0:1788813449.356575:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813449.356632:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb1bd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e47 expref: 39 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813449.356651:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745acab00) 00010000:00010000:0.0:1788813449.356656:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813449.356888:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1bdd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813449.356920:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1bdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813449.356931:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1bdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788813449.356987:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1788813449.357010:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a5c45f6 reply state 000000000b57d9f6 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1bdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813449.357020:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788813449.357141:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c0cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+41:10374:x1875706562774272:12345-192.168.204.47@tcp:36:truncate.0 Request processed in 635us (1038us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788813449.357149:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 54 00000020:00080000:0.0:1788813449.357154:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788813449.360869:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1bdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.360888:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1bdd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.360916:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1bdd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.360922:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740030a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813449.360926:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1bdd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.360935:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1bdd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.360951:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745acab00) 00010000:00010000:3.0:1788813449.360954:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813449.360959:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1bdd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.360966:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1bdd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788813449.486392:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967338 is committed 00000004:00080000:1.0:1788813449.486425:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788813449.486452:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90876e497240 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788813449.486465:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff908748140400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90876e497b40 00000020:00080000:1.0:1788813449.486468:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff908748140d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90876fa9c800 00000020:00080000:3.0:1788813449.486771:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788813449.486910:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788813449.486922:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813449.486943:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877be46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583777280:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788813449.487024:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813449.487231:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583777280 00000100:00100000:0.0:1788813449.487238:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583777280 00000100:00100000:0.0:1788813449.487284:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788813449.487294:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1875706583777280:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788813449.487321:0:6705:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1788813449.487368:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9f2088, atime: 0x6a9f2089, ctime: 0x6a9f2088, blocks: 0xb 00010000:00010000:0.0:1788813449.487376:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb1be4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813449.487392:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=391s v=(0 0) 00010000:00010000:0.0:1788813449.487396:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813449.487401:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb1be4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813449.487439:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb1be4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813449.487449:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb1be4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813449.487604:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb1be4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813449.487625:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788813449.488164:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e427b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3319:x1875706583777280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 869us (1137us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788813449.488171:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788813449.488202:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:3.0:1788813449.488573:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90877be46a00/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788813449.488608:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877be46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583777280:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788813449.488796:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb1be4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813449.488807:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031000 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813449.488812:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb1be4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813449.488823:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb1be4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813449.488954:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb1be4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813449.488975:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb1be4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813449.488997:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813449.488999:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813449.489001:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813449.554692:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813449.554876:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562774400 00000100:00100000:3.0:1788813449.554887:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562774400 00000100:00100000:3.0:1788813449.554951:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 55 00000100:00100000:3.0:1788813449.554961:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c0c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+10:10388:x1875706562774400:12345-192.168.204.47@tcp:101:stat.0 00010000:00010000:3.0:1788813449.555005:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813449.555028:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1beb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483e4e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.555095:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1bf2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.555109:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1bf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.555120:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1bf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.555136:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1bf9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.555143:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.555149:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.555727:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1c00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.555738:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1c00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.555746:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1c00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813449.555782:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788813449.555793:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813449.555818:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1c00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.555832:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1c00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.556091:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1bf2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.556100:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1bf2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.556106:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1bf2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.556112:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1c00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813449.556116:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1bf2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.556124:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1bf2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.556137:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:3.0:1788813449.556140:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813449.556145:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1bf2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.556151:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1bf2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.556379:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.556398:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1bf9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.556404:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1bf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.556409:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813449.556412:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1bf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.556418:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1bf9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.556426:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff908745aca700) 00010000:00010000:3.0:1788813449.556429:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813449.556431:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1bf9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.556436:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1bf9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.556474:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1beb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e4e expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.556488:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1c00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e4e expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.556496:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745acab00) 00010000:00010000:3.0:1788813449.556498:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813449.556507:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad1200, rc 0) 00000100:00100000:2.0:1788813449.559940:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c0c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+11:10388:x1875706562774400:12345-192.168.204.47@tcp:101:stat.0 Request processed in 4968us (5247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813449.559953:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 55 00000100:00100000:2.0:1788813449.664519:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813449.664626:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562774656 00000100:00100000:1.0:1788813449.664637:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562774656 00000100:00100000:1.0:1788813449.664714:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 56 00000100:00100000:1.0:1788813449.664725:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c0c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+11:10398:x1875706562774656:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:1.0:1788813449.664749:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813449.664771:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb1c07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483e55 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813449.664903:0:8269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788813449.665125:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb1c07 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e55 expref: 13 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813449.665140:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908746516a00) 00010000:00010000:1.0:1788813449.665144:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788813449.665150:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb1c07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e55 expref: 13 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813449.665162:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908749d73a00, rc 0) 00000100:00100000:1.0:1788813449.665228:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c0c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+12:10398:x1875706562774656:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 505us (722us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1788813449.665236:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 56 00000100:00100000:0.0:1788813449.667972:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813449.668212:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562774912 00000100:00100000:2.0:1788813449.668223:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562774912 00000100:00100000:2.0:1788813449.668284:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 14 00000100:00100000:2.0:1788813449.668294:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+12:10398:x1875706562774912:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:2.0:1788813449.668551:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+13:10398:x1875706562774912:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 257us (587us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788813449.668614:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 14 00000100:00100000:2.0:1788813449.728049:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813449.728435:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562775168 00000100:00100000:1.0:1788813449.728445:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562775168 00000100:00100000:2.0:1788813449.728542:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 57 00000100:00100000:2.0:1788813449.728555:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c0c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+13:10404:x1875706562775168:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:2.0:1788813449.728609:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813449.728631:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb1c15 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483e5c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.728745:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1c1c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.728761:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1c00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e4e expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.728769:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1c1c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.728803:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1c00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e4e expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.728818:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1c00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e4e expref: 14 pid: 5849 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813449.728831:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c0c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1875706583777408:192.168.204.47@tcp:104: 00000100:00100000:2.0:1788813449.729065:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c1c7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813449.734045:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813449.734225:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562775296 00000100:00100000:3.0:1788813449.734238:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562775296 00010000:00010000:3.0:1788813449.734281:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1c00 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e4e expref: 15 pid: 5849 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813449.734388:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c0c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1875706583777408:192.168.204.47@tcp:104: 00010000:00010000:2.0:1788813449.734435:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1c1c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813449.734495:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 40 00000100:00100000:3.0:1788813449.734506:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e90f6370-8c16-4659-9369-1cd146993b4c+15:2359:x1875706562775296:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813449.734537:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813449.734545:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1c00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e4e expref: 15 pid: 5849 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.734558:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1c00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e4e expref: 15 pid: 5849 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.734608:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1c00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e4e expref: 15 pid: 5849 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.734625:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745acab00) 00010000:00010000:3.0:1788813449.734630:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1c1c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.734639:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1c1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.734648:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1c1c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.734678:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813449.734751:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e90f6370-8c16-4659-9369-1cd146993b4c+14:2359:x1875706562775296:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 246us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813449.734759:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 40 00010000:00010000:2.0:1788813449.734812:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1c1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.734826:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1c1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813449.734847:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788813449.735018:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb1c15 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e5c expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.735035:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1c1c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e5c expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.735043:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745acab00) 00010000:00010000:2.0:1788813449.735045:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788813449.735048:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369e00, rc 0) 00000100:00100000:2.0:1788813449.735087:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c0c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+14:10404:x1875706562775168:12345-192.168.204.47@tcp:101:bash.0 Request processed in 6535us (7050us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788813449.735103:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 57 00000100:00100000:0.0:1788813449.740527:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813449.740736:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562775552 00000100:00100000:1.0:1788813449.740747:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562775552 00000100:00100000:1.0:1788813449.740813:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 58 00000100:00100000:1.0:1788813449.740834:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+14:10404:x1875706562775552:12345-192.168.204.47@tcp:36:bash.0 00010000:00010000:1.0:1788813449.741293:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb1c2a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813449.741312:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb1c2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813449.741332:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb1c2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788813449.741401:0:8269:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1788813449.741426:0:8269:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc05d7fe reply state 0000000099b5df69 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb1c2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813449.741435:0:8269:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788813449.741621:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+17:10404:x1875706562775552:12345-192.168.204.47@tcp:36:bash.0 Request processed in 789us (1103us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1788813449.741628:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 58 00000020:00080000:1.0:1788813449.741632:0:8269:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788813449.745177:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb1c2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.745196:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb1c2a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.745204:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb1c2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.745210:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813449.745216:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb1c2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.745224:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb1c2a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.745245:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745acab00) 00010000:00010000:3.0:1788813449.745248:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813449.745254:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb1c2a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813449.745261:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb1c2a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813449.750752:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813449.750846:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562775680 00000100:00100000:1.0:1788813449.750865:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562775680 00000100:00100000:1.0:1788813449.750932:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 59 00000100:00100000:1.0:1788813449.750943:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+16:10404:x1875706562775680:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:1.0:1788813449.750970:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813449.750993:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb1c31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483e63 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813449.751086:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb1c38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813449.751111:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1c1c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e5c expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813449.751120:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb1c38 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813449.751156:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1c1c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e5c expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813449.751189:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1c1c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e5c expref: 17 pid: 5849 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813449.751204:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876f9a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875706583777536:192.168.204.47@tcp:104: 00000100:00100000:1.0:1788813449.751294:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff908759e3f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813449.753760:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813449.753863:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562775808 00000100:00100000:2.0:1788813449.753872:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562775808 00010000:00010000:2.0:1788813449.753912:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1c1c lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e5c expref: 18 pid: 5849 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813449.753956:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 41 00000100:00100000:2.0:1788813449.753966:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+18:2360:x1875706562775808:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813449.753994:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813449.754001:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1c1c lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e5c expref: 18 pid: 5849 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.754015:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1c1c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e5c expref: 18 pid: 5849 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.754038:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745acab00) 00010000:00010000:2.0:1788813449.754043:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb1c38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.754053:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb1c38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.754060:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb1c38 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.754077:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813449.754276:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+18:2360:x1875706562775808:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 310us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813449.754283:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 41 00010000:00010000:1.0:1788813449.754799:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1c1c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e5c expref: 17 pid: 5849 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813449.754819:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876f9a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875706583777536:192.168.204.47@tcp:104: 00010000:00010000:1.0:1788813449.755066:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb1c38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813449.755077:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb1c38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813449.755084:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb1c38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813449.755183:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788813449.755188:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813449.755209:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb1c38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813449.755241:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb1c31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e63 expref: 17 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813449.755258:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb1c38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e63 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813449.755278:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745acab00) 00010000:00010000:1.0:1788813449.755281:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813449.755285:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908749d72a00, rc 0) 00000100:00100000:1.0:1788813449.755398:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+16:10404:x1875706562775680:12345-192.168.204.47@tcp:101:bash.0 Request processed in 4456us (4656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813449.755406:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 59 00000100:00100000:0.0:1788813449.758427:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813449.758562:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562776064 00000100:00100000:2.0:1788813449.758572:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562776064 00000100:00100000:2.0:1788813449.758784:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 15 00000100:00100000:2.0:1788813449.758796:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874adac050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+16:10404:x1875706562776064:12345-192.168.204.47@tcp:35:bash.0 00000100:00100000:2.0:1788813449.759070:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874adac050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+17:10404:x1875706562776064:12345-192.168.204.47@tcp:35:bash.0 Request processed in 275us (653us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1788813449.759077:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 15 00000100:00100000:0.0:1788813449.860932:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813449.861081:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562776320 00000100:00100000:2.0:1788813449.861092:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562776320 00000100:00100000:2.0:1788813449.861153:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 60 00000100:00100000:2.0:1788813449.861163:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+17:10414:x1875706562776320:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:2.0:1788813449.861189:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813449.861212:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb1c3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483e6a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813449.861301:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788813449.861438:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb1c3f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e6a expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.861453:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908746516a00) 00010000:00010000:2.0:1788813449.861456:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813449.861461:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb1c3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e6a expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.861477:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369400, rc 0) 00000100:00100000:2.0:1788813449.861557:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+18:10414:x1875706562776320:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 395us (634us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1788813449.861564:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 60 00000100:00100000:1.0:1788813449.865377:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813449.865461:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562776448 00000100:00100000:2.0:1788813449.865471:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562776448 00000100:00100000:2.0:1788813449.865543:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 61 00000100:00100000:2.0:1788813449.865554:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+18:10414:x1875706562776448:12345-192.168.204.47@tcp:34:lfs.0 00010000:00010000:2.0:1788813449.865667:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1c4d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.865702:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1c4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.865717:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1c4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.865733:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1c54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.865739:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1c54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.865747:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1c54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.866044:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1c5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.866053:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.866060:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788813449.866113:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.866125:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1c4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.866132:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1c4d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.866150:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1c4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.866156:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813449.866160:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1c4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.866168:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1c4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.866179:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:2.0:1788813449.866182:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813449.866186:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1c4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.866192:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1c4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.866204:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1c54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.866210:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1c54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.866215:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1c54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.866220:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368c00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813449.866223:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1c54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.866237:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1c54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.866245:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff908743ce0400) 00010000:00010000:2.0:1788813449.866247:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813449.866250:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1c54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.866256:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1c54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.866268:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.866274:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1c5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.866279:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1c5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.866285:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813449.866288:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1c5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.866293:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1c5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.866300:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745acab00) 00010000:00010000:2.0:1788813449.866302:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813449.866304:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1c5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.866334:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1c5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813449.866424:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+18:10414:x1875706562776448:12345-192.168.204.47@tcp:34:lfs.0 Request processed in 869us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813449.866432:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 61 00000100:00100000:0.0:1788813449.870055:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813449.870187:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562776704 00000100:00100000:2.0:1788813449.870198:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562776704 00000100:00100000:2.0:1788813449.870249:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 16 00000100:00100000:2.0:1788813449.870260:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+18:10414:x1875706562776704:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:2.0:1788813449.870797:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+19:10414:x1875706562776704:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 536us (749us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788813449.870805:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 16 00000100:00100000:0.0:1788813449.910199:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813449.910309:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562776960 00000100:00100000:2.0:1788813449.910330:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562776960 00000100:00100000:2.0:1788813449.910395:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 62 00000100:00100000:2.0:1788813449.910405:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+19:10417:x1875706562776960:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:2.0:1788813449.910430:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813449.910449:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1c62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483e71 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.910533:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1c69 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.910548:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1c69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.910576:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1c69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.910630:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1c70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.910637:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1c70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.910644:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1c70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.910972:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb1c77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.910982:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb1c77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.910990:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb1c77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813449.911000:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788813449.911109:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1c69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.911118:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1c69 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.911124:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1c69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.911130:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368c00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813449.911140:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1c69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.911149:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1c69 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.911162:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:2.0:1788813449.911166:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813449.911171:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1c69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.911178:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1c69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.911191:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1c70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.911197:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1c70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.911203:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1c70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.911208:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813449.911211:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1c70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.911217:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1c70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.911225:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff908743ce0400) 00010000:00010000:2.0:1788813449.911227:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813449.911237:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1c70 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.911243:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1c70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.911291:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1c62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e71 expref: 22 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.911306:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb1c77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e71 expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.911314:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745acab00) 00010000:00010000:2.0:1788813449.911317:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813449.911332:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369400, rc 0) 00000100:00100000:2.0:1788813449.911391:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+21:10417:x1875706562776960:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 986us (1202us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788813449.911399:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 62 00000100:00100000:0.0:1788813449.916557:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813449.916640:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813449.916738:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562777216 00000100:00100000:2.0:1788813449.916749:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562777216 00000100:00100000:2.0:1788813449.916806:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 63 00000100:00100000:2.0:1788813449.916829:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+21:10417:x1875706562777216:12345-192.168.204.47@tcp:54:lfs.0 00010000:00010000:2.0:1788813449.916912:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1c85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.916931:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1c85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.916944:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1c85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.916995:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1c85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.917003:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1c85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.917010:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1c85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.917016:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369600 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813449.917022:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1c85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.917030:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1c85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.917043:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745acab00) 00010000:00010000:2.0:1788813449.917046:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813449.917051:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1c85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813449.917057:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1c85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813449.917127:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+21:10417:x1875706562777216:12345-192.168.204.47@tcp:54:lfs.0 Request processed in 312us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813449.917135:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 63 00010000:00010000:3.0:1788813449.917469:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813449.918148:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562777088 00000100:00100000:1.0:1788813449.918158:0:8477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562777088 00000100:00100000:1.0:1788813449.918213:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 4 00000100:00100000:1.0:1788813449.918223:0:8477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+21:2361:x1875706562777088:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813449.918236:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813449.918255:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb1c77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e71 expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813449.918269:0:8477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745acab00) 00010000:00010000:1.0:1788813449.918274:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813449.918310:0:8477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+20:2361:x1875706562777088:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 89us (1764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813449.918317:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 4 00000100:00100000:0.0:1788813449.920637:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813449.920936:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562777472 00000100:00100000:2.0:1788813449.920947:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562777472 00000100:00100000:2.0:1788813449.920999:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 17 00000100:00100000:2.0:1788813449.921022:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+20:10417:x1875706562777472:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:2.0:1788813449.921255:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+21:10417:x1875706562777472:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 234us (628us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788813449.921263:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 17 00000100:00100000:0.0:1788813450.123145:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813450.123189:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813450.123228:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813450.123379:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562777728 00000100:00100000:1.0:1788813450.123390:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562777728 00000100:00100000:1.0:1788813450.123467:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 75 00000100:00100000:1.0:1788813450.123479:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+5:2360:x1875706562777728:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813450.123551:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+5:2360:x1875706562777728:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 75us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813450.123574:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 75 00000100:00100000:3.0:1788813450.123654:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562777600 00000100:00100000:3.0:1788813450.123659:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562777600 00000100:00080000:0.0:1788813450.123677:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813450.123696:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 285 00000100:00100000:3.0:1788813450.123702:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2360:x1875706562777600:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:3.0:1788813450.123737:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2360:x1875706562777600:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 35us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813450.123743:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 285 00000100:00100000:2.0:1788813450.124230:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562777856 00000100:00100000:2.0:1788813450.124235:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562777856 00000100:00100000:2.0:1788813450.124340:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 136 00000100:00100000:2.0:1788813450.124348:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa21be5-2246-40d3-8e20-d34501daf545+5:2360:x1875706562777856:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813450.124354:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813450.124387:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1aa21be5-2246-40d3-8e20-d34501daf545+5:2360:x1875706562777856:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 39us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813450.124394:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 136 00000100:00100000:2.0:1788813450.124405:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562778112 00000100:00100000:2.0:1788813450.124408:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562778112 00000100:00100000:2.0:1788813450.124431:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 64 00000100:00100000:2.0:1788813450.124437:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+21:10435:x1875706562778112:12345-192.168.204.47@tcp:101:cat.0 00010000:00010000:2.0:1788813450.124452:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813450.124475:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1c8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483e78 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813450.124571:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1c93 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813450.124614:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1c93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813450.124626:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1c93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813450.124653:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788813450.124785:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1c8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e78 expref: 24 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813450.124805:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1c93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e78 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813450.124813:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745acab00) 00010000:00010000:2.0:1788813450.124816:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788813450.124820:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368000, rc 0) 00000100:00100000:2.0:1788813450.124850:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+23:10435:x1875706562778112:12345-192.168.204.47@tcp:101:cat.0 Request processed in 412us (495us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788813450.124856:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 64 00000100:00080000:0.0:1788813450.131625:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813450.160419:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813450.160513:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562778240 00000100:00100000:3.0:1788813450.160524:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562778240 00000100:00100000:3.0:1788813450.160664:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 65 00000100:00100000:3.0:1788813450.160676:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+23:10436:x1875706562778240:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:3.0:1788813450.160699:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813450.160721:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1ca1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483e7f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.160818:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1ca8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.160833:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.160851:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813450.160886:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788813450.160890:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813450.160919:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.160947:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1ca1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e7f expref: 25 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.160967:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e7f expref: 24 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.160988:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:3.0:1788813450.160991:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788813450.160995:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad1000, rc 0) 00000100:00100000:3.0:1788813450.161065:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+24:10436:x1875706562778240:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 391us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813450.161072:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 65 00000100:00100000:1.0:1788813450.173969:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813450.180432:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562778624 00000100:00100000:2.0:1788813450.180449:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562778624 00000100:00100000:2.0:1788813450.180615:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 18 00000100:00100000:2.0:1788813450.180627:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+24:10436:x1875706562778624:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:2.0:1788813450.181032:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+25:10436:x1875706562778624:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 406us (7297us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788813450.181040:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 18 00000100:00100000:0.0:1788813450.187394:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813450.187565:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562778752 00000100:00100000:3.0:1788813450.187621:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562778752 00000100:00100000:3.0:1788813450.187696:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 5 00000100:00100000:3.0:1788813450.187707:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+25:10436:x1875706562778752:12345-192.168.204.47@tcp:103:lfs.0 00010000:00010000:3.0:1788813450.187724:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788813450.187761:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb1c38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e63 expref: 25 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.187783:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1c93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e78 expref: 24 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.187795:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1b3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e24 expref: 23 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.187806:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745acab00) 00010000:00010000:3.0:1788813450.187829:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813450.187898:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+22:10436:x1875706562778752:12345-192.168.204.47@tcp:103:lfs.0 Request processed in 192us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813450.187906:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 5 00000100:00100000:1.0:1788813450.191925:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813450.192160:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562778880 00000100:00100000:3.0:1788813450.192172:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562778880 00000100:00100000:3.0:1788813450.192305:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 66 00000100:00100000:3.0:1788813450.192327:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+22:10436:x1875706562778880:12345-192.168.204.47@tcp:58:lfs.0 00010000:00010000:3.0:1788813450.192469:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1caf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.192489:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1caf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.192501:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1caf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788813450.193217:0:5849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788813450.193404:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788813450.193464:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788813450.193610:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+22:10436:x1875706562778880:12345-192.168.204.47@tcp:58:lfs.0 Request processed in 1264us (1665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813450.193619:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 66 00000100:00100000:1.0:1788813450.228695:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813450.228792:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562779008 00000100:00100000:3.0:1788813450.228802:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562779008 00000100:00100000:3.0:1788813450.228870:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 67 00000100:00100000:3.0:1788813450.228881:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+22:10438:x1875706562779008:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:3.0:1788813450.228907:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813450.228931:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1cb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483e86 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.228998:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1cbd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.229031:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1cbd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.229043:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1cbd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.229059:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1cc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.229065:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.229071:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.229313:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1ccb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.229333:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1ccb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.229340:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1ccb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813450.229376:0:8269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788813450.229380:0:8269:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813450.229400:0:8269:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1ccb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.229412:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1ccb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.229431:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1cbd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.229437:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1cbd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.229443:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1cbd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.229449:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813450.229453:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1cbd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.229460:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1cbd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.229472:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:3.0:1788813450.229475:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813450.229480:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1cbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.229485:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1cbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.229499:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.229505:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1cc4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.229510:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1cc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.229521:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1c00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813450.229524:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1cc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.229530:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1cc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.229538:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff908745acab00) 00010000:00010000:3.0:1788813450.229541:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813450.229543:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1cc4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.229549:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1cc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.229640:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1cb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e86 expref: 24 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.229656:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1ccb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e86 expref: 23 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.229663:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745aca700) 00010000:00010000:3.0:1788813450.229665:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788813450.229668:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad0000, rc 0) 00000100:00100000:3.0:1788813450.229736:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+23:10438:x1875706562779008:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 856us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813450.229743:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 67 00000100:00100000:3.0:1788813450.428802:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583777792:0@lo:400:kworker.0 00000100:00100000:3.0:1788813450.429107:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813450.429156:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908761eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583778304:0@lo:400:kworker.0 00000100:00100000:3.0:1788813450.429183:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813450.429216:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813450.429222:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583777920:0@lo:400:kworker.0 00000100:00100000:3.0:1788813450.429245:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813450.429288:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583777792 00000100:00100000:3.0:1788813450.429295:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583777792 00000100:00100000:3.0:1788813450.429345:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583777920 00000100:00100000:3.0:1788813450.429348:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583777920 00000100:00100000:3.0:1788813450.429380:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788813450.429388:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583777792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813450.429441:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583777792:12345-0@lo:400:kworker.0 Request processed in 55us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813450.429448:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788813450.429466:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788813450.429473:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583777920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813450.429502:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583777920:12345-0@lo:400:kworker.0 Request processed in 30us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813450.429508:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1788813450.429529:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813450.429560:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583777920:0@lo:400:kworker.0 00000100:00100000:3.0:1788813450.429571:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583777792:0@lo:400:kworker.0 00000100:00100000:3.0:1788813450.429629:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583778304 00000100:00100000:3.0:1788813450.429634:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583778304 00000100:00100000:3.0:1788813450.429667:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788813450.429681:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583778304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813450.429718:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583778304:12345-0@lo:400:kworker.0 Request processed in 40us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813450.429862:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583778048:0@lo:400:kworker.0 00000100:00100000:1.0:1788813450.429896:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813450.429929:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788813450.429936:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583777664:0@lo:400:kworker.0 00000100:00100000:1.0:1788813450.429961:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813450.429982:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875706583778176:0@lo:400:kworker.0 00000100:00100000:1.0:1788813450.430003:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813450.430029:0:11247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583777664 00000100:00100000:1.0:1788813450.430033:0:11247:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583777664 00000100:00100000:1.0:1788813450.430063:0:11247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788813450.430070:0:11247:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3318:x1875706583777664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813450.430105:0:11247:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3318:x1875706583777664:12345-0@lo:400:kworker.0 Request processed in 34us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813450.430110:0:11247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788813450.430146:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583777664:0@lo:400:kworker.0 00000100:00100000:1.0:1788813450.430163:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583778176 00000100:00100000:1.0:1788813450.430166:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583778176 00000100:00100000:1.0:1788813450.430193:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788813450.430200:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875706583778176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813450.430243:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875706583778176:12345-0@lo:400:kworker.0 Request processed in 44us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813450.430250:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788813450.430275:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875706583778176:0@lo:400:kworker.0 00000100:00100000:1.0:1788813450.430292:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583778048 00000100:00100000:1.0:1788813450.430295:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583778048 00000100:00100000:1.0:1788813450.430335:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788813450.430343:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3318:x1875706583778048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813450.430380:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3318:x1875706583778048:12345-0@lo:400:kworker.0 Request processed in 38us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813450.430386:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788813450.430414:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583778048:0@lo:400:kworker.0 00000100:00080000:1.0:1788813450.430457:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788813450.430460:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788813450.430462:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788813450.430478:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908761eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583778304:0@lo:400:kworker.0 00000100:00100000:3.0:1788813450.433401:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000040:00080000:0.0:1788813450.621729:0:11711:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788813450.621739:0:11711:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788813450.621799:0:11711:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788813450.621813:0:11711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788813450.621968:0:11711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877405ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11711:1875706583778432:192.168.204.47@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788813450.622096:0:11711:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c1f9780 going to sleep for 11 seconds 00000100:00100000:0.0:1788813450.627106:0:11711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877405ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11711:1875706583778432:192.168.204.47@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788813450.628893:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813450.628978:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562779136 00000100:00100000:1.0:1788813450.628988:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562779136 00000100:00100000:1.0:1788813450.629044:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 1 00000100:00100000:1.0:1788813450.629053:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877405ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e90f6370-8c16-4659-9369-1cd146993b4c+23:10449:x1875706562779136:12345-192.168.204.47@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788813450.629135:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877405ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e90f6370-8c16-4659-9369-1cd146993b4c+23:10449:x1875706562779136:12345-192.168.204.47@tcp:900:lhsmtool_posix.0 Request processed in 82us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813450.629142:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 1 00000100:00100000:3.0:1788813450.635357:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813450.635561:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562779264 00000100:00100000:0.0:1788813450.635573:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562779264 00000100:00100000:0.0:1788813450.635672:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 68 00000100:00100000:0.0:1788813450.635684:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+23:10449:x1875706562779264:12345-192.168.204.47@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788813450.635717:0:5849:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788813450.635846:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+23:10449:x1875706562779264:12345-192.168.204.47@tcp:53:lhsmtool_posix.0 Request processed in 164us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813450.635853:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 68 00000100:00100000:1.0:1788813450.642976:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813450.643381:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562779392 00000100:00100000:2.0:1788813450.643391:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562779392 00000100:00100000:1.0:1788813450.643858:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 69 00000100:00100000:1.0:1788813450.643885:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+23:10449:x1875706562779392:12345-192.168.204.47@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788813450.643964:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1cd2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.643983:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1cd2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.643996:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1cd2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.644045:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb1cd9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.644054:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb1cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.644061:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb1cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.644093:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb1ce0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.644101:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb1ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.644107:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb1ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813450.644146:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788813450.644151:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813450.644163:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb1ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.646019:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1cd2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.646035:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1cd2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.646043:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1cd2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.646049:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73200 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813450.646054:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1cd2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.646061:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1cd2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.646077:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff908743ce0800) 00010000:00010000:1.0:1788813450.646080:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813450.646085:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1cd2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.646092:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1cd2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.646109:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb1cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.646116:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb1cd9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.646121:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb1cd9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.646137:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73e00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813450.646140:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb1cd9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.646146:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb1cd9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.646154:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff908746516200) 00010000:00010000:1.0:1788813450.646156:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813450.646159:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb1cd9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.646165:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb1cd9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.647126:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb1ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.647140:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb1ce0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.647146:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb1ce0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.647151:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d72200 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813450.647154:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb1ce0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.647161:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb1ce0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.647707:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745aca700) 00010000:00010000:1.0:1788813450.647712:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813450.647717:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb1ce0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.647725:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb1ce0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813450.657668:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+23:10449:x1875706562779392:12345-192.168.204.47@tcp:34:lhsmtool_posix.0 Request processed in 13775us (14689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813450.657683:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 69 00000100:00100000:2.0:1788813450.665791:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813450.666286:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562779648 00000100:00100000:3.0:1788813450.666297:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562779648 00000100:00100000:3.0:1788813450.666507:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 70 00000100:00100000:3.0:1788813450.666521:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c0cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+23:10449:x1875706562779648:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813450.666543:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813450.666564:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1ce7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483e8d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.666696:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1cee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.666713:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1cee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.666726:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1cee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813450.666737:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788813450.666835:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1cee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.666844:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1cee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.666851:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1cee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.666870:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1c00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813450.666876:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1cee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.666883:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1cee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.666896:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745aca700) 00010000:00010000:3.0:1788813450.666899:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788813450.666904:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1cee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.666910:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1cee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.666956:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1ce7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e8d expref: 25 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.666966:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff908743ce0800) 00010000:00010000:3.0:1788813450.666968:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788813450.666971:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1ce7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e8d expref: 25 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.666980:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad1800, rc 0) 00000100:00100000:3.0:1788813450.667043:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c0cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+24:10449:x1875706562779648:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 526us (1262us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1788813450.667050:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 70 00000100:00100000:0.0:1788813450.705401:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813450.705491:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562779776 00000100:00100000:1.0:1788813450.705502:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562779776 00000100:00100000:1.0:1788813450.705566:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 71 00000100:00100000:1.0:1788813450.705577:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774058000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+24:10449:x1875706562779776:12345-192.168.204.47@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788813450.705631:0:8269:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788813450.705779:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774058000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+24:10449:x1875706562779776:12345-192.168.204.47@tcp:53:lhsmtool_posix.0 Request processed in 203us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813450.705786:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 71 00000100:00100000:2.0:1788813450.713035:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813450.713283:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562780032 00000100:00100000:0.0:1788813450.713296:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562780032 00000100:00100000:0.0:1788813450.713385:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 72 00000100:00100000:0.0:1788813450.713399:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+24:10449:x1875706562780032:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813450.713428:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813450.713432:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788813450.713464:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1ca8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e7f expref: 24 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813450.713497:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:0.0:1788813450.713503:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813450.713522:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1cfc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483e94 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788813450.714576:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788813450.714941:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1d03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813450.714958:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1d03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813450.714968:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1d03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813450.715032:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1cfc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e94 expref: 26 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813450.715051:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1d03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e94 expref: 25 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813450.715059:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90874a4cb900) 00010000:00010000:0.0:1788813450.715062:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813450.715066:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740030a00, rc 0) 00000100:00100000:0.0:1788813450.715540:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c0c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+25:10449:x1875706562780032:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 2142us (2512us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1788813450.715551:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 72 00000100:00100000:2.0:1788813450.722740:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813450.722814:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562780288 00000100:00100000:1.0:1788813450.722824:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562780288 00000100:00100000:1.0:1788813450.722883:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 73 00000100:00100000:1.0:1788813450.722893:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c0cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+25:10449:x1875706562780288:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788813450.722957:0:8269:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813450.722989:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1d03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e94 expref: 25 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.723008:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90874a4cb900) 00010000:00010000:1.0:1788813450.723020:0:8269:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788813450.723051:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb1d11 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.723067:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb1d11 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.723079:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb1d11 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.723108:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1d18 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x90cf6e5a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.723116:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1d18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x90cf6e5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.723123:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1d18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x90cf6e5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.723546:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb1d11 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.723555:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb1d11 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.723562:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb1d11 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.723568:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73e00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813450.723573:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb1d11 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.723667:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb1d11 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.723689:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:1.0:1788813450.723691:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813450.723696:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb1d11 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.723703:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb1d11 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.723714:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1d18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x90cf6e5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.723721:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1d18 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x90cf6e5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.723727:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1d18 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x90cf6e5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.723732:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73200 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813450.723735:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1d18 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x90cf6e5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.723741:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1d18 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x90cf6e5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.723748:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x90cf6e5a (ffff908746516200) 00010000:00010000:1.0:1788813450.723750:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813450.723753:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1d18 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x90cf6e5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.723759:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1d18 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x90cf6e5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813450.723868:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c0cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+24:10449:x1875706562780288:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 Request processed in 974us (1135us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788813450.723876:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 73 00000100:00100000:1.0:1788813450.733262:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813450.733320:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562780416 00000100:00100000:3.0:1788813450.733341:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562780416 00000100:00100000:3.0:1788813450.733393:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 74 00000100:00100000:3.0:1788813450.733468:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+24:10449:x1875706562780416:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813450.733497:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813450.733658:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483e9b expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.733698:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1d26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.733711:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.733723:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.734004:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e9b expref: 26 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.734022:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1d26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e9b expref: 25 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.734031:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff908745acab00) 00010000:00010000:3.0:1788813450.734034:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788813450.734038:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad1c00, rc 0) 00000100:00100000:3.0:1788813450.734103:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+25:10449:x1875706562780416:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 638us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813450.734111:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 74 00000100:00100000:3.0:1788813450.737215:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813450.737345:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562780672 00000100:00100000:1.0:1788813450.737356:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562780672 00000100:00100000:1.0:1788813450.737417:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 75 00000100:00100000:1.0:1788813450.737429:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+25:10449:x1875706562780672:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788813450.737514:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1d2d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.737532:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1d2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.737543:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1d2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788813450.737931:0:8269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1788813450.737942:0:8269:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 392980361535ns, next at 393980359328ns, rc = 0 00000004:00010000:1.0:1788813450.738031:0:8269:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ffe3b825 reply state 00000000e8eb5f91 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1d2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813450.738041:0:8269:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788813450.738160:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+27:10449:x1875706562780672:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 Request processed in 733us (955us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1788813450.738168:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 75 00010000:00010000:3.0:1788813450.739629:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1d2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.739646:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1d2d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.739655:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1d2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.739661:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73200 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813450.739666:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1d2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.739674:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1d2d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.739691:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff908745acab00) 00010000:00010000:3.0:1788813450.739695:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788813450.739700:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1d2d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.739706:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb1d2d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813450.741504:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813450.743464:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562780800 00000100:00100000:2.0:1788813450.743484:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562780800 00000100:00100000:2.0:1788813450.743549:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 76 00000100:00100000:2.0:1788813450.743558:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+26:10449:x1875706562780800:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813450.743603:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813450.743624:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1d34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483ea2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813450.743682:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1d34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ea2 expref: 27 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813450.743696:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1d34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ea2 expref: 27 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813450.743715:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff908745acab00) 00010000:00010000:2.0:1788813450.743718:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788813450.743722:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369a00, rc 0) 00000100:00100000:2.0:1788813450.743792:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+27:10449:x1875706562780800:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 234us (2295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813450.743798:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 76 00000100:00100000:3.0:1788813450.762255:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813450.763346:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562780928 00000100:00100000:3.0:1788813450.763359:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562780928 00000100:00100000:2.0:1788813450.763635:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 25 00000100:00100000:2.0:1788813450.763645:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1875706562780928:12345-192.168.204.47@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788813450.763680:0:6706:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e90f6370-8c16-4659-9369-1cd146993b4c@192.168.204.47@tcp t0 exp 0000000000000000 cur 393 last 0 00000020:00000080:2.0:1788813450.763717:0:6706:0:(genops.c:1384:class_connect()) connect: client e90f6370-8c16-4659-9369-1cd146993b4c, cookie 0x6d74dbab2ddb1d3b 00002000:00100000:2.0:1788813450.763729:0:6706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e90f6370-8c16-4659-9369-1cd146993b4c/ffff9087602ff000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788813450.763753:0:6706:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788813450.763993:0:6706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788813450.764031:0:6706:0:(import.c:65:import_set_state_nolock()) ffff9087602f9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788813450.765632:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:2358:x1875706562780928:12345-192.168.204.47@tcp:8:lhsmtool_posix.0 Request processed in 1979us (5552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813450.765645:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 25 00000100:00100000:3.0:1788813450.773230:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813450.773268:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562781056 00000100:00100000:3.0:1788813450.773277:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562781056 00000100:00100000:3.0:1788813450.773356:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 26 00000100:00100000:3.0:1788813450.773368:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+6:0:x1875706562781056:12345-192.168.204.47@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788813450.773653:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1788813450.870272:0:7669:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e90f6370-8c16-4659-9369-1cd146993b4c 00000001:00080000:1.0:1788813450.870291:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1788813450.870543:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+5:0:x1875706562781056:12345-192.168.204.47@tcp:2:lhsmtool_posix.0 Request processed in 97168us (97311us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788813450.870555:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 26 00000100:00100000:3.0:1788813450.876669:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813450.876721:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562781312 00000100:00100000:2.0:1788813450.876733:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562781312 00000100:00100000:2.0:1788813450.876801:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 19 00000100:00100000:2.0:1788813450.876813:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+27:10449:x1875706562781312:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788813450.877053:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+28:10449:x1875706562781312:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 Request processed in 241us (399us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1788813450.877061:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 19 00000100:00100000:2.0:1788813450.879705:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813450.879950:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562781568 00000100:00100000:3.0:1788813450.879963:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562781568 00000100:00100000:3.0:1788813450.880027:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 77 00000100:00100000:3.0:1788813450.880038:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+28:10449:x1875706562781568:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788813450.880173:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+28:10449:x1875706562781568:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 Request processed in 137us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813450.880180:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 77 00000100:00100000:2.0:1788813450.884340:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813450.884419:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562781696 00000100:00100000:0.0:1788813450.884429:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562781696 00000100:00100000:0.0:1788813450.884487:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 78 00000100:00100000:0.0:1788813450.884497:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+28:10449:x1875706562781696:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813450.884520:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813450.884543:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1d42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483ea9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813450.884648:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1d49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813450.884664:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1d49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813450.884678:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1d49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813450.884715:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788813450.884734:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1d49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813450.884760:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1d42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ea9 expref: 30 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813450.884776:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1d49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ea9 expref: 29 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813450.884785:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff908745acab00) 00010000:00010000:0.0:1788813450.884788:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788813450.884791:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740031400, rc 0) 00000100:00100000:0.0:1788813450.884867:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+29:10449:x1875706562781696:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 370us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813450.884874:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 78 00000100:00100000:2.0:1788813450.888263:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813450.888357:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562781824 00000100:00100000:3.0:1788813450.888367:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562781824 00000100:00100000:3.0:1788813450.888425:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 27 00000100:00100000:3.0:1788813450.888436:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+5:2362:x1875706562781824:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813450.888455:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813450.888477:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016258b30/0x6d74dbab2ddb1d50 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483eb0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788813450.888507:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f208b, blocks: 0x1 00010000:00010000:3.0:1788813450.888526:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=393s v=(0 0) 00010000:00010000:3.0:1788813450.888531:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813450.888541:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016258b30/0x6d74dbab2ddb1d50 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eb0 expref: 6 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.888570:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000016258b30/0x6d74dbab2ddb1d50 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eb0 expref: 6 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.888608:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad1800, rc 0) 00000100:00100000:3.0:1788813450.888669:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:2362:x1875706562781824:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 235us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813450.888676:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 27 00000100:00100000:2.0:1788813450.892030:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813450.892104:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562782080 00000100:00100000:3.0:1788813450.892115:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562782080 00000100:00100000:3.0:1788813450.892176:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 79 00000100:00100000:3.0:1788813450.892186:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+29:10449:x1875706562782080:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788813450.892292:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+29:10449:x1875706562782080:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 Request processed in 107us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813450.892309:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 79 00000100:00100000:0.0:1788813450.894910:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813450.895723:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562782208 00000100:00100000:3.0:1788813450.895740:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562782208 00000100:00100000:3.0:1788813450.895873:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 28 00000100:00100000:3.0:1788813450.895885:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774059c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+6:10449:x1875706562782208:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813450.895907:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813450.895929:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d741d7a8/0x6d74dbab2ddb1d57 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483eb7 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.895961:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000016258b30/0x6d74dbab2ddb1d50 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eb0 expref: 7 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.895981:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813450.895986:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813450.895992:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d741d7a8/0x6d74dbab2ddb1d57 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eb7 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.896025:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000016258b30/0x6d74dbab2ddb1d50 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eb0 expref: 7 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813450.896040:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000016258b30/0x6d74dbab2ddb1d50 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eb0 expref: 7 pid: 6706 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813450.896053:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877be7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1875706583778560:192.168.204.47@tcp:104: 00000100:00100000:3.0:1788813450.896145:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749cf3300 going to sleep for 11 seconds 00000100:00100000:0.0:1788813450.899468:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813450.899535:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562782336 00000100:00100000:1.0:1788813450.899544:0:8477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562782336 00010000:00010000:1.0:1788813450.899616:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000016258b30/0x6d74dbab2ddb1d50 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eb0 expref: 8 pid: 6706 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813450.899653:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 42 00000100:00100000:1.0:1788813450.899663:0:8477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600e0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+8:2360:x1875706562782336:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813450.899678:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813450.899702:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000016258b30/0x6d74dbab2ddb1d50 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eb0 expref: 8 pid: 6706 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.899716:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000016258b30/0x6d74dbab2ddb1d50 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eb0 expref: 8 pid: 6706 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.899744:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813450.899749:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813450.899759:0:8477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d741d7a8/0x6d74dbab2ddb1d57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eb7 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.899770:0:8477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d741d7a8/0x6d74dbab2ddb1d57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eb7 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.899812:0:8477:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d741d7a8/0x6d74dbab2ddb1d57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eb7 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813450.899828:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876f9aad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8477:1875706583778688:192.168.204.47@tcp:105: 00000100:00100000:1.0:1788813450.899919:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dff0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788813450.899959:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016258b30/0x6d74dbab2ddb1d50 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eb0 expref: 8 pid: 6706 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813450.899976:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877be7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1875706583778560:192.168.204.47@tcp:104: 00010000:00010000:1.0:1788813450.900001:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d741d7a8/0x6d74dbab2ddb1d57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eb7 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813450.900012:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad1a00, rc 0) 00000100:00100000:1.0:1788813450.900048:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774059c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+7:10449:x1875706562782208:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 4166us (5146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813450.900056:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 28 00000100:00100000:1.0:1788813450.903065:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876f9aad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8477:1875706583778688:192.168.204.47@tcp:105: 00010000:00010000:1.0:1788813450.903105:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813450.903204:0:8477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600e0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+6:2360:x1875706562782336:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 3541us (3745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813450.903215:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 42 00000100:00100000:3.0:1788813450.904765:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813450.904947:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562782464 00000100:00100000:0.0:1788813450.904956:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562782464 00002000:00100000:0.0:1788813450.905000:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff90877be7dc00 x1875706562782464/t0(0) o4->e90f6370-8c16-4659-9369-1cd146993b4c@192.168.204.47@tcp:266/0 lens 504/0 e 0 to 0 dl 1788813461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788813450.905010:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90877be7dc00 with x1875706562782464 ext(0->8) 00002000:00010000:0.0:1788813450.905016:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90877be7dc00 00000100:00100000:0.0:1788813450.905080:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 0 00000100:00100000:0.0:1788813450.905089:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:2360:x1875706562782464:12345-192.168.204.47@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788813450.905788:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e90f6370-8c16-4659-9369-1cd146993b4c+8:2360:x1875706562782464:12345-192.168.204.47@tcp:4:lhsmtool_posix.0 Request processed in 697us (1026us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788813450.905807:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 0 00002000:00100000:0.0:1788813450.905816:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff90877be7dc00 x1875706562782464/t4294967302(0) o4->e90f6370-8c16-4659-9369-1cd146993b4c@192.168.204.47@tcp:266/0 lens 504/448 e 0 to 0 dl 1788813461 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788813450.905823:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90877be7dc00 with x1875706562782464 ext(0->8) 00002000:00010000:0.0:1788813450.905835:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90877be7dc00 00000100:00100000:1.0:1788813450.908942:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813450.909055:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562782592 00000100:00100000:3.0:1788813450.909067:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562782592 00000100:00100000:3.0:1788813450.909120:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 80 00000100:00100000:3.0:1788813450.909131:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+29:10449:x1875706562782592:12345-192.168.204.47@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788813450.941408:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788813450.941432:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877405aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583778816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813450.941498:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813450.941545:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583778816 00000100:00100000:0.0:1788813450.941554:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583778816 00000100:00100000:0.0:1788813450.941784:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788813450.941795:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877405b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583778816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788813450.941824:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813450.941884:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877405b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583778816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813450.941891:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788813450.942706:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877405aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583778816:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788813450.946695:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788813450.950534:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:1.0:1788813450.950557:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:1.0:1788813450.950562:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000001:00080000:1.0:1788813450.950618:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:1.0:1788813450.950641:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1788813450.950656:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1788813450.950666:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788813450.950921:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+13:10449:x1875706562782592:12345-192.168.204.47@tcp:44:lhsmtool_posix.0 Request processed in 41785us (41983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813450.950932:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 80 00000100:00100000:3.0:1788813450.951709:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813450.951728:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583778944:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788813450.951785:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813450.951909:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583778944 00000100:00100000:2.0:1788813450.951918:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583778944 00000100:00100000:2.0:1788813450.951962:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788813450.951972:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583778944:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788813450.952133:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788813450.952137:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788813451 00002000:00010000:2.0:1788813450.952139:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788813450.952141:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788813451 -> 1788813451 00002000:00010000:2.0:1788813450.952143:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788813450.952448:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3319:x1875706583778944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 476us (661us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788813450.952465:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:3.0:1788813450.952556:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff908749ac3480/2, rc 0, transno 4294967303 00000100:00100000:3.0:1788813450.952563:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583778944:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788813450.953328:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813450.953406:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562782720 00000100:00100000:1.0:1788813450.953414:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562782720 00000100:00100000:1.0:1788813450.953464:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 30 00000100:00100000:1.0:1788813450.953474:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+8:2359:x1875706562782720:12345-192.168.204.47@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788813451.017408:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:3.0:1788813451.017430:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1788813451.017471:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+6:2359:x1875706562782720:12345-192.168.204.47@tcp:16:lhsmtool_posix.0 Request processed in 63993us (64141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813451.017483:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 30 00000100:00100000:1.0:1788813451.032692:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813451.038067:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562782976 00000100:00100000:3.0:1788813451.038083:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562782976 00000100:00100000:3.0:1788813451.038171:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 81 00000100:00100000:3.0:1788813451.038182:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+13:10449:x1875706562782976:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788813451.038240:0:8269:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813451.038268:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1d49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ea9 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.038286:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff908745acab00) 00010000:00010000:3.0:1788813451.038292:0:8269:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813451.038333:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1d5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.038348:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1d5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.038358:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1d5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813451.038652:0:8269:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005587ff15 reply state 00000000727abf61 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1d5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813451.038662:0:8269:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788813451.038768:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+14:10449:x1875706562782976:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 Request processed in 587us (6083us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788813451.038804:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 81 00000100:00080000:2.0:1788813451.039092:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813451.042000:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00010000:00010000:2.0:1788813451.042038:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1d5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.042050:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1d5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.042056:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1d5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.042062:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad0c00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813451.042067:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1d5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.042074:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1d5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.042089:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff908745acab00) 00010000:00010000:2.0:1788813451.042093:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813451.042098:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1d5e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.042103:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1d5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813451.042135:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562783104 00000100:00100000:2.0:1788813451.042145:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562783104 00000100:00100000:2.0:1788813451.042192:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 31 00000100:00100000:2.0:1788813451.042209:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:2359:x1875706562783104:12345-192.168.204.47@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788813451.042486:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788813451.042490:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788813451 -> 1788813450 00002000:00010000:2.0:1788813451.042493:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788813449 00002000:00010000:2.0:1788813451.042495:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788813451 -> 1788813450 00002000:00010000:2.0:1788813451.042497:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788813451.042563:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+7:2359:x1875706562783104:12345-192.168.204.47@tcp:2:lhsmtool_posix.0 Request processed in 355us (572us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788813451.042571:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 31 00000100:00100000:2.0:1788813451.052096:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813451.052704:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562783360 00000100:00100000:3.0:1788813451.052715:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562783360 00000100:00100000:3.0:1788813451.052773:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 82 00000100:00100000:3.0:1788813451.052783:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+13:10449:x1875706562783360:12345-192.168.204.47@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788813451.052975:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.052993:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1d26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e9b expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.053003:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d65 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.053038:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1d26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e9b expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.053054:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1d26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e9b expref: 13 pid: 5850 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813451.053067:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877be7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875706583779072:192.168.204.47@tcp:104: 00000100:00100000:3.0:1788813451.053149:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff908643a95180 going to sleep for 11 seconds 00000100:00100000:2.0:1788813451.061220:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813451.062151:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877be7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875706583779072:192.168.204.47@tcp:104: 00010000:00010000:3.0:1788813451.062182:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813451.063210:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562783488 00000100:00100000:0.0:1788813451.063223:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562783488 00010000:00010000:0.0:1788813451.063267:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1d26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e9b expref: 14 pid: 5850 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813451.063335:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 43 00000100:00100000:0.0:1788813451.063346:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+14:2360:x1875706562783488:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813451.063362:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813451.063370:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1d26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e9b expref: 14 pid: 5850 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.063383:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1d26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e9b expref: 14 pid: 5850 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.063408:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1d26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e9b expref: 14 pid: 5850 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.063426:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff908745acab00) 00010000:00010000:0.0:1788813451.063432:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.063451:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.063459:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d65 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.063497:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813451.063617:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.063631:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.063659:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.063666:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.063673:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.063679:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813451.063683:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.063691:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d65 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.063700:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff908745acab00) 00010000:00010000:3.0:1788813451.063703:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788813451.063706:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d65 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.063712:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d65 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813451.067444:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+13:2360:x1875706562783488:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 4084us (6219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813451.067461:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 43 00000100:00100000:3.0:1788813451.068092:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+12:10449:x1875706562783360:12345-192.168.204.47@tcp:55:lhsmtool_posix.0 Request processed in 15303us (15998us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788813451.068103:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 82 00000100:00100000:2.0:1788813451.080248:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813451.083014:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562783616 00000100:00100000:1.0:1788813451.083031:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562783616 00000100:00100000:1.0:1788813451.083106:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 32 00000100:00100000:1.0:1788813451.083118:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876fac9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+7:2360:x1875706562783616:12345-192.168.204.47@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788813451.083167:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f7a98abf/0x6d74dbab2ddb1d6c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.083190:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d741d7a8/0x6d74dbab2ddb1d57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eb7 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.083199:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813451.083203:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788813451.083209:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7a98abf/0x6d74dbab2ddb1d6c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.083246:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d741d7a8/0x6d74dbab2ddb1d57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eb7 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.083260:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d741d7a8/0x6d74dbab2ddb1d57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eb7 expref: 7 pid: 6705 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813451.083283:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876f9a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1875706583779200:192.168.204.47@tcp:104: 00000100:00100000:1.0:1788813451.083382:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dffc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813451.089661:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813451.092562:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562783744 00000100:00100000:0.0:1788813451.092609:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562783744 00010000:00010000:0.0:1788813451.092656:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d741d7a8/0x6d74dbab2ddb1d57 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eb7 expref: 8 pid: 6705 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813451.092713:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 44 00000100:00100000:0.0:1788813451.092724:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e90f6370-8c16-4659-9369-1cd146993b4c+8:2359:x1875706562783744:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813451.092743:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813451.092770:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d741d7a8/0x6d74dbab2ddb1d57 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eb7 expref: 8 pid: 6705 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.092784:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d741d7a8/0x6d74dbab2ddb1d57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eb7 expref: 8 pid: 6705 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.093185:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813451.093190:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813451.093197:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7a98abf/0x6d74dbab2ddb1d6c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.093227:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7a98abf/0x6d74dbab2ddb1d6c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.093252:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813451.093373:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e90f6370-8c16-4659-9369-1cd146993b4c+8:2359:x1875706562783744:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 649us (3720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813451.093381:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 44 00010000:00010000:1.0:1788813451.096247:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d741d7a8/0x6d74dbab2ddb1d57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eb7 expref: 7 pid: 6705 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813451.096272:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876f9a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1875706583779200:192.168.204.47@tcp:104: 00010000:00010000:1.0:1788813451.096309:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f7a98abf/0x6d74dbab2ddb1d6c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.096322:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f7a98abf/0x6d74dbab2ddb1d6c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.096330:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7a98abf/0x6d74dbab2ddb1d6c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.096363:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f7a98abf/0x6d74dbab2ddb1d6c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.096372:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7a98abf/0x6d74dbab2ddb1d6c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.096380:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7a98abf/0x6d74dbab2ddb1d6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.096403:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d72400 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813451.096407:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7a98abf/0x6d74dbab2ddb1d6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.096426:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7a98abf/0x6d74dbab2ddb1d6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.096446:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7a98abf/0x6d74dbab2ddb1d6c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.096452:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7a98abf/0x6d74dbab2ddb1d6c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813451.096533:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876fac9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+6:2360:x1875706562783616:12345-192.168.204.47@tcp:1:lhsmtool_posix.0 Request processed in 13416us (16306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813451.096543:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 32 00000100:00100000:2.0:1788813451.101543:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813451.101865:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562784000 00000100:00100000:3.0:1788813451.101875:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562784000 00000100:00100000:3.0:1788813451.101938:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 83 00000100:00100000:3.0:1788813451.101948:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+12:10449:x1875706562784000:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788813451.102039:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d73 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.102059:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.102072:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.102320:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1d7a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.102334:0:8269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1d34 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ea2 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.102342:0:8269:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1d7a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.102376:0:8269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1d34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ea2 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.102391:0:8269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1d34 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ea2 expref: 13 pid: 5849 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813451.102405:0:8269:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877be7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8269:1875706583779328:192.168.204.47@tcp:104: 00000100:00100000:3.0:1788813451.102484:0:8269:0:(client.c:2716:ptlrpc_set_wait()) set ffff908643a95180 going to sleep for 11 seconds 00000100:00100000:1.0:1788813451.110618:0:8269:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877be7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8269:1875706583779328:192.168.204.47@tcp:104: 00010000:00010000:1.0:1788813451.110654:0:8269:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1d7a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813451.121268:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813451.121470:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562784128 00000100:00100000:0.0:1788813451.121481:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562784128 00010000:00010000:0.0:1788813451.121521:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1d34 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ea2 expref: 14 pid: 5849 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813451.121561:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 45 00000100:00100000:0.0:1788813451.121571:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+14:2359:x1875706562784128:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813451.121616:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813451.121624:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1d34 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ea2 expref: 14 pid: 5849 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.121640:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1d34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ea2 expref: 14 pid: 5849 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.121662:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1d34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ea2 expref: 14 pid: 5849 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.121678:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff908745acab00) 00010000:00010000:0.0:1788813451.121696:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1d7a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.121706:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1d7a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.121713:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1d7a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.121743:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813451.121810:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+13:2359:x1875706562784128:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 240us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813451.121819:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 45 00010000:00010000:3.0:1788813451.123238:0:8269:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1d7a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.123255:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1d7a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788813451.123561:0:8269:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1788813451.125405:0:8269:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1788813451.128993:0:8269:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1788813451.129132:0:8269:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877be7d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8269:1875706583779456:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788813451.129200:0:8269:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813451.129562:0:8269:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087601e3000 going to sleep for 11 seconds 00000100:00100000:2.0:1788813451.137049:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583779456 00000100:00100000:2.0:1788813451.137068:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583779456 00000100:00100000:2.0:1788813451.137471:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788813451.137483:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8269:x1875706583779456:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788813451.137766:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8269:x1875706583779456:12345-0@lo:1000:mdt00_003.0 Request processed in 283us (8564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813451.137775:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788813451.137851:0:8269:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1788813451.137859:0:8269:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff908749ac3480, transno 4294967303 00000100:00100000:2.0:1788813451.137873:0:8269:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877be7d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8269:1875706583779456:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788813451.141013:0:8269:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1788813451.141127:0:8269:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fa55880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8269:1875706583779584:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788813451.141196:0:8269:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813451.141238:0:8269:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876ea790c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813451.143713:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583779584 00000100:00100000:0.0:1788813451.143726:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583779584 00000100:00100000:0.0:1788813451.143775:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788813451.143785:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8269:x1875706583779584:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788813451.148165:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8269:x1875706583779584:12345-0@lo:1000:mdt00_003.0 Request processed in 4371us (6958us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788813451.148179:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813451.157678:0:8269:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fa55880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8269:1875706583779584:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788813451.157733:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1d7a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.157745:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1d7a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.157761:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1d7a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.157768:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813451.157772:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1d7a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.157781:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1d7a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.158237:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff908745acab00) 00010000:00010000:1.0:1788813451.158241:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788813451.158248:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1d7a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.158255:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1d7a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.158293:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1caf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.158311:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1caf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.158316:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1caf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.158320:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1200 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813451.158323:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1caf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.158340:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1caf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.158349:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745aca700) 00010000:00010000:1.0:1788813451.158352:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788813451.158355:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1caf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.158362:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1caf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.158409:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72400/0x6d74dbab2ddb1d81 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.158431:0:8269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1ccb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e86 expref: 16 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.158442:0:8269:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72400/0x6d74dbab2ddb1d81 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.158483:0:8269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1ccb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e86 expref: 16 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.158500:0:8269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1ccb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e86 expref: 16 pid: 8269 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813451.158517:0:8269:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876f9a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8269:1875706583779712:192.168.204.47@tcp:104: 00000100:00100000:1.0:1788813451.160029:0:8269:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dffb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788813451.168357:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813451.168396:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562784256 00000100:00100000:2.0:1788813451.168406:0:8477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562784256 00010000:00010000:2.0:1788813451.168451:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1ccb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e86 expref: 17 pid: 8269 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813451.168490:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 46 00000100:00100000:2.0:1788813451.168500:0:8477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+17:2359:x1875706562784256:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813451.168516:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813451.168523:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1ccb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e86 expref: 17 pid: 8269 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.168535:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1ccb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e86 expref: 17 pid: 8269 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.168557:0:8477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745aca700) 00010000:00010000:2.0:1788813451.168562:0:8477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72400/0x6d74dbab2ddb1d81 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.168572:0:8477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72400/0x6d74dbab2ddb1d81 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.168617:0:8477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72400/0x6d74dbab2ddb1d81 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.168636:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813451.168700:0:8477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+17:2359:x1875706562784256:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 201us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813451.168708:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 46 00010000:00010000:3.0:1788813451.169371:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1ccb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483e86 expref: 16 pid: 8269 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813451.169389:0:8269:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876f9a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8269:1875706583779712:192.168.204.47@tcp:104: 00010000:00010000:3.0:1788813451.169411:0:8269:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72400/0x6d74dbab2ddb1d81 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.169420:0:8269:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72400/0x6d74dbab2ddb1d81 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.169426:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72400/0x6d74dbab2ddb1d81 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.169437:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72400/0x6d74dbab2ddb1d81 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.169445:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72400/0x6d74dbab2ddb1d81 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.169452:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72400/0x6d74dbab2ddb1d81 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.169467:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d72400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813451.169472:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72400/0x6d74dbab2ddb1d81 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.169479:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72400/0x6d74dbab2ddb1d81 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.169490:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745aca700) 00010000:00010000:3.0:1788813451.169493:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813451.169497:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72400/0x6d74dbab2ddb1d81 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.169502:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72400/0x6d74dbab2ddb1d81 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.169512:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.169517:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d73 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.169522:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.169526:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813451.169528:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.169533:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d73 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.169550:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908745aca700) 00010000:00010000:3.0:1788813451.169552:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788813451.169555:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d73 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.169560:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d73 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813451.170573:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+15:10449:x1875706562784000:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 Request processed in 68619us (69035us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1788813451.171356:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 83 00000020:00080000:3.0:1788813451.171363:0:8269:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788813451.174126:0:11711:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788813451.174136:0:11711:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788813451.174168:0:11711:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788813451.174175:0:11711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788813451.177067:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813451.177977:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562784512 00000100:00100000:3.0:1788813451.177992:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562784512 00000100:00100000:3.0:1788813451.178072:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 20 00000100:00100000:3.0:1788813451.178084:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+15:10449:x1875706562784512:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788813451.180567:0:5852:0:(mdd_object.c:4181:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788813451.181460:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1788813451.181541:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1d88 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.181559:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1d88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.181571:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1d88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.181623:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1d88 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.181630:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1d88 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.181635:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1d88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.181652:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788813451.181761:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+17:10449:x1875706562784512:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 Request processed in 3674us (4707us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788813451.181772:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 20 00000020:00080000:0.0:1788813451.181778:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788813451.184534:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813451.184550:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1d88 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.184562:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740030000 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:3.0:1788813451.184566:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1d88 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.184576:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1d88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.184621:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff90874a4cb100) 00010000:00010000:3.0:1788813451.184625:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788813451.184639:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1d88 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.184645:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1d88 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.184667:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813451.184669:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813451.184671:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788813451.229267:0:12024:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788813451.229278:0:12024:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788813451.229335:0:12024:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788813451.229341:0:12024:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788813451.399157:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813451.401002:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562784768 00000100:00100000:3.0:1788813451.401019:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562784768 00000100:00100000:3.0:1788813451.401100:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 84 00000100:00100000:3.0:1788813451.401111:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+17:10459:x1875706562784768:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:3.0:1788813451.401137:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813451.401160:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483ebe expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.401254:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1d96 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.401269:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1d96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.401279:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1d96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813451.401301:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788813451.401417:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1d8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ebe expref: 20 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.401433:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1d96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ebe expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.401449:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:3.0:1788813451.401452:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788813451.401456:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad0000, rc 0) 00000100:00100000:3.0:1788813451.401528:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+19:10459:x1875706562784768:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 418us (2377us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1788813451.401535:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 84 00000100:00100000:3.0:1788813451.410439:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813451.413516:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562784896 00000100:00100000:0.0:1788813451.413531:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562784896 00000100:00100000:0.0:1788813451.413621:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 85 00000100:00100000:0.0:1788813451.413633:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+19:10459:x1875706562784896:12345-192.168.204.47@tcp:34:lfs.0 00010000:00010000:0.0:1788813451.413721:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1da4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.413739:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1da4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.413753:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1da4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.413771:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1dab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.413793:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1dab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.413800:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1dab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.414057:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1db2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.414068:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1db2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.414076:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1db2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813451.414117:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1db2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.414131:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1da4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.414137:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1da4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.414144:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1da4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.414150:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813451.414154:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1da4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.414161:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1da4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.414181:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:0.0:1788813451.414185:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813451.414191:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1da4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.414197:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1da4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.414208:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1dab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.414215:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1dab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.414220:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1dab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.414225:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740030000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813451.414228:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1dab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.414235:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1dab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.414244:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90874a4cbb00) 00010000:00010000:0.0:1788813451.414246:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813451.414249:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1dab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.414255:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1dab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.414283:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1db2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.414289:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1db2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.414309:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1db2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.414315:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813451.414318:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1db2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.414324:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1db2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.414332:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90874a4cb800) 00010000:00010000:0.0:1788813451.414334:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813451.414337:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1db2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.414343:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1db2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813451.414449:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+19:10459:x1875706562784896:12345-192.168.204.47@tcp:34:lfs.0 Request processed in 816us (4019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813451.414459:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 85 00000100:00100000:2.0:1788813451.477646:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813451.477679:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562785152 00000100:00100000:2.0:1788813451.477688:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562785152 00000100:00100000:2.0:1788813451.477742:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 86 00000100:00100000:2.0:1788813451.477753:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+19:10462:x1875706562785152:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:2.0:1788813451.477776:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813451.477798:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1db9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483ec5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.477872:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb1dc0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.477889:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb1dc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.477901:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb1dc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.477934:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1dc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.477941:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.477947:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.478240:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1dce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.478250:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.478257:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813451.478266:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788813451.478495:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb1dc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.478504:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb1dc0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.478512:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb1dc0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.478517:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813451.478521:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb1dc0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.478540:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb1dc0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.478551:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:2.0:1788813451.478554:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813451.478559:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb1dc0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.478564:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb1dc0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.478575:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.478607:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1dc7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.478613:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1dc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.478618:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813451.478620:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1dc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.478626:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1dc7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.478633:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff908743ce0500) 00010000:00010000:2.0:1788813451.478635:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813451.478638:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1dc7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.478654:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1dc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.478711:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1db9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ec5 expref: 22 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.478725:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1dce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ec5 expref: 21 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.478732:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908743ce0c00) 00010000:00010000:2.0:1788813451.478735:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813451.478738:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369600, rc 0) 00000100:00100000:2.0:1788813451.478897:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+21:10462:x1875706562785152:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 1144us (1259us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788813451.478905:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 86 00000100:00100000:1.0:1788813451.493042:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813451.493122:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562785280 00000100:00100000:3.0:1788813451.493133:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562785280 00000100:00100000:3.0:1788813451.493195:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 87 00000100:00100000:3.0:1788813451.493206:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+21:10462:x1875706562785280:12345-192.168.204.47@tcp:54:lfs.0 00010000:00010000:3.0:1788813451.493283:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1ddc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.493314:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1ddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.493327:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1ddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.493356:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1ddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.493362:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1ddc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.493369:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1ddc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.493387:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813451.493391:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1ddc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.493399:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1ddc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.493413:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908743ce0c00) 00010000:00010000:3.0:1788813451.493416:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788813451.493422:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1ddc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.493428:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1ddc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813451.493551:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+21:10462:x1875706562785280:12345-192.168.204.47@tcp:54:lfs.0 Request processed in 346us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813451.493559:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 87 00000100:00100000:2.0:1788813451.505255:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813451.505463:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562785536 00000100:00100000:3.0:1788813451.505474:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562785536 00000100:00100000:3.0:1788813451.505529:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 21 00000100:00100000:3.0:1788813451.505539:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874adae450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+21:10462:x1875706562785536:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:3.0:1788813451.505943:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874adae450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+22:10462:x1875706562785536:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 404us (697us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788813451.505951:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 21 00000100:00100000:1.0:1788813451.552824:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813451.552929:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562785792 00000100:00100000:2.0:1788813451.552943:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562785792 00000100:00100000:2.0:1788813451.553012:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 88 00000100:00100000:2.0:1788813451.553022:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+22:9991:x1875706562785792:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:2.0:1788813451.553048:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813451.553070:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1de3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483ecc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.553185:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1dea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.553220:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1dce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ec5 expref: 23 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.553228:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1dea lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.553261:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1dce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ec5 expref: 23 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.553276:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1dce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ec5 expref: 23 pid: 5849 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813451.553301:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fa54e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1875706583779840:192.168.204.47@tcp:104: 00000100:00100000:2.0:1788813451.553405:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876ea793c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813451.558213:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fa54e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1875706583779840:192.168.204.47@tcp:104: 00010000:00010000:2.0:1788813451.558244:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1dea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813451.561084:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813451.562426:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562785920 00000100:00100000:0.0:1788813451.562439:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562785920 00010000:00010000:0.0:1788813451.562485:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1dce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ec5 expref: 24 pid: 5849 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813451.562615:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 47 00000100:00100000:0.0:1788813451.562626:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+24:2359:x1875706562785920:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813451.562641:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813451.562648:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1dce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ec5 expref: 24 pid: 5849 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.562663:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1dce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ec5 expref: 24 pid: 5849 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.562686:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1dce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ec5 expref: 24 pid: 5849 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.562704:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908743ce0c00) 00010000:00010000:0.0:1788813451.562710:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1dea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.562719:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1dea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.562727:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1dea lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.562760:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813451.562837:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+23:2359:x1875706562785920:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 212us (1763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813451.562845:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 47 00010000:00010000:2.0:1788813451.562914:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1dea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.562923:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1dea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813451.562944:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788813451.563108:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1de3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ecc expref: 24 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.563137:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1dea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ecc expref: 23 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.563145:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908743ce0c00) 00010000:00010000:2.0:1788813451.563148:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788813451.563150:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368000, rc 0) 00000100:00100000:2.0:1788813451.563177:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+23:9991:x1875706562785792:12345-192.168.204.47@tcp:101:bash.0 Request processed in 10157us (10363us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788813451.563184:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 88 00000100:00100000:1.0:1788813451.569259:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813451.569357:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562786176 00000100:00100000:3.0:1788813451.569367:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562786176 00000100:00100000:3.0:1788813451.569430:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 89 00000100:00100000:3.0:1788813451.569454:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+23:9991:x1875706562786176:12345-192.168.204.47@tcp:36:bash.0 00010000:00010000:3.0:1788813451.570087:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1df8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.570106:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1df8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.570119:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1df8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788813451.570173:0:8269:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1788813451.570201:0:8269:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b2bb3fb6 reply state 00000000207a5d51 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1df8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813451.570211:0:8269:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788813451.570256:0:8269:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1788813451.570387:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+27:9991:x1875706562786176:12345-192.168.204.47@tcp:36:bash.0 Request processed in 931us (1135us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1788813451.570395:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 89 00000020:00080000:3.0:1788813451.570400:0:8269:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788813451.571734:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1df8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.571749:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1df8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.571757:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1df8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.571763:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813451.571768:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1df8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.571791:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1df8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.571805:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908743ce0c00) 00010000:00010000:3.0:1788813451.571808:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813451.571814:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1df8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.571833:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1df8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813451.572964:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813451.573201:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562786304 00000100:00100000:2.0:1788813451.573211:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562786304 00000100:00100000:2.0:1788813451.573265:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 90 00000100:00100000:2.0:1788813451.573275:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+26:9991:x1875706562786304:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:2.0:1788813451.573309:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813451.573328:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1dff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483ed3 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.573385:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1dff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ed3 expref: 27 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.573399:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1dff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ed3 expref: 27 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.573416:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908743ce0c00) 00010000:00010000:2.0:1788813451.573419:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788813451.573434:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369e00, rc 0) 00000100:00100000:2.0:1788813451.573495:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+27:9991:x1875706562786304:12345-192.168.204.47@tcp:101:bash.0 Request processed in 221us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813451.573502:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 90 00000100:00100000:1.0:1788813451.576201:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813451.576319:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562786432 00000100:00100000:2.0:1788813451.576330:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562786432 00000100:00100000:2.0:1788813451.576398:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 33 00000100:00100000:2.0:1788813451.576409:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:9991:x1875706562786432:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:2.0:1788813451.576431:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813451.576461:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb1e06 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483eda expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788813451.576490:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f208a, atime: 0x6a9f2089, ctime: 0x6a9f208a, blocks: 0xb 00010000:00010000:2.0:1788813451.576510:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788813451.576516:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813451.576524:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb1e06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eda expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.576539:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb1e06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eda expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.576550:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369400, rc 0) 00000100:00100000:2.0:1788813451.576833:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+7:9991:x1875706562786432:12345-192.168.204.47@tcp:101:bash.0 Request processed in 425us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813451.576841:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 33 00000100:00100000:1.0:1788813451.579128:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813451.579252:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562786560 00000100:00100000:2.0:1788813451.579262:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562786560 00002000:00010000:2.0:1788813451.579326:0:6710:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1788813451.579332:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90876f9ab800 with x1875706562786560 ext(0->18446744073709551615) 00002000:00010000:2.0:1788813451.579344:0:6710:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90876f9ab800. 00000100:00100000:2.0:1788813451.579413:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 1 00000100:00100000:2.0:1788813451.579424:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e90f6370-8c16-4659-9369-1cd146993b4c+7:2360:x1875706562786560:12345-192.168.204.47@tcp:10:bash.0 00002000:00010000:2.0:1788813451.579829:0:6710:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788813451.579834:0:6710:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788813450 -> 1788813452 00002000:00010000:2.0:1788813451.579837:0:6710:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788813449 -> 1788813449 00002000:00010000:2.0:1788813451.579840:0:6710:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788813450 -> 1788813452 00002000:00010000:2.0:1788813451.579842:0:6710:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788813451.579911:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e90f6370-8c16-4659-9369-1cd146993b4c+8:2360:x1875706562786560:12345-192.168.204.47@tcp:10:bash.0 Request processed in 486us (792us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788813451.579919:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 1 00002000:00010000:2.0:1788813451.579924:0:6710:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1788813451.579927:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90876f9ab800 with x1875706562786560 ext(0->18446744073709551615) 00002000:00010000:2.0:1788813451.579932:0:6710:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90876f9ab800. 00000100:00100000:1.0:1788813451.648057:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813451.648306:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562786688 00000100:00100000:0.0:1788813451.648338:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562786688 00000100:00100000:0.0:1788813451.648405:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 91 00000100:00100000:0.0:1788813451.648418:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+27:10476:x1875706562786688:12345-192.168.204.47@tcp:34:lfs.0 00010000:00010000:0.0:1788813451.648498:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1e0d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.648519:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1e0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.648531:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1e0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.648548:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1e14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.648554:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1e14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.648561:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1e14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.649430:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1e1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.649445:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1e1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.649453:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1e1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813451.649497:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1e1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.649523:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1e0d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.649529:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1e0d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.649536:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1e0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.649542:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740030000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813451.649546:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1e0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.649554:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1e0d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.649565:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:0.0:1788813451.649568:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813451.649574:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1e0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.649606:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1e0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.649620:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1e14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.649627:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1e14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.649633:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1e14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.649642:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813451.649645:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1e14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.649651:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1e14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.649659:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90874a4cb800) 00010000:00010000:0.0:1788813451.649661:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813451.649664:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1e14 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.649669:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1e14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.649683:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1e1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.649688:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1e1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.649693:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1e1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.649698:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740030a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813451.649701:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1e1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.649706:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1e1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.649788:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908743ce0c00) 00010000:00010000:0.0:1788813451.649798:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813451.649802:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1e1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.649808:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1e1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813451.650081:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+27:10476:x1875706562786688:12345-192.168.204.47@tcp:34:lfs.0 Request processed in 1663us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813451.650100:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 91 00000100:00100000:1.0:1788813451.693525:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813451.695071:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562786944 00000100:00100000:2.0:1788813451.695207:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562786944 00000100:00100000:2.0:1788813451.695342:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 92 00000100:00100000:2.0:1788813451.695355:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+27:10479:x1875706562786944:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:2.0:1788813451.695378:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813451.695408:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1e22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483ee1 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.695497:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1e29 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.695533:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1e29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.695546:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1e29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.695562:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1e30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.695568:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.695575:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.696752:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1e37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.696768:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1e37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.696778:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1e37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813451.696791:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788813451.698498:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1e29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.698513:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1e29 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.698520:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1e29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.698534:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813451.698538:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1e29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.698545:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1e29 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.698562:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:2.0:1788813451.698565:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813451.698570:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1e29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.698576:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1e29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.698615:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.698621:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1e30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.698627:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1e30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.698632:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368e00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813451.698635:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1e30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.698642:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1e30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.698661:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff908743ce0e00) 00010000:00010000:2.0:1788813451.698663:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813451.698667:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1e30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.698672:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1e30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.698729:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1e22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ee1 expref: 30 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.698745:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1e37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ee1 expref: 29 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.698751:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908743ce0c00) 00010000:00010000:2.0:1788813451.698754:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788813451.698756:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369600, rc 0) 00000100:00100000:2.0:1788813451.699374:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+29:10479:x1875706562786944:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 4017us (5856us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1788813451.699384:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 92 00000100:00100000:1.0:1788813451.702854:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813451.703312:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562787072 00000100:00100000:3.0:1788813451.703323:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562787072 00000100:00100000:3.0:1788813451.703410:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 93 00000100:00100000:3.0:1788813451.703422:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+29:10479:x1875706562787072:12345-192.168.204.47@tcp:54:lfs.0 00010000:00010000:3.0:1788813451.703491:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1e45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.703510:0:8269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1dea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ecc expref: 29 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.703520:0:8269:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1e45 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.703555:0:8269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1dea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ecc expref: 29 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.703570:0:8269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1dea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ecc expref: 29 pid: 5849 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813451.703643:0:8269:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877be7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8269:1875706583779968:192.168.204.47@tcp:104: 00000100:00100000:3.0:1788813451.703754:0:8269:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c234f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788813451.706841:0:8269:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877be7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8269:1875706583779968:192.168.204.47@tcp:104: 00010000:00010000:3.0:1788813451.706882:0:8269:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1e45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813451.708253:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813451.708346:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562787328 00000100:00100000:2.0:1788813451.708356:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562787328 00000100:00100000:2.0:1788813451.708419:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 22 00000100:00100000:2.0:1788813451.708429:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+30:5600:x1875706562787328:12345-192.168.204.47@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788813451.708805:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+31:5600:x1875706562787328:12345-192.168.204.47@tcp:35:ldlm_bl.0 Request processed in 375us (558us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788813451.708814:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 22 00000100:00100000:1.0:1788813451.713983:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813451.714194:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562787456 00000100:00100000:2.0:1788813451.714204:0:8477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562787456 00010000:00010000:2.0:1788813451.714246:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1dea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ecc expref: 31 pid: 5849 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813451.714302:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 48 00000100:00100000:2.0:1788813451.714313:0:8477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+31:2360:x1875706562787456:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813451.714328:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813451.714335:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1dea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ecc expref: 31 pid: 5849 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.714349:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1dea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ecc expref: 31 pid: 5849 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.714370:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1dea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ecc expref: 31 pid: 5849 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.714386:0:8477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908743ce0c00) 00010000:00010000:2.0:1788813451.714391:0:8477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1e45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.714400:0:8477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1e45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.714408:0:8477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1e45 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.714488:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813451.714550:0:8477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+30:2360:x1875706562787456:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 238us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813451.714572:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 48 00010000:00010000:3.0:1788813451.720379:0:8269:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1e45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.720400:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1e45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.721200:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1e45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.721213:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1e45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.721222:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1e45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.721229:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813451.721234:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1e45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.721242:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1e45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.721259:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908743ce0c00) 00010000:00010000:2.0:1788813451.721262:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813451.721268:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1e45 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.721275:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1e45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813451.721458:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+29:10479:x1875706562787072:12345-192.168.204.47@tcp:54:lfs.0 Request processed in 18033us (18609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813451.721468:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 93 00000100:00100000:1.0:1788813451.727993:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813451.731333:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562787712 00000100:00100000:2.0:1788813451.731350:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562787712 00000100:00100000:2.0:1788813451.731496:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 23 00000100:00100000:2.0:1788813451.731509:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+29:10479:x1875706562787712:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:2.0:1788813451.731772:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+30:10479:x1875706562787712:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 265us (3786us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788813451.731790:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 23 00000100:00100000:1.0:1788813451.868499:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813451.868649:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562787968 00000100:00100000:3.0:1788813451.868661:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562787968 00000100:00100000:3.0:1788813451.868723:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 94 00000100:00100000:3.0:1788813451.868733:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+30:10490:x1875706562787968:12345-192.168.204.47@tcp:101:cat.0 00010000:00010000:3.0:1788813451.868759:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813451.868783:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1e4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483ee8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.868870:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1e53 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.868886:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1e53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.868899:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1e53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.868930:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1e5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.868938:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.868944:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.869773:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1e61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.869787:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1e61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.869796:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1e61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813451.869944:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788813451.870265:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1e53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.870273:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1e53 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.870280:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1e53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.870298:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1200 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813451.870301:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1e53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.870324:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1e53 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.870338:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:3.0:1788813451.870341:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813451.870345:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1e53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.870352:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1e53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.870366:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.870371:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1e5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.870377:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1e5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.870382:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813451.870384:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1e5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.870390:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1e5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.870397:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff908745aca700) 00010000:00010000:3.0:1788813451.870400:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813451.870403:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1e5a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.870419:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1e5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.870472:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1e4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ee8 expref: 33 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.870487:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1e61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ee8 expref: 32 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.870494:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908743ce0c00) 00010000:00010000:3.0:1788813451.870496:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813451.870499:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad1a00, rc 0) 00000100:00100000:3.0:1788813451.873513:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+32:10490:x1875706562787968:12345-192.168.204.47@tcp:101:cat.0 Request processed in 1849us (2091us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788813451.873531:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 94 00000100:00100000:1.0:1788813451.886187:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813451.886398:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562788224 00000100:00100000:3.0:1788813451.886410:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562788224 00000100:00100000:3.0:1788813451.886479:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 24 00000100:00100000:3.0:1788813451.886491:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+32:10490:x1875706562788224:12345-192.168.204.47@tcp:35:cat.0 00000100:00100000:3.0:1788813451.886778:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+33:10490:x1875706562788224:12345-192.168.204.47@tcp:35:cat.0 Request processed in 288us (1716us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788813451.886787:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 24 00000100:00100000:1.0:1788813451.918787:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813451.919133:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562788480 00000100:00100000:0.0:1788813451.919294:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562788480 00000100:00100000:0.0:1788813451.919369:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 95 00000100:00100000:0.0:1788813451.919381:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c230380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+33:10491:x1875706562788480:12345-192.168.204.47@tcp:36:rm.0 00010000:00010000:0.0:1788813451.919443:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788813451.919472:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb1e61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ee8 expref: 33 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.919496:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1e37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ee1 expref: 32 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.919508:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1dff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ed3 expref: 31 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.919518:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff908743ce0c00) 00010000:00010000:0.0:1788813451.919530:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813451.919566:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1e6f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.919712:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1e6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.919726:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1e6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.919743:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1e76 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.919751:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1e76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.919757:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1e76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.920996:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1e7d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.921787:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1e7d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.921800:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1e7d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788813451.924699:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1788813451.924715:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 394167133667ns, next at 395167130185ns, rc = 0 00010000:00010000:0.0:1788813451.924801:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1e84 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.924818:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1e84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.924838:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1e84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.924848:0:5851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1e84 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.924854:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1e84 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.924860:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1e84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.927452:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813451.927499:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1e7d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.927513:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1e7d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.927521:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1e7d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.927527:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740030a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813451.927531:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1e7d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.927539:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1e7d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.927553:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90874a4cbb00) 00010000:00010000:0.0:1788813451.927556:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788813451.927607:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1e7d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.927614:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1e7d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.927640:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1e6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.927646:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1e6f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.927651:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1e6f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.927656:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813451.927658:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1e6f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.927664:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1e6f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.927673:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:0.0:1788813451.927676:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813451.927679:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1e6f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813451.927685:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1e6f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813451.927695:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cbf53aac reply state 00000000f9dff30d transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1e76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813451.927714:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788813451.927818:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c230380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+32:10491:x1875706562788480:12345-192.168.204.47@tcp:36:rm.0 Request processed in 8435us (9038us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788813451.927827:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 95 00010000:00010000:3.0:1788813451.931728:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813451.931743:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1e84 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.931755:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031400 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:3.0:1788813451.931776:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1e84 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.931786:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1e84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.931804:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff90874a4cbb00) 00010000:00010000:3.0:1788813451.931807:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788813451.931813:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1e84 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.931819:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1e84 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.931838:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813451.931840:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813451.931842:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813451.932256:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1e76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.932267:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1e76 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.932273:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1e76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.932279:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740030000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813451.932295:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1e76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.932301:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1e76 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.932312:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff90874a4cb800) 00010000:00010000:2.0:1788813451.932314:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813451.932318:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1e76 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.932323:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1e76 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813451.964907:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813451.984723:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813451.987236:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562788736 00000100:00100000:2.0:1788813451.987267:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562788736 00000100:00100000:2.0:1788813451.987351:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 96 00000100:00100000:2.0:1788813451.987362:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+31:10497:x1875706562788736:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:2.0:1788813451.987389:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813451.987412:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1e8b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483eef expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.987547:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1e92 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.987562:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1e92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.987574:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1e92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.987607:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1e99 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.987615:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1e99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.987621:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1e99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788813451.991177:0:5850:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1788813451.991426:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1ea0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.991445:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.991476:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.991517:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1e92 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.991524:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1e92 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.991531:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1e92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.991537:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368e00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813451.991541:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1e92 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.991549:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1e92 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.991562:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:2.0:1788813451.991565:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813451.991570:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1e92 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.992436:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1e92 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788813451.992460:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000a3f390 reply state 00000000ae611f26 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1e99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813451.992469:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788813451.992524:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1e8b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eef expref: 34 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.992539:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eef expref: 33 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813451.992547:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff908743ce0d00) 00010000:00010000:2.0:1788813451.992549:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813451.992553:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368800, rc 0) 00000100:00100000:2.0:1788813451.994132:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+34:10497:x1875706562788736:12345-192.168.204.47@tcp:101:bash.0 Request processed in 6763us (9410us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788813451.994143:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 96 00010000:00010000:3.0:1788813451.998256:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1e99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.998275:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1e99 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.998295:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1e99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.998301:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813451.998307:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1e99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.998315:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1e99 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.998355:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff908743ce0e00) 00010000:00010000:3.0:1788813451.998358:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813451.998364:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1e99 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813451.998371:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1e99 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813451.998997:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813452.000152:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562788864 00000100:00100000:2.0:1788813452.000166:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562788864 00000100:00100000:2.0:1788813452.000249:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 34 00000100:00100000:2.0:1788813452.000261:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+5:2361:x1875706562788864:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:2.0:1788813452.000291:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813452.000316:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075c556f4/0x6d74dbab2ddb1eae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483ef6 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788813452.000345:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813452.000367:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1788813452.000372:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813452.000383:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075c556f4/0x6d74dbab2ddb1eae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ef6 expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.000401:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000075c556f4/0x6d74dbab2ddb1eae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ef6 expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.000429:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368c00, rc 0) 00000100:00100000:2.0:1788813452.000497:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+6:2361:x1875706562788864:12345-192.168.204.47@tcp:101:bash.0 Request processed in 239us (1506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813452.000504:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 34 00000100:00080000:3.0:1788813452.001303:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813452.006982:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813452.010504:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562788992 00000100:00100000:0.0:1788813452.010522:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562788992 00000100:00100000:0.0:1788813452.010611:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 35 00000100:00100000:0.0:1788813452.010622:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c0c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+6:10497:x1875706562788992:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:0.0:1788813452.010642:0:8270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813452.010666:0:8270:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006db76c5b/0x6d74dbab2ddb1eb5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483efd expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.010701:0:8270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000075c556f4/0x6d74dbab2ddb1eae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ef6 expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.010710:0:8270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813452.010714:0:8270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813452.010720:0:8270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006db76c5b/0x6d74dbab2ddb1eb5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483efd expref: 7 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.010757:0:8270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000075c556f4/0x6d74dbab2ddb1eae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ef6 expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.010772:0:8270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000075c556f4/0x6d74dbab2ddb1eae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ef6 expref: 7 pid: 6704 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813452.010807:0:8270:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877405aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8270:1875706583780096:192.168.204.47@tcp:104: 00000100:00100000:0.0:1788813452.012141:0:8270:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fab1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813452.016497:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813452.017101:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562789120 00000100:00100000:3.0:1788813452.017112:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562789120 00010000:00010000:3.0:1788813452.017152:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000075c556f4/0x6d74dbab2ddb1eae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ef6 expref: 8 pid: 6704 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813452.017206:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 49 00000100:00100000:3.0:1788813452.017215:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600e2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+8:2360:x1875706562789120:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813452.017231:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813452.017254:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000075c556f4/0x6d74dbab2ddb1eae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ef6 expref: 8 pid: 6704 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.017267:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000075c556f4/0x6d74dbab2ddb1eae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ef6 expref: 8 pid: 6704 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.017310:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813452.017315:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813452.017323:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006db76c5b/0x6d74dbab2ddb1eb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483efd expref: 8 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.017348:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006db76c5b/0x6d74dbab2ddb1eb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483efd expref: 8 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.017387:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006db76c5b/0x6d74dbab2ddb1eb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483efd expref: 8 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813452.017401:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877be7c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5835:1875706583780224:192.168.204.47@tcp:105: 00000100:00100000:3.0:1788813452.017486:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c1c7480 going to sleep for 11 seconds 00010000:00010000:2.0:1788813452.019663:0:8270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075c556f4/0x6d74dbab2ddb1eae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ef6 expref: 8 pid: 6704 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813452.019686:0:8270:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877405aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8270:1875706583780096:192.168.204.47@tcp:104: 00010000:00010000:2.0:1788813452.019720:0:8270:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006db76c5b/0x6d74dbab2ddb1eb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483efd expref: 7 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.019735:0:8270:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740030a00, rc 0) 00000100:00100000:1.0:1788813452.020063:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c0c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+7:10497:x1875706562788992:12345-192.168.204.47@tcp:101:bash.0 Request processed in 9441us (13091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813452.020072:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 35 00000100:00100000:3.0:1788813452.021836:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877be7c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5835:1875706583780224:192.168.204.47@tcp:105: 00010000:00010000:3.0:1788813452.021862:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813452.021912:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600e2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+6:2360:x1875706562789120:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 4697us (5424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813452.021922:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 49 00000100:00100000:0.0:1788813452.025547:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813452.027150:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562789376 00000100:00100000:3.0:1788813452.027163:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562789376 00000100:00100000:3.0:1788813452.027231:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 25 00000100:00100000:3.0:1788813452.027242:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774059500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+33:10497:x1875706562789376:12345-192.168.204.47@tcp:35:bash.0 00000100:00100000:3.0:1788813452.027802:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774059500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+34:10497:x1875706562789376:12345-192.168.204.47@tcp:35:bash.0 Request processed in 560us (2263us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788813452.027811:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 25 00000100:00100000:1.0:1788813452.191290:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813452.192572:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562789504 00000100:00100000:2.0:1788813452.192597:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562789504 00000100:00100000:2.0:1788813452.192810:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 97 00000100:00100000:2.0:1788813452.192821:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c0c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+34:10513:x1875706562789504:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:2.0:1788813452.192845:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813452.192870:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1ebc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483f04 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.192949:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1ec3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.192963:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.192990:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813452.193031:0:8269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788813452.193034:0:8269:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788813452.193065:0:8269:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.193101:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1ebc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f04 expref: 36 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.193123:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f04 expref: 35 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.193131:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:2.0:1788813452.193134:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813452.193137:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368e00, rc 0) 00000100:00100000:2.0:1788813452.193266:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c0c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+35:10513:x1875706562789504:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 446us (1998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813452.193273:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 97 00000100:00100000:0.0:1788813452.200393:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813452.200476:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562789760 00000100:00100000:3.0:1788813452.200488:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562789760 00000100:00100000:3.0:1788813452.200553:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 98 00000100:00100000:3.0:1788813452.200563:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774059180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+35:10513:x1875706562789760:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:3.0:1788813452.200634:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813452.200655:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1eca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483f0b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.200761:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1ed1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.200776:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.200788:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1ed1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813452.200799:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788813452.201083:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1eca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f0b expref: 38 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.201104:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1ed1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f0b expref: 37 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.201113:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff908743ce0d00) 00010000:00010000:3.0:1788813452.201116:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813452.201119:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad1000, rc 0) 00000100:00100000:3.0:1788813452.201415:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774059180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+37:10513:x1875706562789760:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 852us (1031us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788813452.201424:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 98 00000100:00100000:0.0:1788813452.210985:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813452.211026:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813452.211148:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562790144 00000100:00100000:1.0:1788813452.211167:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562790144 00000100:00100000:1.0:1788813452.211430:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 99 00000100:00100000:1.0:1788813452.211439:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+37:10513:x1875706562790144:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:1.0:1788813452.211462:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813452.211493:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb1edf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483f12 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813452.211710:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72600/0x6d74dbab2ddb1ee6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813452.211726:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72600/0x6d74dbab2ddb1ee6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813452.211737:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72600/0x6d74dbab2ddb1ee6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813452.211752:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788813452.211991:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb1edf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f12 expref: 40 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813452.212009:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72600/0x6d74dbab2ddb1ee6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f12 expref: 39 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813452.212016:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff908743ce0d00) 00010000:00010000:1.0:1788813452.212019:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788813452.212023:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908749d72600, rc 0) 00000100:00100000:1.0:1788813452.212095:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+39:10513:x1875706562790144:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 655us (1067us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788813452.212102:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 99 00000100:00100000:2.0:1788813452.212188:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562789888 00000100:00100000:2.0:1788813452.212194:0:8477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562789888 00000100:00100000:2.0:1788813452.212234:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 6 00000100:00100000:2.0:1788813452.212241:0:8477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877405b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+39:2360:x1875706562789888:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813452.212251:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813452.212265:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb1ed1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f0b expref: 39 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.212301:0:8477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff908743ce0d00) 00010000:00010000:2.0:1788813452.212304:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813452.212329:0:8477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877405b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+38:2360:x1875706562789888:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 88us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813452.212335:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 6 00000100:00100000:1.0:1788813452.230697:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813452.230944:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562790272 00000100:00100000:2.0:1788813452.230956:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562790272 00000100:00100000:2.0:1788813452.231024:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 36 00000100:00100000:2.0:1788813452.231034:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+6:2362:x1875706562790272:12345-192.168.204.47@tcp:1:lfs.0 00010000:00010000:2.0:1788813452.231095:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075c556f4/0x6d74dbab2ddb1ef4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.231113:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006db76c5b/0x6d74dbab2ddb1eb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483efd expref: 6 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.231122:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813452.231126:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813452.231130:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075c556f4/0x6d74dbab2ddb1ef4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.231175:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006db76c5b/0x6d74dbab2ddb1eb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483efd expref: 6 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.231190:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006db76c5b/0x6d74dbab2ddb1eb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483efd expref: 6 pid: 8270 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813452.231225:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fa54e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1875706583780352:192.168.204.47@tcp:104: 00000100:00100000:2.0:1788813452.231335:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff908643a95180 going to sleep for 11 seconds 00000100:00100000:0.0:1788813452.237725:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813452.238027:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562790400 00000100:00100000:1.0:1788813452.238038:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562790400 00002000:00100000:1.0:1788813452.238090:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff90877405b100 x1875706562790400/t0(0) o4->e90f6370-8c16-4659-9369-1cd146993b4c@192.168.204.47@tcp:268/0 lens 504/0 e 0 to 0 dl 1788813463 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788813452.238117:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90877405b100 with x1875706562790400 ext(0->8) 00010000:00010000:1.0:1788813452.238128:0:6712:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006db76c5b/0x6d74dbab2ddb1eb5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483efd expref: 7 pid: 8270 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813452.238147:0:6712:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006db76c5b/0x6d74dbab2ddb1eb5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483efd expref: 7 pid: 8270 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788813452.238167:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90877405b100 00000100:00100000:1.0:1788813452.238198:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 1 00000100:00100000:1.0:1788813452.238209:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877405b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e90f6370-8c16-4659-9369-1cd146993b4c+7:2359:x1875706562790400:12345-192.168.204.47@tcp:4:lfs.0 00000100:00100000:1.0:1788813452.238739:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877405b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e90f6370-8c16-4659-9369-1cd146993b4c+9:2359:x1875706562790400:12345-192.168.204.47@tcp:4:lfs.0 Request processed in 529us (1020us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788813452.238748:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 1 00002000:00100000:1.0:1788813452.238763:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff90877405b100 x1875706562790400/t4294967302(0) o4->e90f6370-8c16-4659-9369-1cd146993b4c@192.168.204.47@tcp:268/0 lens 504/448 e 0 to 0 dl 1788813463 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788813452.238783:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90877405b100 with x1875706562790400 ext(0->8) 00010000:00010000:1.0:1788813452.238790:0:6712:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006db76c5b/0x6d74dbab2ddb1eb5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483efd expref: 9 pid: 8270 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813452.241387:0:6712:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006db76c5b/0x6d74dbab2ddb1eb5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483efd expref: 9 pid: 8270 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788813452.241406:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90877405b100 00000100:00100000:2.0:1788813452.241570:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fa54e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1875706583780352:192.168.204.47@tcp:104: 00010000:00010000:2.0:1788813452.241629:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000075c556f4/0x6d74dbab2ddb1ef4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813452.242792:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813452.243466:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562790528 00000100:00100000:0.0:1788813452.243477:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562790528 00010000:00010000:0.0:1788813452.243526:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006db76c5b/0x6d74dbab2ddb1eb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483efd expref: 9 pid: 8270 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813452.243691:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 50 00000100:00100000:0.0:1788813452.243701:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+9:2360:x1875706562790528:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813452.243720:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788813452.243741:0:5834:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788813452.243745:0:5834:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788813452 00002000:00010000:0.0:1788813452.243748:0:5834:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788813452 00002000:00010000:0.0:1788813452.243750:0:5834:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788813452 00010000:00010000:0.0:1788813452.243757:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006db76c5b/0x6d74dbab2ddb1eb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483efd expref: 9 pid: 8270 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.243781:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006db76c5b/0x6d74dbab2ddb1eb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483efd expref: 9 pid: 8270 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.243831:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006db76c5b/0x6d74dbab2ddb1eb5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483efd expref: 9 pid: 8270 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.243850:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813452.243854:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813452.243860:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000075c556f4/0x6d74dbab2ddb1ef4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.243869:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075c556f4/0x6d74dbab2ddb1ef4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.243903:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813452.243977:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+8:2360:x1875706562790528:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 278us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813452.243985:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 50 00010000:00010000:2.0:1788813452.244618:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000075c556f4/0x6d74dbab2ddb1ef4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.244633:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075c556f4/0x6d74dbab2ddb1ef4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.244663:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075c556f4/0x6d74dbab2ddb1ef4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.244671:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075c556f4/0x6d74dbab2ddb1ef4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.244680:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075c556f4/0x6d74dbab2ddb1ef4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.244687:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368c00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:2.0:1788813452.244692:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075c556f4/0x6d74dbab2ddb1ef4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.244715:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075c556f4/0x6d74dbab2ddb1ef4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.244731:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075c556f4/0x6d74dbab2ddb1ef4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.244740:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075c556f4/0x6d74dbab2ddb1ef4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813452.244839:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+7:2362:x1875706562790272:12345-192.168.204.47@tcp:1:lfs.0 Request processed in 13804us (14149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813452.244848:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 36 00000100:00100000:2.0:1788813452.251311:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813452.251520:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562790784 00000100:00100000:0.0:1788813452.251531:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562790784 00000100:00100000:1.0:1788813452.252068:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 26 00000100:00100000:1.0:1788813452.252100:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874adae850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+38:10513:x1875706562790784:12345-192.168.204.47@tcp:35:lfs.0 00000004:00010000:1.0:1788813452.252178:0:5852:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72600/0x6d74dbab2ddb1ee6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f12 expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788813452.252471:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1788813452.252516:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1788813452.255345:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1788813452.256057:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1efb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813452.256080:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1ea0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eef expref: 42 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813452.256090:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1efb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813452.256131:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eef expref: 42 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813452.256147:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1ea0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eef expref: 42 pid: 5850 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813452.258392:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3f2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5852:1875706583780480:192.168.204.47@tcp:104: 00000100:00100000:1.0:1788813452.261121:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dff180 going to sleep for 11 seconds 00000100:00100000:2.0:1788813452.266448:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3f2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5852:1875706583780480:192.168.204.47@tcp:104: 00010000:00010000:2.0:1788813452.266481:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1efb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813452.268655:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813452.268892:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562790912 00000100:00100000:3.0:1788813452.268903:0:8477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562790912 00010000:00010000:3.0:1788813452.268981:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1ea0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eef expref: 43 pid: 5850 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813452.269027:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 51 00000100:00100000:3.0:1788813452.269038:0:8477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+43:2359:x1875706562790912:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813452.269054:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813452.269061:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1ea0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eef expref: 43 pid: 5850 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.269083:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eef expref: 43 pid: 5850 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.269105:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1ea0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eef expref: 43 pid: 5850 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.269121:0:8477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff908743ce0d00) 00010000:00010000:3.0:1788813452.269127:0:8477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1efb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.269136:0:8477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1efb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.269143:0:8477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1efb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.269189:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813452.269249:0:8477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+42:2359:x1875706562790912:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 213us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813452.269257:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 51 00010000:00010000:2.0:1788813452.269564:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1efb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.269573:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1efb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788813452.269721:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788813452.269904:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1788813452.270038:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fa56d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1875706583780608:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788813452.270090:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813452.270119:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff908643a95300 going to sleep for 11 seconds 00000100:00100000:3.0:1788813452.270734:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583780608 00000100:00100000:3.0:1788813452.270741:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583780608 00000100:00080000:2.0:1788813452.270863:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813452.270903:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788813452.270913:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5852:x1875706583780608:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788813452.271005:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5852:x1875706583780608:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 94us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813452.271012:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788813452.271088:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fa56d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1875706583780608:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788813452.271563:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1788813452.271656:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fa56d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1875706583780736:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788813452.271695:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813452.274118:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff908643a95180 going to sleep for 11 seconds 00000100:00100000:1.0:1788813452.274293:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583780736 00000100:00100000:1.0:1788813452.274303:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583780736 00000100:00100000:1.0:1788813452.274362:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813452.274372:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5852:x1875706583780736:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788813452.274661:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5852:x1875706583780736:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 290us (2964us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788813452.274669:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788813452.275090:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fa56d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1875706583780736:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788813452.275170:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1788813452.275219:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1efb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.275230:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1efb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.275238:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1efb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.275244:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d72800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813452.275249:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1efb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.275257:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1efb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.275281:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff908743ce0d00) 00010000:00010000:2.0:1788813452.275284:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788813452.275297:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1efb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.275304:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb1efb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788813452.275491:0:5852:0:(mdd_object.c:4181:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788813452.275850:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1788813452.275862:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 394518281471ns, next at 395518279293ns, rc = 0 00000001:00080000:2.0:1788813452.275869:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788813452.275903:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff908743ce0d00) 00010000:00010000:2.0:1788813452.275907:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788813452.275915:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72600/0x6d74dbab2ddb1ee6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f12 expref: 46 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813452.276235:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874adae850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+45:10513:x1875706562790784:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 24139us (24931us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1788813452.276244:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 26 00000020:00080000:2.0:1788813452.276249:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788813452.280465:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813452.280551:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562791040 00000100:00100000:0.0:1788813452.280560:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562791040 00000100:00100000:0.0:1788813452.280892:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 100 00000100:00100000:0.0:1788813452.280902:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+45:10513:x1875706562791040:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:0.0:1788813452.280935:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813452.280957:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1f02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483f19 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.281025:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1f02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f19 expref: 46 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.281055:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1f02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f19 expref: 46 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.281559:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:0.0:1788813452.281563:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788813452.281568:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740030a00, rc 0) 00000100:00100000:0.0:1788813452.281719:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+46:10513:x1875706562791040:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 817us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813452.281727:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 100 00000100:00100000:1.0:1788813452.286446:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813452.286601:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562791296 00000100:00100000:3.0:1788813452.286611:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562791296 00000100:00100000:3.0:1788813452.286659:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 27 00000100:00100000:3.0:1788813452.286668:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+46:10513:x1875706562791296:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:3.0:1788813452.287410:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+47:10513:x1875706562791296:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 739us (968us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1788813452.287419:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 27 00000100:00100000:1.0:1788813452.409392:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813452.409475:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562791424 00000100:00100000:3.0:1788813452.409485:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562791424 00000100:00100000:3.0:1788813452.409538:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 101 00000100:00100000:3.0:1788813452.409548:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+47:10523:x1875706562791424:12345-192.168.204.47@tcp:34:lfs.0 00010000:00010000:3.0:1788813452.409665:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f09 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.409682:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.409694:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.409709:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.409729:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.409736:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.409827:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1f17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.409835:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.409842:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813452.409879:0:8269:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.409890:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.409897:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f09 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.409903:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.409910:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813452.409925:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.409933:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f09 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.409950:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:3.0:1788813452.409953:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813452.409958:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.409964:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.409977:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.409983:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.409989:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.409994:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1200 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813452.409996:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.410001:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.410007:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff908745aca700) 00010000:00010000:3.0:1788813452.410009:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813452.410011:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.410016:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.410038:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.410043:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1f17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.410049:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1f17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.410054:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1c00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813452.410056:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1f17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.410062:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1f17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.410068:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:3.0:1788813452.410070:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813452.410073:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1f17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.410079:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1f17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813452.411020:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+47:10523:x1875706562791424:12345-192.168.204.47@tcp:34:lfs.0 Request processed in 1465us (1627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813452.411031:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 101 00000100:00100000:2.0:1788813452.458396:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813452.458489:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562791680 00000100:00100000:3.0:1788813452.458499:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562791680 00000100:00100000:3.0:1788813452.458560:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 102 00000100:00100000:3.0:1788813452.458629:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+47:10526:x1875706562791680:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:3.0:1788813452.458649:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813452.458669:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1f1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483f20 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.458740:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f25 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.458754:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.458765:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.458780:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.458787:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.458794:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.458916:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1f33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.458925:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1f33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.458932:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1f33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813452.458954:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788813452.459054:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.459062:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f25 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.459069:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.459075:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1200 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813452.459079:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.459087:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f25 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.459099:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:3.0:1788813452.459102:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813452.459107:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.459113:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.459126:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.459132:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.459333:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.459341:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813452.459345:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.459351:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.459358:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff908745aca700) 00010000:00010000:3.0:1788813452.459361:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813452.459364:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f2c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.459369:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.459413:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1f1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f20 expref: 50 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.459427:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1f33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f20 expref: 49 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.459433:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:3.0:1788813452.459435:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813452.459437:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad0c00, rc 0) 00000100:00100000:3.0:1788813452.459497:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+49:10526:x1875706562791680:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 869us (1111us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1788813452.459513:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 102 00000100:00100000:0.0:1788813452.467815:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813452.467926:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562791808 00000100:00100000:1.0:1788813452.467937:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562791808 00000100:00100000:1.0:1788813452.467996:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 103 00000100:00100000:1.0:1788813452.468005:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877405a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+49:10526:x1875706562791808:12345-192.168.204.47@tcp:54:lfs.0 00010000:00010000:1.0:1788813452.468071:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb1f41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813452.468086:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb1f41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813452.468107:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb1f41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813452.468133:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb1f41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813452.468140:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb1f41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813452.468146:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb1f41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813452.468481:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813452.468486:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb1f41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813452.468513:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb1f41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813452.468525:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:1.0:1788813452.468528:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788813452.468533:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb1f41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813452.468539:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb1f41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813452.468727:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877405a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+49:10526:x1875706562791808:12345-192.168.204.47@tcp:54:lfs.0 Request processed in 720us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813452.468735:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 103 00000100:00100000:3.0:1788813452.474407:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813452.474491:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562792064 00000100:00100000:2.0:1788813452.474503:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562792064 00000100:00100000:2.0:1788813452.474599:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 28 00000100:00100000:2.0:1788813452.474611:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+49:10526:x1875706562792064:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:2.0:1788813452.475394:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+50:10526:x1875706562792064:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 781us (993us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788813452.475405:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 28 00000100:00100000:3.0:1788813452.577049:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813452.577982:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562792320 00000100:00100000:2.0:1788813452.578010:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562792320 00000100:00100000:2.0:1788813452.578290:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 104 00000100:00100000:2.0:1788813452.578303:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+50:10536:x1875706562792320:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:2.0:1788813452.578330:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813452.578333:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788813452.578364:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1ec3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f04 expref: 50 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.578384:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:2.0:1788813452.578389:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813452.578404:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1f48 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483f27 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.578509:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1f4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.578523:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1f4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.578533:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1f4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813452.578543:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788813452.578729:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1f48 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f27 expref: 52 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.578744:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1f4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f27 expref: 51 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.578751:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:2.0:1788813452.578761:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813452.578776:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368800, rc 0) 00000100:00100000:2.0:1788813452.578857:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+51:10536:x1875706562792320:12345-192.168.204.47@tcp:101:bash.0 Request processed in 556us (1819us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788813452.578864:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 104 00000100:00100000:1.0:1788813452.583257:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813452.584224:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562792576 00000100:00100000:0.0:1788813452.584236:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562792576 00000100:00100000:0.0:1788813452.584309:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 105 00000100:00100000:0.0:1788813452.584320:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+51:10536:x1875706562792576:12345-192.168.204.47@tcp:36:bash.0 00010000:00010000:0.0:1788813452.584385:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788813452.584412:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb1f4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f27 expref: 51 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.584447:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1f33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f20 expref: 50 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.584459:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:0.0:1788813452.584464:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813452.585455:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1f5d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.585494:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1f5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.585505:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1f5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788813452.585892:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1788813452.586007:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d4bf4a7 reply state 0000000064485193 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1f5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813452.586018:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788813452.586607:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+52:10536:x1875706562792576:12345-192.168.204.47@tcp:36:bash.0 Request processed in 2250us (3322us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788813452.586618:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 105 00000020:00080000:0.0:1788813452.586624:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788813452.594101:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813452.594857:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562792704 00000100:00100000:0.0:1788813452.594872:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562792704 00000100:00100000:0.0:1788813452.595091:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 106 00000100:00100000:0.0:1788813452.595103:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+52:10536:x1875706562792704:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:0.0:1788813452.595128:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813452.595151:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1f64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483f2e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.595263:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1f6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.595288:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1f5d lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.595306:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1f6b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.595323:0:5851:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1f5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.595334:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1f6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.595509:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1f5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.595518:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1f5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.595525:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1f5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.595531:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813452.595534:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1f5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.595542:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1f5d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.595558:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:2.0:1788813452.595561:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813452.595563:0:3304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1f6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.595730:0:3304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1f6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.595738:0:3304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1f6b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.595928:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1f5d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.595936:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1f5d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.596105:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1f6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.596112:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1f6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813452.596147:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788813452.596151:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788813452.596172:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1f6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.596199:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1f64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f2e expref: 53 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.596215:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1f6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f2e expref: 52 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.596222:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:0.0:1788813452.596224:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813452.596227:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740031400, rc 0) 00000100:00100000:0.0:1788813452.596346:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+52:10536:x1875706562792704:12345-192.168.204.47@tcp:101:bash.0 Request processed in 1244us (2264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813452.596362:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 106 00000100:00100000:3.0:1788813452.599649:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813452.599740:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562792960 00000100:00100000:1.0:1788813452.599753:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562792960 00000100:00100000:1.0:1788813452.599822:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 29 00000100:00100000:1.0:1788813452.599832:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+52:10536:x1875706562792960:12345-192.168.204.47@tcp:35:bash.0 00000100:00100000:1.0:1788813452.600515:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+53:10536:x1875706562792960:12345-192.168.204.47@tcp:35:bash.0 Request processed in 680us (871us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1788813452.600525:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 29 00000100:00100000:3.0:1788813452.665101:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813452.665320:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562793088 00000100:00100000:2.0:1788813452.665331:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562793088 00000100:00100000:2.0:1788813452.665397:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 107 00000100:00100000:2.0:1788813452.665410:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+53:10542:x1875706562793088:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:2.0:1788813452.665438:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813452.665461:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1f72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483f35 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.665528:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1f79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.665543:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.665554:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813452.665629:0:8269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788813452.665633:0:8269:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788813452.665653:0:8269:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.665679:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1f72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f35 expref: 55 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.665717:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1f79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f35 expref: 54 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.665725:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:2.0:1788813452.665728:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813452.665731:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369a00, rc 0) 00000100:00100000:2.0:1788813452.665795:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+54:10542:x1875706562793088:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 388us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813452.665802:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 107 00000100:00100000:2.0:1788813452.669347:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813452.669432:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562793216 00000100:00100000:3.0:1788813452.669443:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562793216 00000100:00100000:3.0:1788813452.669504:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 108 00000100:00100000:3.0:1788813452.669514:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+54:10542:x1875706562793216:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:3.0:1788813452.669536:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813452.669554:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1f80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483f3c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.669657:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f87 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.669672:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.669681:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.669694:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.669700:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.669725:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.669830:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1f95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.669839:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.669845:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813452.669881:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788813452.669884:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813452.669901:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.670134:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.670144:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.670151:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f87 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.670158:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.670164:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813452.670168:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.670183:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.670195:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:3.0:1788813452.670198:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813452.670203:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.670210:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb1f87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.670224:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.670229:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.670234:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.670239:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1200 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813452.670242:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.670248:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.670255:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff908745aca700) 00010000:00010000:3.0:1788813452.670258:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813452.670260:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f8e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.670285:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb1f8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.670321:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb1f80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f3c expref: 56 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.670334:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1f95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f3c expref: 55 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.670342:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:3.0:1788813452.670345:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813452.670348:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad0c00, rc 0) 00000100:00100000:3.0:1788813452.670417:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+55:10542:x1875706562793216:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 904us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813452.670424:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 108 00000100:00100000:3.0:1788813452.675738:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813452.675859:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562793472 00000100:00100000:2.0:1788813452.675869:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562793472 00000100:00100000:2.0:1788813452.675941:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 109 00000100:00100000:2.0:1788813452.675952:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+55:10542:x1875706562793472:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:2.0:1788813452.675974:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813452.675998:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1f9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483f43 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.676105:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1fa3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.676120:0:8269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1f6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f2e expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.676128:0:8269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1f95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f3c expref: 56 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.676153:0:8269:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1fa3 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.676186:0:8269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1f95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f3c expref: 56 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.676201:0:8269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1f95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f3c expref: 56 pid: 5849 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813452.676214:0:8269:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fa54700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8269:1875706583780864:192.168.204.47@tcp:104: 00010000:00010000:2.0:1788813452.676332:0:8269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1f6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f2e expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.676341:0:8269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1f6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f2e expref: 56 pid: 5851 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813452.676350:0:8269:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fa57100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8269:1875706583780992:192.168.204.47@tcp:104: 00000100:00100000:2.0:1788813452.676375:0:8269:0:(client.c:2716:ptlrpc_set_wait()) set ffff90874676d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788813452.681362:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813452.681460:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562793600 00000100:00100000:3.0:1788813452.681472:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562793600 00010000:00010000:3.0:1788813452.681517:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1f95 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f3c expref: 57 pid: 5849 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813452.681560:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 52 00000100:00100000:3.0:1788813452.681613:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+57:2360:x1875706562793600:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813452.681630:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813452.681638:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1f95 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f3c expref: 57 pid: 5849 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.681673:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1f95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f3c expref: 57 pid: 5849 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.681697:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:3.0:1788813452.681702:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1fa3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.681712:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1fa3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813452.681718:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813452.682487:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+57:2360:x1875706562793600:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 217us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813452.682497:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 52 00000100:00100000:3.0:1788813452.684079:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813452.684315:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562793728 00000100:00100000:0.0:1788813452.684326:0:8477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562793728 00010000:00010000:0.0:1788813452.684366:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1f6b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f2e expref: 57 pid: 5851 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813452.684409:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 53 00000100:00100000:0.0:1788813452.684419:0:8477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+57:2359:x1875706562793728:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813452.684434:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813452.684441:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1f6b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f2e expref: 57 pid: 5851 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.684455:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1f6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f2e expref: 57 pid: 5851 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.684476:0:8477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:0.0:1788813452.684481:0:8477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1fa3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.684491:0:8477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1fa3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.684499:0:8477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1fa3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.684519:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813452.684576:0:8477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+57:2359:x1875706562793728:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 158us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813452.684635:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 53 00010000:00010000:2.0:1788813452.685493:0:8269:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.47@tcp) returned -22 from blocking AST (req@0000000070d6104e x1875706583780864) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1f95 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f3c expref: 56 pid: 5849 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.685511:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb1f95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f3c expref: 56 pid: 5849 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813452.685540:0:8269:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fa54700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8269:1875706583780864:192.168.204.47@tcp:104: 00010000:00010000:2.0:1788813452.685555:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1f6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f2e expref: 55 pid: 5851 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813452.685577:0:8269:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fa57100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8269:1875706583780992:192.168.204.47@tcp:104: 00010000:00010000:2.0:1788813452.685647:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:2.0:1788813452.685655:0:8269:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1fa3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.685664:0:8269:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1fa3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.685670:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1fa3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813452.685693:0:8269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788813452.686073:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1f9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f43 expref: 56 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.686196:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1fa3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f43 expref: 55 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.686206:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:2.0:1788813452.686209:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788813452.686212:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369e00, rc 0) 00000100:00100000:2.0:1788813452.686281:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+55:10542:x1875706562793472:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 10331us (10553us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788813452.686296:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 109 00000100:00100000:3.0:1788813452.691399:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813452.691515:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562793984 00000100:00100000:1.0:1788813452.691527:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562793984 00000100:00100000:1.0:1788813452.691624:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 7 00000100:00100000:1.0:1788813452.691633:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+55:10542:x1875706562793984:12345-192.168.204.47@tcp:103:lfs.0 00010000:00010000:1.0:1788813452.691650:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813452.691692:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1f02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f19 expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813452.691710:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:1.0:1788813452.691714:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813452.691784:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+54:10542:x1875706562793984:12345-192.168.204.47@tcp:103:lfs.0 Request processed in 151us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813452.691800:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 7 00000100:00100000:3.0:1788813452.693939:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813452.694006:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562794112 00000100:00100000:2.0:1788813452.694017:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562794112 00000100:00100000:2.0:1788813452.694083:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 110 00000100:00100000:2.0:1788813452.694214:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+54:10542:x1875706562794112:12345-192.168.204.47@tcp:58:lfs.0 00010000:00010000:2.0:1788813452.694353:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1fb1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.694370:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1fb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813452.694382:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1fb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788813452.694680:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788813452.694772:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+54:10542:x1875706562794112:12345-192.168.204.47@tcp:58:lfs.0 Request processed in 679us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813452.694780:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 110 00000100:00100000:3.0:1788813452.697106:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813452.697311:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562794240 00000100:00100000:0.0:1788813452.697321:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562794240 00000100:00100000:0.0:1788813452.697383:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 111 00000100:00100000:0.0:1788813452.697394:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+54:10542:x1875706562794240:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:0.0:1788813452.697415:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813452.697436:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1fb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483f4a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.697499:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1fb1 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.697511:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1fb8 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f4a expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.697531:0:5850:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1fb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.697544:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1fb8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f4a expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.697560:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:0.0:1788813452.697563:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788813452.697567:0:5850:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1fb8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f4a expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813452.697798:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740030000, rc 0) 00000100:00100000:0.0:1788813452.697879:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+55:10542:x1875706562794240:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 486us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813452.697886:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 111 00010000:00010000:3.0:1788813452.988814:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788813453.244859:0:11711:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788813453.244869:0:11711:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788813453.244942:0:11711:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788813453.244949:0:11711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788813453.245073:0:11711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fa57100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11711:1875706583781120:192.168.204.47@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788813453.245198:0:11711:0:(client.c:2716:ptlrpc_set_wait()) set ffff908744e41780 going to sleep for 11 seconds 00000100:00100000:2.0:1788813453.248145:0:11711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fa57100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11711:1875706583781120:192.168.204.47@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788813453.249677:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813453.249792:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562794368 00000100:00100000:0.0:1788813453.249803:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562794368 00000100:00100000:0.0:1788813453.249899:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 112 00000100:00100000:0.0:1788813453.249910:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+55:10543:x1875706562794368:12345-192.168.204.47@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788813453.249943:0:5851:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788813453.250054:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+55:10543:x1875706562794368:12345-192.168.204.47@tcp:53:lhsmtool_posix.0 Request processed in 145us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813453.250062:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 112 00000100:00080000:2.0:1788813453.250366:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813453.258463:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813453.258570:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562794496 00000100:00100000:2.0:1788813453.258629:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562794496 00000100:00100000:2.0:1788813453.258700:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 113 00000100:00100000:2.0:1788813453.258711:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+55:10543:x1875706562794496:12345-192.168.204.47@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788813453.259069:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1fbf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259087:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1fbf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259110:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1fbf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259183:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1fc6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259191:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259198:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259222:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1fcd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259229:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1fcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259235:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1fcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813453.259285:0:8269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788813453.259290:0:8269:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788813453.259312:0:8269:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1fcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259325:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1fbf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259331:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1fbf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259338:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1fbf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259344:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368c00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813453.259348:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1fbf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259355:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1fbf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259367:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff908743ce0800) 00010000:00010000:2.0:1788813453.259370:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813453.259375:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1fbf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259382:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb1fbf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259397:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259403:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1fc6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259408:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259419:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813453.259422:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259429:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1fc6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259437:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff908743ce0d00) 00010000:00010000:2.0:1788813453.259440:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813453.259442:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1fc6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259448:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb1fc6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259463:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1fcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259469:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1fcd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259475:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1fcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259480:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368e00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813453.259482:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1fcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259488:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1fcd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259505:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:2.0:1788813453.259507:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813453.259510:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1fcd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.259516:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb1fcd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813453.259643:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+55:10543:x1875706562794496:12345-192.168.204.47@tcp:34:lhsmtool_posix.0 Request processed in 931us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813453.259651:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 113 00000100:00100000:3.0:1788813453.270367:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813453.270457:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562794752 00000100:00100000:0.0:1788813453.270467:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562794752 00000100:00100000:0.0:1788813453.270524:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 114 00000100:00100000:0.0:1788813453.270534:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+55:10543:x1875706562794752:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813453.270554:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813453.270575:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1fd4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483f51 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.270705:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1fdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.270721:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1fdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.270732:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1fdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813453.270774:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788813453.270880:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1fdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.270888:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1fdb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.270895:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1fdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.270901:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813453.270906:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1fdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.270913:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1fdb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.270926:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:0.0:1788813453.270929:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788813453.270934:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1fdb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.270940:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1fdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.270983:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1fd4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f51 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.270993:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff908743ce0800) 00010000:00010000:0.0:1788813453.270995:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788813453.271006:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1fd4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f51 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.271016:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740030a00, rc 0) 00000100:00100000:0.0:1788813453.271082:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+56:10543:x1875706562794752:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 549us (723us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1788813453.271106:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 114 00000100:00100000:3.0:1788813453.284147:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813453.284430:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562794880 00000100:00100000:0.0:1788813453.284441:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562794880 00000100:00100000:0.0:1788813453.284505:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 115 00000100:00100000:0.0:1788813453.284514:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+56:10543:x1875706562794880:12345-192.168.204.47@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788813453.284575:0:5850:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788813453.284721:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+56:10543:x1875706562794880:12345-192.168.204.47@tcp:53:lhsmtool_posix.0 Request processed in 208us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813453.284729:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 115 00000100:00100000:2.0:1788813453.292333:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813453.292448:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562795136 00000100:00100000:0.0:1788813453.292458:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562795136 00000100:00100000:0.0:1788813453.292517:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 116 00000100:00100000:0.0:1788813453.292528:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+56:10543:x1875706562795136:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813453.292555:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813453.292559:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788813453.292615:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb1f79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f35 expref: 56 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.292636:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:0.0:1788813453.292642:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813453.292655:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1fe9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483f58 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788813453.293078:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788813453.293294:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1ff0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.293309:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.293321:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.293371:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb1fe9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f58 expref: 58 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.293387:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1ff0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f58 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.293394:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90874a4cb600) 00010000:00010000:0.0:1788813453.293397:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813453.293399:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740031400, rc 0) 00000100:00100000:0.0:1788813453.293468:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+57:10543:x1875706562795136:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 941us (1143us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788813453.293475:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 116 00000100:00100000:3.0:1788813453.296810:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813453.296930:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562795392 00000100:00100000:0.0:1788813453.296940:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562795392 00000100:00100000:0.0:1788813453.297006:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 117 00000100:00100000:0.0:1788813453.297017:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+57:10543:x1875706562795392:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788813453.297083:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813453.297138:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb1ff0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f58 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.297159:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90874a4cb600) 00010000:00010000:0.0:1788813453.297171:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813453.297196:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1ffe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.297211:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1ffe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.297221:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1ffe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.297237:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0200/0x6d74dbab2ddb2005 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xc69abecf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.297245:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0200/0x6d74dbab2ddb2005 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc69abecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.297251:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0200/0x6d74dbab2ddb2005 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc69abecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.297329:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1ffe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.297338:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1ffe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.297345:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1ffe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.297351:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813453.297365:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1ffe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.297372:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1ffe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.297382:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:0.0:1788813453.297385:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813453.297389:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1ffe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.297395:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb1ffe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.297404:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0200/0x6d74dbab2ddb2005 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc69abecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.297409:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0200/0x6d74dbab2ddb2005 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc69abecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.297415:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0200/0x6d74dbab2ddb2005 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc69abecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.297420:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a0200 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813453.297423:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0200/0x6d74dbab2ddb2005 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc69abecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.297428:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0200/0x6d74dbab2ddb2005 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc69abecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.297447:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xc69abecf (ffff90874a4cbc00) 00010000:00010000:0.0:1788813453.297449:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813453.297458:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0200/0x6d74dbab2ddb2005 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc69abecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.297464:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0200/0x6d74dbab2ddb2005 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc69abecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813453.297563:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+56:10543:x1875706562795392:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 Request processed in 547us (763us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788813453.297571:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 117 00000100:00100000:2.0:1788813453.301044:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813453.301212:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562795520 00000100:00100000:3.0:1788813453.301222:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562795520 00000100:00100000:3.0:1788813453.301294:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 118 00000100:00100000:3.0:1788813453.301369:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+56:10543:x1875706562795520:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813453.301390:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813453.301417:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb200c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483f5f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.301454:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb2013 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.301468:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb2013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.301479:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb2013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.301572:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb200c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f5f expref: 58 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.301611:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb2013 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f5f expref: 57 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.301620:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff908745aca700) 00010000:00010000:3.0:1788813453.301622:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788813453.301626:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad1000, rc 0) 00000100:00100000:3.0:1788813453.301825:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+57:10543:x1875706562795520:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 508us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813453.301833:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 118 00000100:00100000:3.0:1788813453.305357:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813453.305533:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562795776 00000100:00100000:0.0:1788813453.305544:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562795776 00000100:00100000:0.0:1788813453.305743:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 119 00000100:00100000:0.0:1788813453.305763:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+57:10543:x1875706562795776:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788813453.305858:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb201a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.305876:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb201a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.305887:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb201a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788813453.306131:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1788813453.306141:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 395548559817ns, next at 396548557296ns, rc = 0 00000004:00010000:0.0:1788813453.306225:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f24cc12 reply state 00000000575f4059 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb201a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813453.306234:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788813453.306390:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+59:10543:x1875706562795776:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 Request processed in 637us (1043us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1788813453.306415:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 119 00010000:00010000:2.0:1788813453.308675:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb201a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.308691:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb201a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.308699:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb201a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.308705:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a1c00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813453.308710:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb201a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.308718:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb201a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.308734:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff908745aca700) 00010000:00010000:2.0:1788813453.308762:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788813453.308769:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb201a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.308775:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb201a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813453.309731:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813453.309923:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562795904 00000100:00100000:0.0:1788813453.309934:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562795904 00000100:00100000:0.0:1788813453.309985:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 120 00000100:00100000:0.0:1788813453.309995:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+58:10543:x1875706562795904:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813453.310021:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813453.310039:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0200/0x6d74dbab2ddb2021 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483f66 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.310106:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0200/0x6d74dbab2ddb2021 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f66 expref: 59 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.310120:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0200/0x6d74dbab2ddb2021 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f66 expref: 59 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.310139:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff908745aca700) 00010000:00010000:0.0:1788813453.310143:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788813453.310146:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9087413a0200, rc 0) 00000100:00100000:0.0:1788813453.310214:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+59:10543:x1875706562795904:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 220us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813453.310221:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 120 00000100:00100000:1.0:1788813453.313674:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813453.313919:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562796032 00000100:00100000:2.0:1788813453.313932:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562796032 00000100:00100000:2.0:1788813453.314006:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 37 00000100:00100000:2.0:1788813453.314016:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+8:2359:x1875706562796032:12345-192.168.204.47@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788813453.314327:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+9:2359:x1875706562796032:12345-192.168.204.47@tcp:2:lhsmtool_posix.0 Request processed in 311us (661us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788813453.314335:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 37 00000100:00080000:3.0:1788813453.314400:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813453.319364:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813453.319462:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562796288 00000100:00100000:3.0:1788813453.319473:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562796288 00000100:00100000:3.0:1788813453.319545:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 30 00000100:00100000:3.0:1788813453.319555:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+59:10543:x1875706562796288:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788813453.319847:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+60:10543:x1875706562796288:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 Request processed in 291us (494us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1788813453.319856:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 30 00000100:00100000:0.0:1788813453.324431:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813453.324529:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562796544 00000100:00100000:2.0:1788813453.324540:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562796544 00000100:00100000:2.0:1788813453.324633:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 121 00000100:00100000:2.0:1788813453.324644:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877405a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+60:10543:x1875706562796544:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788813453.325377:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877405a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+60:10543:x1875706562796544:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 Request processed in 115us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813453.325387:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 121 00000100:00100000:1.0:1788813453.327172:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813453.327322:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562796672 00000100:00100000:0.0:1788813453.327332:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562796672 00000100:00100000:0.0:1788813453.327391:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 122 00000100:00100000:0.0:1788813453.327401:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+60:10543:x1875706562796672:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813453.327439:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813453.327460:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb2028 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483f6d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.327529:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb202f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.327544:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb202f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.327555:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb202f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813453.327635:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788813453.327657:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb202f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.327684:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb2028 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f6d expref: 62 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.327702:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb202f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f6d expref: 61 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.327710:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff908745aca700) 00010000:00010000:0.0:1788813453.327713:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788813453.327717:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9087413a0800, rc 0) 00000100:00100000:0.0:1788813453.327774:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+61:10543:x1875706562796672:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 374us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813453.327911:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 122 00000100:00100000:3.0:1788813453.331186:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813453.331526:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562796800 00000100:00100000:1.0:1788813453.331537:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562796800 00000100:00100000:1.0:1788813453.331728:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 38 00000100:00100000:1.0:1788813453.331740:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+9:2360:x1875706562796800:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788813453.331767:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813453.331797:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b34bf5a1/0x6d74dbab2ddb2036 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483f74 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788813453.331825:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f208d, blocks: 0x1 00010000:00010000:1.0:1788813453.331846:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1788813453.331851:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813453.331860:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b34bf5a1/0x6d74dbab2ddb2036 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f74 expref: 10 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.331879:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b34bf5a1/0x6d74dbab2ddb2036 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f74 expref: 10 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.331913:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908749d72600, rc 0) 00000100:00100000:1.0:1788813453.331971:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+10:2360:x1875706562796800:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 234us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813453.331978:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 38 00000100:00100000:1.0:1788813453.335365:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813453.335470:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562797056 00000100:00100000:2.0:1788813453.335481:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562797056 00000100:00100000:2.0:1788813453.335596:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 123 00000100:00100000:2.0:1788813453.335607:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+61:10543:x1875706562797056:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788813453.335726:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+61:10543:x1875706562797056:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 Request processed in 120us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813453.335747:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 123 00000100:00100000:3.0:1788813453.338677:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813453.338826:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562797184 00000100:00100000:2.0:1788813453.338835:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562797184 00000100:00100000:2.0:1788813453.338893:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 39 00000100:00100000:2.0:1788813453.338904:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+10:10543:x1875706562797184:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813453.338923:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813453.338942:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075c556f4/0x6d74dbab2ddb203d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483f7b expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.338977:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b34bf5a1/0x6d74dbab2ddb2036 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f74 expref: 11 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.338986:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813453.338991:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813453.338995:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075c556f4/0x6d74dbab2ddb203d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f7b expref: 11 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.339029:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b34bf5a1/0x6d74dbab2ddb2036 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f74 expref: 11 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.339044:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b34bf5a1/0x6d74dbab2ddb2036 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f74 expref: 11 pid: 6705 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813453.339058:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fa54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1875706583781248:192.168.204.47@tcp:104: 00000100:00100000:2.0:1788813453.339152:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff908744e41780 going to sleep for 11 seconds 00000100:00100000:3.0:1788813453.342136:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813453.342235:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562797312 00000100:00100000:0.0:1788813453.342245:0:8477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562797312 00010000:00010000:0.0:1788813453.342296:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b34bf5a1/0x6d74dbab2ddb2036 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f74 expref: 12 pid: 6705 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813453.342342:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 54 00000100:00100000:0.0:1788813453.342353:0:8477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600e2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+12:2360:x1875706562797312:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813453.342369:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813453.342393:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b34bf5a1/0x6d74dbab2ddb2036 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f74 expref: 12 pid: 6705 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.342405:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b34bf5a1/0x6d74dbab2ddb2036 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f74 expref: 12 pid: 6705 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.342429:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813453.342433:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813453.342441:0:8477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000075c556f4/0x6d74dbab2ddb203d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f7b expref: 12 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.342450:0:8477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075c556f4/0x6d74dbab2ddb203d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f7b expref: 12 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.342486:0:8477:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000075c556f4/0x6d74dbab2ddb203d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f7b expref: 12 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813453.342501:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908774059880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8477:1875706583781376:192.168.204.47@tcp:105: 00000100:00100000:0.0:1788813453.342625:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fab1180 going to sleep for 11 seconds 00010000:00010000:2.0:1788813453.343458:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b34bf5a1/0x6d74dbab2ddb2036 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f74 expref: 12 pid: 6705 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813453.343478:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fa54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1875706583781248:192.168.204.47@tcp:104: 00010000:00010000:2.0:1788813453.343504:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075c556f4/0x6d74dbab2ddb203d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f7b expref: 11 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.343516:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368c00, rc 0) 00000100:00100000:2.0:1788813453.343570:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+11:10543:x1875706562797184:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 4667us (4904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813453.344060:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 39 00000100:00100000:3.0:1788813453.350404:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813453.350531:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908774059880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8477:1875706583781376:192.168.204.47@tcp:105: 00010000:00010000:0.0:1788813453.350557:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813453.350651:0:8477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600e2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+10:2360:x1875706562797312:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 8298us (8524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813453.350660:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 54 00000100:00100000:2.0:1788813453.351545:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562797440 00000100:00100000:2.0:1788813453.351557:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562797440 00002000:00100000:2.0:1788813453.351643:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff90876eb70a80 x1875706562797440/t0(0) o4->e90f6370-8c16-4659-9369-1cd146993b4c@192.168.204.47@tcp:269/0 lens 504/0 e 0 to 0 dl 1788813464 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788813453.351656:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90876eb70a80 with x1875706562797440 ext(0->12) 00002000:00010000:2.0:1788813453.351663:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90876eb70a80 00000100:00100000:2.0:1788813453.351693:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 2 00000100:00100000:2.0:1788813453.351703:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e90f6370-8c16-4659-9369-1cd146993b4c+10:2360:x1875706562797440:12345-192.168.204.47@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788813453.352571:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e90f6370-8c16-4659-9369-1cd146993b4c+12:2360:x1875706562797440:12345-192.168.204.47@tcp:4:lhsmtool_posix.0 Request processed in 865us (2172us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788813453.352612:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 2 00002000:00100000:2.0:1788813453.352622:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff90876eb70a80 x1875706562797440/t4294967308(0) o4->e90f6370-8c16-4659-9369-1cd146993b4c@192.168.204.47@tcp:269/0 lens 504/448 e 0 to 0 dl 1788813464 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788813453.352643:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90876eb70a80 with x1875706562797440 ext(0->12) 00002000:00010000:2.0:1788813453.352648:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90876eb70a80 00000100:00100000:3.0:1788813453.355828:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813453.355987:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562797568 00000100:00100000:2.0:1788813453.355999:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562797568 00000100:00100000:2.0:1788813453.356059:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 124 00000100:00100000:2.0:1788813453.356074:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+61:10543:x1875706562797568:12345-192.168.204.47@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788813453.393650:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:1.0:1788813453.393663:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:1.0:1788813453.393694:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:1.0:1788813453.393737:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1788813453.393756:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff908643a95480 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788813453.393760:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90877433a300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff908743ce4000 00000020:00080000:1.0:1788813453.393764:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90877433a600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90876e5fd800 00000020:00080000:1.0:1788813453.393800:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90876ea799c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788813453.393803:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90877433ab00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90876ea79900 00000020:00080000:1.0:1788813453.393807:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90877433af00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90876e45f400 00000001:00080000:1.0:1788813453.393813:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:1.0:1788813453.393957:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788813453.394138:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788813453.394158:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583781504:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788813453.394227:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813453.394307:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583781504 00000100:00100000:1.0:1788813453.394314:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583781504 00000100:00100000:1.0:1788813453.394358:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788813453.394367:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3319:x1875706583781504:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788813453.394411:0:6704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1788813453.394449:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f208c, atime: 0x6a9f208c, ctime: 0x6a9f208c, blocks: 0x1 00010000:00010000:1.0:1788813453.394458:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006246ceb3/0x6d74dbab2ddb2044 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.394474:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1788813453.394479:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813453.394486:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006246ceb3/0x6d74dbab2ddb2044 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.394505:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006246ceb3/0x6d74dbab2ddb2044 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.394516:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006246ceb3/0x6d74dbab2ddb2044 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.394524:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006246ceb3/0x6d74dbab2ddb2044 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.394542:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788813453.395084:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3319:x1875706583781504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 716us (855us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788813453.395092:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1788813453.395122:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813453.395128:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006246ceb3/0x6d74dbab2ddb2044 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.395150:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73600 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813453.395155:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006246ceb3/0x6d74dbab2ddb2044 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.395164:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006246ceb3/0x6d74dbab2ddb2044 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.395181:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006246ceb3/0x6d74dbab2ddb2044 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.395188:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006246ceb3/0x6d74dbab2ddb2044 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.395210:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813453.395212:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813453.395214:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788813453.395247:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90877c3ef480/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788813453.395266:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583781504:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788813453.395874:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908774059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583781760:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788813453.395922:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813453.395966:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788813453.395983:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877405b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583781632:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788813453.396006:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813453.396036:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583781760 00000100:00100000:3.0:1788813453.396042:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583781760 00000100:00100000:3.0:1788813453.396082:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583781632 00000100:00100000:3.0:1788813453.396085:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583781632 00000100:00100000:3.0:1788813453.396103:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788813453.396111:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3321:x1875706583781760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788813453.396250:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788813453.396265:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788813454 00002000:00010000:3.0:1788813453.396267:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788813453.396269:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788813453 -> 1788813454 00002000:00010000:3.0:1788813453.396282:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788813453.396315:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3321:x1875706583781760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 205us (393us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788813453.396322:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788813453.396336:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788813453.396341:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3321:x1875706583781632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788813453.396353:0:6706:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1788813453.396368:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e3edff/0x6d74dbab2ddb204b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.396386:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb1e06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eda expref: 11 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.396396:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788813453.396399:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788813453.396404:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e3edff/0x6d74dbab2ddb204b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.396429:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb1e06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eda expref: 11 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.396444:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb1e06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eda expref: 11 pid: 6706 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813453.396456:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb73800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1875706583781888:192.168.204.47@tcp:104: 00000100:00100000:3.0:1788813453.396512:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087486e4600 going to sleep for 11 seconds 00000100:00080000:3.0:1788813453.396531:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788813453.396558:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff908774059880/2, rc 0, transno 4294967309 00000100:00100000:3.0:1788813453.396563:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908774059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583781760:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788813453.401321:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813453.401361:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562797696 00000100:00100000:1.0:1788813453.401369:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562797696 00010000:00010000:1.0:1788813453.401411:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb1e06 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eda expref: 12 pid: 6706 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813453.401450:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 55 00000100:00100000:1.0:1788813453.401472:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+12:2359:x1875706562797696:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813453.401488:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813453.401495:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb1e06 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eda expref: 12 pid: 6706 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.401509:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb1e06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eda expref: 12 pid: 6706 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.401534:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788813453.401539:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788813453.401544:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0e3edff/0x6d74dbab2ddb204b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.401553:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e3edff/0x6d74dbab2ddb204b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.401574:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813453.401650:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+12:2359:x1875706562797696:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 180us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813453.401658:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 55 00000100:00100000:2.0:1788813453.401855:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+15:10543:x1875706562797568:12345-192.168.204.47@tcp:44:lhsmtool_posix.0 Request processed in 45782us (46035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813453.401864:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 124 00010000:00010000:3.0:1788813453.402378:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb1e06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483eda expref: 11 pid: 6706 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813453.402394:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb73800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1875706583781888:192.168.204.47@tcp:104: 00010000:00010000:3.0:1788813453.402421:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b0e3edff/0x6d74dbab2ddb204b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.402431:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b0e3edff/0x6d74dbab2ddb204b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.402438:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0e3edff/0x6d74dbab2ddb204b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.402448:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0e3edff/0x6d74dbab2ddb204b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.402454:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0e3edff/0x6d74dbab2ddb204b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.402525:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788813453.403419:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3321:x1875706583781632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7074us (7408us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788813453.403430:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788813453.406414:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813453.406492:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562797824 00000100:00100000:3.0:1788813453.406503:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562797824 00000100:00100000:3.0:1788813453.406564:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 43 00000100:00100000:3.0:1788813453.406575:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+11:2362:x1875706562797824:12345-192.168.204.47@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1788813453.410044:0:7658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813453.410059:0:7658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0e3edff/0x6d74dbab2ddb204b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.410087:0:7658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1c00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:2.0:1788813453.410092:0:7658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0e3edff/0x6d74dbab2ddb204b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.410106:0:7658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0e3edff/0x6d74dbab2ddb204b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.410127:0:7658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0e3edff/0x6d74dbab2ddb204b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.410136:0:7658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0e3edff/0x6d74dbab2ddb204b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.410177:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813453.410179:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813453.410181:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788813453.410512:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90877405b800/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788813453.410522:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877405b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583781632:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788813453.444652:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+11:2362:x1875706562797824:12345-192.168.204.47@tcp:16:lhsmtool_posix.0 Request processed in 38065us (38233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813453.444667:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 43 00000001:00080000:3.0:1788813453.444708:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1788813453.444720:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1788813453.444737:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:1.0:1788813453.447673:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813453.447762:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562798080 00000100:00100000:0.0:1788813453.447772:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562798080 00000100:00100000:0.0:1788813453.447854:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 125 00000100:00100000:0.0:1788813453.447865:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+15:10543:x1875706562798080:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788813453.447920:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813453.447960:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb202f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f6d expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.447983:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff908745aca700) 00010000:00010000:0.0:1788813453.447989:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813453.448030:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb2052 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.448044:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb2052 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.448053:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb2052 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813453.448316:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005cdc5ed5 reply state 000000002b2bdcd1 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb2052 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813453.448339:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788813453.448449:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+16:10543:x1875706562798080:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 Request processed in 585us (787us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788813453.448456:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 125 00000100:00100000:1.0:1788813453.451671:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813453.452317:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562798208 00000100:00100000:3.0:1788813453.452328:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562798208 00000100:00100000:3.0:1788813453.452388:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 44 00000100:00100000:3.0:1788813453.452399:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+6:2360:x1875706562798208:12345-192.168.204.47@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788813453.452695:0:6704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788813453.452699:0:6704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788813454 -> 1788813453 00002000:00010000:3.0:1788813453.452702:0:6704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788813452 00002000:00010000:3.0:1788813453.452704:0:6704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788813454 -> 1788813453 00002000:00010000:3.0:1788813453.452707:0:6704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788813453.452793:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+7:2360:x1875706562798208:12345-192.168.204.47@tcp:2:lhsmtool_posix.0 Request processed in 386us (1122us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788813453.452801:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 44 00010000:00010000:2.0:1788813453.453049:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb2052 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.453060:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb2052 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.453068:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb2052 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.453075:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a1600 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813453.453079:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb2052 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.453088:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb2052 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.453115:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff908745aca700) 00010000:00010000:2.0:1788813453.453118:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813453.453123:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb2052 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.453130:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb2052 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813453.458793:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813453.460662:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562798464 00000100:00100000:0.0:1788813453.460677:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562798464 00000100:00100000:0.0:1788813453.460761:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 126 00000100:00100000:0.0:1788813453.460774:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+15:10543:x1875706562798464:12345-192.168.204.47@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788813453.460862:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2059 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.460881:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb2013 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f5f expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.460891:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2059 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.460927:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb2013 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f5f expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.460942:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb2013 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f5f expref: 15 pid: 5849 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813453.460957:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877405bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1875706583782016:192.168.204.47@tcp:104: 00000100:00100000:0.0:1788813453.461074:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087480f5840 going to sleep for 11 seconds 00000100:00100000:1.0:1788813453.466032:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813453.466117:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562798592 00000100:00100000:2.0:1788813453.466128:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562798592 00010000:00010000:2.0:1788813453.466169:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb2013 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f5f expref: 16 pid: 5849 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813453.466224:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 56 00000100:00100000:2.0:1788813453.466235:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e90f6370-8c16-4659-9369-1cd146993b4c+16:2359:x1875706562798592:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813453.466250:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813453.466269:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb2013 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f5f expref: 16 pid: 5849 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.466282:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb2013 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f5f expref: 16 pid: 5849 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.466306:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff908745aca700) 00010000:00010000:2.0:1788813453.466311:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2059 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.466333:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2059 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.466342:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2059 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.466362:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813453.466419:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e90f6370-8c16-4659-9369-1cd146993b4c+16:2359:x1875706562798592:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 186us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813453.466427:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 56 00010000:00010000:0.0:1788813453.468299:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb2013 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f5f expref: 15 pid: 5849 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813453.468350:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877405bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1875706583782016:192.168.204.47@tcp:104: 00010000:00010000:0.0:1788813453.468377:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2059 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.468476:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2059 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.468491:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2059 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.468523:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2059 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.468531:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2059 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.468538:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2059 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.468544:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a0800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813453.468549:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2059 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.468556:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2059 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.468571:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff908745aca700) 00010000:00010000:1.0:1788813453.468574:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788813453.468938:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2059 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.468948:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2059 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813453.469075:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+14:10543:x1875706562798464:12345-192.168.204.47@tcp:55:lhsmtool_posix.0 Request processed in 8302us (10298us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788813453.469086:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 126 00000100:00100000:1.0:1788813453.472276:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813453.472368:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562798720 00000100:00100000:2.0:1788813453.472378:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562798720 00000100:00100000:2.0:1788813453.472470:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 45 00000100:00100000:2.0:1788813453.472481:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+7:2359:x1875706562798720:12345-192.168.204.47@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788813453.472540:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb2060 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.472563:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000075c556f4/0x6d74dbab2ddb203d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f7b expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.472573:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813453.472607:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813453.472613:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb2060 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.472650:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000075c556f4/0x6d74dbab2ddb203d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f7b expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.472665:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000075c556f4/0x6d74dbab2ddb203d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f7b expref: 7 pid: 6706 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813453.472680:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fa54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1875706583782144:192.168.204.47@tcp:104: 00000100:00100000:2.0:1788813453.473035:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876e5a2900 going to sleep for 11 seconds 00000100:00100000:2.0:1788813453.482170:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813453.482239:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562798848 00000100:00100000:3.0:1788813453.482248:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562798848 00010000:00010000:3.0:1788813453.482295:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000075c556f4/0x6d74dbab2ddb203d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f7b expref: 8 pid: 6706 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813453.482356:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 57 00000100:00100000:3.0:1788813453.482364:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+8:2360:x1875706562798848:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813453.482381:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813453.482403:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000075c556f4/0x6d74dbab2ddb203d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f7b expref: 8 pid: 6706 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.482417:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000075c556f4/0x6d74dbab2ddb203d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f7b expref: 8 pid: 6706 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.482441:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788813453.482445:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788813453.482451:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb2060 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.482460:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb2060 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.482478:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813453.482531:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+8:2360:x1875706562798848:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 167us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813453.482538:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 57 00010000:00010000:1.0:1788813453.485153:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075c556f4/0x6d74dbab2ddb203d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f7b expref: 7 pid: 6706 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813453.485179:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fa54a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1875706583782144:192.168.204.47@tcp:104: 00010000:00010000:1.0:1788813453.485203:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb2060 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.485215:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb2060 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.485223:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb2060 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.485269:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb2060 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.485277:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb2060 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.485285:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb2060 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.485292:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369400 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813453.485297:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb2060 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.485330:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb2060 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.485351:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb2060 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.485358:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb2060 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813453.485513:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+6:2359:x1875706562798720:12345-192.168.204.47@tcp:1:lhsmtool_posix.0 Request processed in 13033us (13244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813453.485523:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 45 00000100:00100000:2.0:1788813453.489106:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813453.489303:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562799104 00000100:00100000:0.0:1788813453.489313:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562799104 00000100:00100000:0.0:1788813453.489373:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 127 00000100:00100000:0.0:1788813453.489384:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+14:10543:x1875706562799104:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788813453.489463:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2067 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.489480:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2067 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.489492:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2067 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.490050:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb206e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.490064:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0200/0x6d74dbab2ddb2021 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f66 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.490071:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb206e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.490106:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0200/0x6d74dbab2ddb2021 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f66 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.490121:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0200/0x6d74dbab2ddb2021 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f66 expref: 15 pid: 5851 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813453.490156:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877be45500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875706583782272:192.168.204.47@tcp:104: 00000100:00100000:1.0:1788813453.490247:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dff780 going to sleep for 11 seconds 00000100:00100000:1.0:1788813453.493420:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877be45500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875706583782272:192.168.204.47@tcp:104: 00010000:00010000:1.0:1788813453.493454:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb206e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813453.494642:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813453.495314:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562799232 00000100:00100000:1.0:1788813453.495325:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562799232 00010000:00010000:1.0:1788813453.495373:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0200/0x6d74dbab2ddb2021 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f66 expref: 16 pid: 5851 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813453.495417:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 58 00000100:00100000:1.0:1788813453.495426:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e90f6370-8c16-4659-9369-1cd146993b4c+16:2359:x1875706562799232:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813453.495439:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813453.495445:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0200/0x6d74dbab2ddb2021 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f66 expref: 16 pid: 5851 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.495457:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0200/0x6d74dbab2ddb2021 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f66 expref: 16 pid: 5851 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.495477:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0200/0x6d74dbab2ddb2021 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f66 expref: 16 pid: 5851 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.495494:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff908745aca700) 00010000:00010000:1.0:1788813453.495499:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb206e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.495523:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb206e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.495530:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb206e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.495561:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813453.495709:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e90f6370-8c16-4659-9369-1cd146993b4c+15:2359:x1875706562799232:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 283us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813453.495717:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 58 00010000:00010000:2.0:1788813453.495920:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb206e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813453.495928:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb206e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788813453.496139:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1788813453.496289:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1788813453.496334:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1788813453.496412:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fa56680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1875706583782400:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788813453.496467:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813453.496505:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876e5a2180 going to sleep for 11 seconds 00000100:00100000:1.0:1788813453.497032:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583782400 00000100:00100000:1.0:1788813453.497040:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583782400 00000100:00100000:1.0:1788813453.497082:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788813453.497108:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5850:x1875706583782400:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788813453.497202:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5850:x1875706583782400:12345-0@lo:1000:mdt00_001.0 Request processed in 111us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813453.497209:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788813453.497443:0:5850:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788813453.497449:0:5850:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:3.0:1788813453.497469:0:5850:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff908774059880, transno 4294967309 00000004:00080000:3.0:1788813453.497485:0:5850:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90877405b800, transno 4294967310 00000100:00100000:3.0:1788813453.497505:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fa56680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1875706583782400:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788813453.498053:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1788813453.498143:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb73800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1875706583782528:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788813453.498200:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813453.498224:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff90875efc9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788813453.498522:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583782528 00000100:00100000:2.0:1788813453.498530:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583782528 00000100:00100000:2.0:1788813453.498562:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788813453.498569:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1875706583782528:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788813453.498761:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1875706583782528:12345-0@lo:1000:mdt00_001.0 Request processed in 191us (560us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788813453.498768:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788813453.499381:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb73800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1875706583782528:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788813453.499422:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb206e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.499433:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb206e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.499441:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb206e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.499447:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d72200 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813453.499452:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb206e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.499459:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb206e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.499488:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff908745aca700) 00010000:00010000:3.0:1788813453.499491:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813453.499496:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb206e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.499503:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb206e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.499535:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1fb1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.499550:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1fb1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.499555:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1fb1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.499561:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369600 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813453.499564:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1fb1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.499571:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1fb1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.499614:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:3.0:1788813453.499617:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813453.499625:0:5850:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1fb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f4a expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.499636:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1fb8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f4a expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.499645:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1fb8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f4a expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.499675:0:5850:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1fb8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f4a expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813453.499689:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fa55880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875706583782656:192.168.204.47@tcp:105: 00000100:00100000:1.0:1788813453.501416:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff90875efc9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813453.512862:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813453.513174:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fa55880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875706583782656:192.168.204.47@tcp:105: 00010000:00010000:1.0:1788813453.513208:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1fb1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.513220:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb1fb1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.514567:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2075 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.514606:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2075 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.514631:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2075 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.514643:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2075 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.514649:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2075 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.514656:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2075 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.514661:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73600 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813453.514665:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2075 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.514671:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2075 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.514683:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:1.0:1788813453.514686:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813453.514690:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2075 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.514695:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2075 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.514706:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2067 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.514712:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2067 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.514725:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2067 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.514731:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a0800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813453.514734:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2067 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.515071:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2067 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.515086:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:1.0:1788813453.515088:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788813453.515092:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2067 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.515099:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2067 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813453.515344:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+18:10543:x1875706562799104:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 Request processed in 25958us (26244us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1788813453.515356:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 127 00000020:00080000:1.0:1788813453.515363:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788813453.515492:0:11711:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788813453.515499:0:11711:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788813453.516027:0:11711:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788813453.516035:0:11711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788813453.518321:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562799360 00000100:00100000:2.0:1788813453.518338:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562799360 00000100:00100000:2.0:1788813453.518409:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 31 00000100:00100000:2.0:1788813453.518419:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+18:10542:x1875706562799360:12345-192.168.204.47@tcp:49:lfs.0 00000100:00100000:2.0:1788813453.518561:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+18:10542:x1875706562799360:12345-192.168.204.47@tcp:49:lfs.0 Request processed in 143us (5708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813453.518569:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 31 00000100:00100000:2.0:1788813453.524215:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813453.524336:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813453.524409:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562799616 00000100:00100000:0.0:1788813453.524420:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562799616 00000100:00100000:0.0:1788813453.524477:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 32 00000100:00100000:0.0:1788813453.524488:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874adaf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+18:10543:x1875706562799616:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788813453.525115:0:5852:0:(mdd_object.c:4181:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788813453.525211:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1788813453.525266:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb207c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.525283:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb207c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.525303:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb207c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.525311:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb207c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.525318:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb207c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.525323:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb207c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.525342:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788813453.525428:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874adaf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+20:10543:x1875706562799616:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 Request processed in 940us (1218us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788813453.525436:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 32 00000020:00080000:0.0:1788813453.525440:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788813453.525494:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813453.525500:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb207c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.525507:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a1600 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813453.525511:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb207c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.525519:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb207c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.525530:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff90874a4cbc00) 00010000:00010000:0.0:1788813453.525533:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788813453.525544:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb207c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.525550:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb207c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813453.525566:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813453.525568:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813453.525570:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813453.526439:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562799872 00000100:00100000:1.0:1788813453.526449:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562799872 00000100:00100000:1.0:1788813453.526488:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 128 00000100:00100000:1.0:1788813453.526496:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+20:10542:x1875706562799872:12345-192.168.204.47@tcp:58:lfs.0 00000040:00080000:1.0:1788813453.526714:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788813453.526789:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+20:10542:x1875706562799872:12345-192.168.204.47@tcp:58:lfs.0 Request processed in 293us (2452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813453.526797:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 128 00000100:00100000:0.0:1788813453.563797:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813453.563943:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562800000 00000100:00100000:3.0:1788813453.563955:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562800000 00000100:00100000:3.0:1788813453.564007:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 129 00000100:00100000:3.0:1788813453.564017:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877405bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+20:10545:x1875706562800000:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:3.0:1788813453.564046:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813453.564066:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb2083 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483f82 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.564145:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb208a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.564160:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb208a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.564171:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb208a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.564184:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2091 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.564191:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.564197:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.564422:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb2098 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.564433:0:8269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1fa3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f43 expref: 21 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.564449:0:8269:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb2098 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.564480:0:8269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1fa3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f43 expref: 21 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.564493:0:8269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1fa3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f43 expref: 21 pid: 8269 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813453.564506:0:8269:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8269:1875706583782784:192.168.204.47@tcp:104: 00000100:00100000:3.0:1788813453.564635:0:8269:0:(client.c:2716:ptlrpc_set_wait()) set ffff90875efc9480 going to sleep for 11 seconds 00000100:00100000:3.0:1788813453.571438:0:8269:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8269:1875706583782784:192.168.204.47@tcp:104: 00000100:00100000:1.0:1788813453.571440:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00010000:00010000:3.0:1788813453.571468:0:8269:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb2098 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813453.572199:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562800256 00000100:00100000:0.0:1788813453.572208:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562800256 00000100:00100000:0.0:1788813453.572279:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 33 00000100:00100000:0.0:1788813453.572290:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+22:5599:x1875706562800256:12345-192.168.204.47@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788813453.572603:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+23:5599:x1875706562800256:12345-192.168.204.47@tcp:35:ldlm_bl.0 Request processed in 289us (1137us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1788813453.572612:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 33 00000100:00100000:3.0:1788813453.574844:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813453.574945:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562800384 00000100:00100000:1.0:1788813453.574954:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562800384 00010000:00010000:1.0:1788813453.574996:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1fa3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f43 expref: 23 pid: 8269 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813453.575045:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 59 00000100:00100000:1.0:1788813453.575055:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+23:2360:x1875706562800384:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813453.575070:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813453.575076:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1fa3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f43 expref: 23 pid: 8269 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.575101:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1fa3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f43 expref: 23 pid: 8269 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.575123:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb1fa3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f43 expref: 23 pid: 8269 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.575139:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:1.0:1788813453.575145:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb2098 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.575155:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb2098 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.575177:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb2098 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813453.575208:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813453.575268:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+22:2360:x1875706562800384:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 213us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813453.575275:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 59 00010000:00010000:3.0:1788813453.575471:0:8269:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb2098 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.575480:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb2098 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813453.575524:0:8269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788813453.575529:0:8269:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813453.575550:0:8269:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb2098 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.575563:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb2098 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.575620:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb208a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.575628:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb208a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.575636:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb208a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.575641:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813453.575646:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb208a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.575653:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb208a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.575664:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:3.0:1788813453.575666:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813453.575671:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb208a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.575677:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb208a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.575688:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.575694:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2091 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.575699:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2091 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.575712:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813453.575715:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2091 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.575721:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2091 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.575729:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff908745acaf00) 00010000:00010000:3.0:1788813453.575731:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813453.575733:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2091 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.575739:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2091 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.575773:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb2083 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f82 expref: 22 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.575787:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb2098 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f82 expref: 21 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813453.575794:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:3.0:1788813453.575796:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813453.575799:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad1000, rc 0) 00000100:00100000:3.0:1788813453.575844:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877405bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+21:10545:x1875706562800000:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 11828us (12056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813453.575851:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 129 00000001:00080000:3.0:1788813453.586757:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:3.0:1788813453.586947:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1788813453.586955:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:1.0:1788813454.012762:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813454.013191:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583782912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813454.013269:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813454.013388:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583782912 00000100:00100000:2.0:1788813454.013397:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583782912 00000100:00100000:2.0:1788813454.013457:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788813454.013468:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583782912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813454.013510:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788813454.013610:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813454.020228:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583782912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6751us (6946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813454.020255:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788813454.025929:0:3318:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1788813454.025944:0:3318:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:1.0:1788813454.025968:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90877be46a00, transno 4294967301 00000004:00080000:1.0:1788813454.025989:0:3318:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1788813454.026002:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90877c3ef480, transno 4294967304 00000100:00100000:1.0:1788813454.026024:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583782912:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788813454.525486:0:11711:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788813454.525500:0:11711:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788813454.525546:0:11711:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788813454.525553:0:11711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788813454.525729:0:11711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11711:1875706583783040:192.168.204.47@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788813454.525837:0:11711:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876ea790c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813454.537408:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813454.537456:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562800512 00000100:00100000:0.0:1788813454.537465:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562800512 00000100:00100000:0.0:1788813454.537520:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 130 00000100:00100000:0.0:1788813454.537530:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774058380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+22:10556:x1875706562800512:12345-192.168.204.47@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788813454.537567:0:5849:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788813454.537996:0:11711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11711:1875706583783040:192.168.204.47@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788813454.539228:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774058380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+21:10556:x1875706562800512:12345-192.168.204.47@tcp:53:lhsmtool_posix.0 Request processed in 1692us (1825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813454.540697:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 130 00000040:00080000:3.0:1788813454.540881:0:12078:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788813454.540886:0:12078:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788813454.540941:0:12078:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788813454.540947:0:12078:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788813454.553882:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813454.554098:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562800768 00000100:00100000:1.0:1788813454.554177:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562800768 00000100:00100000:1.0:1788813454.554283:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 131 00000100:00100000:1.0:1788813454.554295:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+21:10556:x1875706562800768:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788813454.554327:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813454.554350:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73000/0x6d74dbab2ddb209f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483f89 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813454.554466:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72600/0x6d74dbab2ddb20a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813454.554494:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72600/0x6d74dbab2ddb20a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813454.554507:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72600/0x6d74dbab2ddb20a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813454.554523:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788813454.554691:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73000/0x6d74dbab2ddb209f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f89 expref: 24 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813454.554711:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72600/0x6d74dbab2ddb20a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f89 expref: 23 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813454.554719:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:1.0:1788813454.554722:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813454.554739:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908749d72600, rc 0) 00000100:00100000:1.0:1788813454.556150:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+23:10556:x1875706562800768:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 1850us (2271us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788813454.556161:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 131 00000100:00100000:3.0:1788813454.560179:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813454.560259:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562801024 00000100:00100000:0.0:1788813454.560281:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562801024 00000100:00100000:0.0:1788813454.560354:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 132 00000100:00100000:0.0:1788813454.560366:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+23:10556:x1875706562801024:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788813454.560439:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb20b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813454.560454:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb20b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813454.560464:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb20b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813454.560653:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb20b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813454.560661:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb20b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813454.560667:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb20b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813454.560672:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a0800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813454.560676:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb20b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813454.560683:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb20b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813454.560694:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:0.0:1788813454.560696:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788813454.560701:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb20b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813454.560748:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb20b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788813454.561112:0:11711:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788813454.561117:0:11711:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1788813454.561199:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+24:10556:x1875706562801024:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 Request processed in 832us (1028us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788813454.561208:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 132 00000040:00080000:2.0:1788813454.561796:0:11711:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788813454.561807:0:11711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788813454.571383:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813454.571483:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813454.571656:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562801408 00000100:00100000:0.0:1788813454.571666:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562801408 00000100:00100000:0.0:1788813454.571720:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 34 00000100:00100000:0.0:1788813454.571730:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+24:10556:x1875706562801408:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788813454.571956:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+25:10556:x1875706562801408:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 Request processed in 227us (472us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788813454.571964:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 34 00000100:00100000:1.0:1788813454.572357:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562801152 00000100:00100000:1.0:1788813454.572364:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562801152 00000100:00100000:1.0:1788813454.572420:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 8 00000100:00100000:1.0:1788813454.572429:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e90f6370-8c16-4659-9369-1cd146993b4c+25:2362:x1875706562801152:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813454.572441:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813454.572466:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72600/0x6d74dbab2ddb20a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f89 expref: 25 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813454.572501:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:1.0:1788813454.572506:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813454.572539:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e90f6370-8c16-4659-9369-1cd146993b4c+24:2362:x1875706562801152:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 111us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813454.572545:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 8 00010000:00010000:2.0:1788813455.043147:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813455.234422:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813455.234469:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813455.234513:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813455.234537:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813455.234563:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813455.234622:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562801536 00000100:00100000:2.0:1788813455.234630:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562801664 00000100:00100000:3.0:1788813455.234632:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562801536 00000100:00100000:2.0:1788813455.234637:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562801664 00000100:00100000:3.0:1788813455.234687:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 287 00000100:00100000:3.0:1788813455.234698:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2359:x1875706562801536:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813455.234700:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562802048 00000100:00100000:2.0:1788813455.234706:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562802048 00000100:00100000:3.0:1788813455.234782:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2359:x1875706562801536:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 85us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813455.234790:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 287 00000100:00100000:2.0:1788813455.234807:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 140 00000100:00100000:2.0:1788813455.234823:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+24:2359:x1875706562801664:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813455.234862:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+24:2359:x1875706562801664:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 42us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813455.234868:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 140 00000100:00100000:2.0:1788813455.234883:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 141 00000100:00100000:2.0:1788813455.234889:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aa21be5-2246-40d3-8e20-d34501daf545+5:2359:x1875706562802048:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813455.234911:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aa21be5-2246-40d3-8e20-d34501daf545+5:2359:x1875706562802048:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 23us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813455.234916:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 141 00000100:00080000:2.0:1788813455.234931:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813455.235013:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562801920 00000100:00100000:3.0:1788813455.235018:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562801920 00000100:00100000:3.0:1788813455.235049:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562801792 00000100:00100000:3.0:1788813455.235052:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562801792 00000100:00100000:3.0:1788813455.235070:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 78 00000100:00100000:3.0:1788813455.235077:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:2359:x1875706562801920:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:3.0:1788813455.235106:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:2359:x1875706562801920:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 29us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813455.235112:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 78 00000100:00100000:3.0:1788813455.235126:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 79 00000100:00100000:3.0:1788813455.235134:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+5:2359:x1875706562801792:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:3.0:1788813455.235163:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+5:2359:x1875706562801792:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 30us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813455.235239:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 79 00000100:00080000:3.0:1788813455.235267:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788813455.235270:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788813455.549500:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908761eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd1fd158-af17-4a1b-8f0b-82e57114d008:3319:1875706583783168:0@lo:400:kworker.0 00000100:00100000:0.0:1788813455.549574:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813455.549670:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908761eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875706583783680:0@lo:400:kworker.0 00000100:00100000:0.0:1788813455.549700:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813455.549728:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788813455.549734:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908761eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583783552:0@lo:400:kworker.0 00000100:00100000:0.0:1788813455.549758:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813455.549782:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908761eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875706583783424:0@lo:400:kworker.0 00000100:00100000:0.0:1788813455.549805:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813455.550029:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788813455.550036:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908761eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583783296:0@lo:400:kworker.0 00000100:00100000:0.0:1788813455.550077:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813455.550095:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90874457b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583783808:0@lo:400:kworker.0 00000100:00100000:0.0:1788813455.550115:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813455.550126:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583783552 00000100:00100000:3.0:1788813455.550135:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583783552 00000100:00100000:3.0:1788813455.550191:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583783808 00000100:00100000:3.0:1788813455.550196:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583783808 00000100:00100000:1.0:1788813455.550232:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788813455.550250:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774058e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583783552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813455.550321:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774058e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583783552:12345-0@lo:400:kworker.0 Request processed in 80us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813455.550386:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908761eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583783552:0@lo:400:kworker.0 00000100:00100000:2.0:1788813455.552314:0:11247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583783168 00000100:00100000:2.0:1788813455.552342:0:11247:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583783168 00000100:00100000:2.0:1788813455.552411:0:11247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788813455.552421:0:11247:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3319:x1875706583783168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813455.552520:0:11247:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3319:x1875706583783168:12345-0@lo:400:kworker.0 Request processed in 101us (2946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813455.552528:0:11247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788813455.552569:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583783680 00000100:00100000:2.0:1788813455.552574:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583783680 00000100:00100000:2.0:1788813455.552659:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583783424 00000100:00100000:2.0:1788813455.552662:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583783424 00000100:00100000:2.0:1788813455.552675:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583783296 00000100:00100000:2.0:1788813455.552678:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583783296 00000100:00100000:2.0:1788813455.552691:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788813455.552697:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774059f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875706583783680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813455.552729:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774059f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875706583783680:12345-0@lo:400:kworker.0 Request processed in 33us (3028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813455.552735:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788813455.552747:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788813455.552753:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875706583783424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813455.552781:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875706583783424:12345-0@lo:400:kworker.0 Request processed in 29us (2976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813455.552787:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788813455.552798:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788813455.552804:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877405b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583783296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813455.552850:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877405b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583783296:12345-0@lo:400:kworker.0 Request processed in 46us (2771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813455.552856:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788813455.552913:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908761eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd1fd158-af17-4a1b-8f0b-82e57114d008:3319:1875706583783168:0@lo:400:kworker.0 00000100:00100000:2.0:1788813455.552928:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908761eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875706583783680:0@lo:400:kworker.0 00000100:00080000:2.0:1788813455.552981:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788813455.552987:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788813455.553238:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908761eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583783296:0@lo:400:kworker.0 00000100:00100000:0.0:1788813455.553250:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908761eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875706583783424:0@lo:400:kworker.0 00000100:00100000:3.0:1788813455.556676:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788813455.556701:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774059500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3321:x1875706583783808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813455.557121:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774059500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3321:x1875706583783808:12345-0@lo:400:kworker.0 Request processed in 432us (7003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813455.557139:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788813455.557691:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90874457b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583783808:0@lo:400:kworker.0 00000100:00100000:1.0:1788813455.557808:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788813456.061297:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813456.061317:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908744579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583783936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813456.061392:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813456.061463:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583783936 00000100:00100000:2.0:1788813456.061470:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583783936 00000100:00100000:2.0:1788813456.061527:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788813456.061537:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908744578380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1875706583783936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813456.061577:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813456.061651:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908744578380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1875706583783936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813456.061658:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788813456.061869:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908744579880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583783936:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788813456.062063:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788813456.594603:0:12129:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788813456.594614:0:12129:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788813456.594659:0:12129:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788813456.594665:0:12129:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788813456.810708:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813456.810767:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562802304 00000100:00100000:2.0:1788813456.810777:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562802304 00000100:00100000:2.0:1788813456.810834:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 133 00000100:00100000:2.0:1788813456.810844:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908744579f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+24:10578:x1875706562802304:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:2.0:1788813456.810865:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813456.810884:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb20bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483f90 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.810983:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb20c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.811018:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb20c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.811032:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb20c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813456.811045:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788813456.811205:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb20bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f90 expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.813680:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb20c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f90 expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.813696:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:2.0:1788813456.813699:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788813456.813703:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368c00, rc 0) 00000100:00100000:2.0:1788813456.813798:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908744579f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+26:10578:x1875706562802304:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 2954us (3100us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788813456.813806:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 133 00000100:00100000:1.0:1788813456.820099:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813456.824607:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562802432 00000100:00100000:2.0:1788813456.824624:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562802432 00000100:00100000:2.0:1788813456.824701:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 134 00000100:00100000:2.0:1788813456.824712:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+26:10578:x1875706562802432:12345-192.168.204.47@tcp:54:lfs.0 00010000:00010000:2.0:1788813456.824783:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb20d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.824802:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb20d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.824833:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb20d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.824862:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb20d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.824869:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb20d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.824875:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb20d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.824881:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369e00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813456.824885:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb20d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.824892:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb20d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.824904:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:2.0:1788813456.824907:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813456.824912:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb20d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813456.824918:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb20d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813456.825006:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+26:10578:x1875706562802432:12345-192.168.204.47@tcp:54:lfs.0 Request processed in 295us (4916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813456.825013:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 134 00000100:00100000:3.0:1788813456.924295:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813456.924410:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562802560 00000100:00100000:0.0:1788813456.924421:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562802560 00000100:00100000:0.0:1788813456.924484:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 46 00000100:00100000:0.0:1788813456.924494:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+6:2362:x1875706562802560:12345-192.168.204.47@tcp:101:cat.0 00010000:00010000:0.0:1788813456.924512:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813456.924533:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e619de5/0x6d74dbab2ddb20d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483f97 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788813456.924561:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f208d, atime: 0x6a9f208c, ctime: 0x6a9f208d, blocks: 0xb 00010000:00010000:0.0:1788813456.924621:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=399s v=(0 0) 00010000:00010000:0.0:1788813456.924627:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813456.924651:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e619de5/0x6d74dbab2ddb20d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f97 expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813456.924673:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e619de5/0x6d74dbab2ddb20d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f97 expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813456.924688:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9087413a0200, rc 0) 00000100:00100000:0.0:1788813456.924744:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+7:2362:x1875706562802560:12345-192.168.204.47@tcp:101:cat.0 Request processed in 252us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813456.924751:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 46 00000100:00100000:2.0:1788813456.942856:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813456.943027:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562802688 00000100:00100000:3.0:1788813456.943042:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562802688 00002000:00100000:3.0:1788813456.943295:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff90874457ad80 x1875706562802688/t0(0) o3->e90f6370-8c16-4659-9369-1cd146993b4c@192.168.204.47@tcp:272/0 lens 488/0 e 0 to 0 dl 1788813467 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788813456.943307:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90874457ad80 with x1875706562802688 ext(0->4095) 00002000:00010000:3.0:1788813456.943313:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90874457ad80 00000100:00100000:3.0:1788813456.943346:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 3 00000100:00100000:3.0:1788813456.943355:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874457ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e90f6370-8c16-4659-9369-1cd146993b4c+7:2361:x1875706562802688:12345-192.168.204.47@tcp:3:cat.0 00000100:00100000:0.0:1788813456.949728:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874457ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e90f6370-8c16-4659-9369-1cd146993b4c+7:2361:x1875706562802688:12345-192.168.204.47@tcp:3:cat.0 Request processed in 6361us (6870us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788813456.949743:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 3 00002000:00100000:0.0:1788813456.949759:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff90874457ad80 x1875706562802688/t0(0) o3->e90f6370-8c16-4659-9369-1cd146993b4c@192.168.204.47@tcp:272/0 lens 488/4536 e 0 to 0 dl 1788813467 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788813456.949769:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90874457ad80 with x1875706562802688 ext(0->4095) 00002000:00010000:0.0:1788813456.949777:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90874457ad80 00010000:00010000:1.0:1788813457.084975:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813458.109076:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788813458.694224:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:3.0:1788813458.694241:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1788813458.695501:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:2.0:1788813458.695539:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:2.0:1788813458.695556:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1788813458.695573:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff908742c820c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788813458.695600:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9087462c5400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90874afb90c0 00000020:00080000:2.0:1788813458.695603:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9087438a9c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff908775ceb800 00000020:00080000:1.0:1788813458.695827:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788813458.696261:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1788813459.132841:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813459.132965:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877bf1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583784064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813459.133038:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813459.136250:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583784064 00000100:00100000:2.0:1788813459.136264:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583784064 00000100:00100000:2.0:1788813459.136337:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788813459.136347:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877405aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583784064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813459.136397:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813459.136464:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877405aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583784064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (3426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813459.136471:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1788813459.136532:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813459.136638:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877bf1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583784064:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788813460.157560:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813460.365614:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813460.365674:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813460.365711:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813460.365745:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813460.365772:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813460.365803:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562803200 00000100:00100000:3.0:1788813460.365813:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562803200 00000100:00100000:3.0:1788813460.365870:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562803072 00000100:00100000:3.0:1788813460.365874:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562803072 00000100:00100000:3.0:1788813460.365897:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 82 00000100:00100000:3.0:1788813460.365907:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bf18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+6:2362:x1875706562803200:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:3.0:1788813460.365979:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bf18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+6:2362:x1875706562803200:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 73us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813460.365987:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 82 00000100:00100000:3.0:1788813460.366004:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 83 00000100:00100000:3.0:1788813460.366011:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bf19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+5:2361:x1875706562803072:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:3.0:1788813460.366055:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bf19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+5:2361:x1875706562803072:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 44us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813460.366062:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 83 00000100:00080000:3.0:1788813460.366079:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788813460.366082:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788813460.366304:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562802816 00000100:00100000:0.0:1788813460.366309:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562802816 00000100:00100000:0.0:1788813460.366341:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 289 00000100:00100000:0.0:1788813460.366348:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2361:x1875706562802816:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813460.366375:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2361:x1875706562802816:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 28us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813460.366387:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 289 00000100:00100000:2.0:1788813460.366475:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562802944 00000100:00100000:2.0:1788813460.366479:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562802944 00000100:00100000:2.0:1788813460.366521:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562803328 00000100:00100000:2.0:1788813460.366524:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562803328 00000100:00100000:2.0:1788813460.366544:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 145 00000100:00100000:2.0:1788813460.366551:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bf18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+13:2362:x1875706562802944:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813460.366607:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bf18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+13:2362:x1875706562802944:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 55us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813460.366613:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 145 00000100:00100000:2.0:1788813460.366627:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 146 00000100:00100000:2.0:1788813460.366634:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bf18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa21be5-2246-40d3-8e20-d34501daf545+5:2361:x1875706562803328:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813460.366683:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bf18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa21be5-2246-40d3-8e20-d34501daf545+5:2361:x1875706562803328:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 50us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813460.366689:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 146 00000100:00080000:0.0:1788813460.366967:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813460.668946:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908761eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583784576:0@lo:400:kworker.0 00000100:00100000:0.0:1788813460.669013:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813460.669082:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788813460.669088:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908774059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583784192:0@lo:400:kworker.0 00000100:00100000:0.0:1788813460.669126:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813460.669149:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908761eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875706583784704:0@lo:400:kworker.0 00000100:00100000:0.0:1788813460.669171:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813460.669194:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908761eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583784320:0@lo:400:kworker.0 00000100:00100000:0.0:1788813460.669214:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813460.669231:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908761eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583784832:0@lo:400:kworker.0 00000100:00100000:0.0:1788813460.669248:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813460.669262:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788813460.669266:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908761eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583784448:0@lo:400:kworker.0 00000100:00100000:0.0:1788813460.669284:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813460.669314:0:11247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583784192 00000100:00100000:0.0:1788813460.669322:0:11247:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583784192 00000100:00100000:0.0:1788813460.669363:0:11247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788813460.669384:0:11247:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3318:x1875706583784192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813460.669428:0:11247:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3318:x1875706583784192:12345-0@lo:400:kworker.0 Request processed in 56us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813460.669435:0:11247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788813460.669469:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583784704 00000100:00100000:0.0:1788813460.669474:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583784704 00000100:00100000:0.0:1788813460.669514:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583784320 00000100:00100000:0.0:1788813460.669517:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583784320 00000100:00100000:0.0:1788813460.669526:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583784448 00000100:00100000:0.0:1788813460.669528:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583784448 00000100:00100000:0.0:1788813460.669546:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788813460.669552:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875706583784704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813460.669565:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583784576 00000100:00100000:3.0:1788813460.669572:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583784576 00000100:00100000:0.0:1788813460.669610:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875706583784704:12345-0@lo:400:kworker.0 Request processed in 58us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813460.669617:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788813460.669626:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583784832 00000100:00100000:3.0:1788813460.669631:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583784832 00000100:00100000:0.0:1788813460.669635:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788813460.669642:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583784320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813460.669674:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788813460.669680:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583784320:12345-0@lo:400:kworker.0 Request processed in 36us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813460.669687:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583784576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813460.669691:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788813460.669710:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788813460.669718:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583784448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813460.669730:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583784576:12345-0@lo:400:kworker.0 Request processed in 46us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813460.669737:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788813460.669755:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788813460.669759:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583784448:12345-0@lo:400:kworker.0 Request processed in 40us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813460.669765:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583784832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813460.669771:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788813460.669797:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583784832:12345-0@lo:400:kworker.0 Request processed in 34us (547us total) trans 0 rc 0/0 00000100:00080000:0.0:1788813460.669799:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813460.669806:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1788813460.669806:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813460.669838:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908761eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583784448:0@lo:400:kworker.0 00000100:00100000:0.0:1788813460.669852:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908761eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583784320:0@lo:400:kworker.0 00000100:00100000:3.0:1788813460.669870:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908774059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583784192:0@lo:400:kworker.0 00000100:00100000:0.0:1788813460.669871:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1788813460.669879:0:3320:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1788813460.669889:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908761eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875706583784704:0@lo:400:kworker.0 00000100:00100000:3.0:1788813460.669899:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908761eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583784576:0@lo:400:kworker.0 00000100:00100000:0.0:1788813460.669904:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908761eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583784832:0@lo:400:kworker.0 00000100:00100000:3.0:1788813461.180893:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813461.180919:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877be7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583784960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813461.181005:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813461.181191:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583784960 00000100:00100000:0.0:1788813461.181199:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583784960 00000100:00100000:0.0:1788813461.181257:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788813461.181268:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bf1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583784960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788813461.181301:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813461.181349:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bf1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583784960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813461.181356:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788813461.181399:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877be7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583784960:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788813461.181511:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788813461.765930:0:11711:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788813461.765940:0:11711:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788813461.766446:0:11711:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788813461.766453:0:11711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788813462.205285:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813462.276666:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813462.276890:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562803456 00000100:00100000:0.0:1788813462.276900:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562803456 00000100:00100000:0.0:1788813462.276995:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 135 00000100:00100000:0.0:1788813462.277009:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bf18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+13:10231:x1875706562803456:12345-192.168.204.47@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788813462.277130:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bf18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+13:10231:x1875706562803456:12345-192.168.204.47@tcp:60:lhsmtool_posix.0 Request processed in 125us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813462.277138:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 135 00000100:00080000:2.0:1788813462.279808:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813462.287984:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813462.288191:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562803712 00000100:00100000:1.0:1788813462.288203:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562803712 00000100:00100000:1.0:1788813462.288263:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 35 00000100:00100000:1.0:1788813462.288274:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908744579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+13:10231:x1875706562803712:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788813462.288988:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908744579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+14:10231:x1875706562803712:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 Request processed in 712us (1011us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788813462.288998:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 35 00010000:00010000:1.0:1788813463.229894:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788813463.876037:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1788813463.876064:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788813463.876466:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788813463.876480:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1788813464.252814:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813464.261018:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813464.261052:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877bf19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583785088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813464.261124:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813464.261201:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583785088 00000100:00100000:3.0:1788813464.261210:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583785088 00000100:00080000:2.0:1788813464.261808:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813464.262563:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788813464.262612:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bf1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583785088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813464.262875:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813464.262959:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bf1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583785088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 355us (1833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813464.262967:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788813464.263083:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877bf19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583785088:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788813464.804385:0:12329:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 16:37:43 (1788813463) 00010000:00010000:1.0:1788813465.277117:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813465.486511:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813465.486721:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813465.486749:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813465.486861:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562804096 00000100:00100000:1.0:1788813465.486871:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562804096 00000100:00100000:1.0:1788813465.486939:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 86 00000100:00100000:1.0:1788813465.486952:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bf1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+5:2362:x1875706562804096:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813465.487060:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bf1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+5:2362:x1875706562804096:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 110us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813465.487067:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 86 00000100:00080000:1.0:1788813465.487101:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813465.487985:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813465.491256:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562803840 00000100:00100000:0.0:1788813465.491278:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562803840 00000100:00100000:0.0:1788813465.491364:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 291 00000100:00100000:0.0:1788813465.491377:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2362:x1875706562803840:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813465.491471:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2362:x1875706562803840:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 97us (4969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813465.491479:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 291 00000100:00100000:3.0:1788813465.492228:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813465.492577:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562804224 00000100:00100000:0.0:1788813465.492607:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562804224 00000100:00100000:0.0:1788813465.492653:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 87 00000100:00100000:0.0:1788813465.492662:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bf1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+6:2362:x1875706562804224:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813465.492718:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bf1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+6:2362:x1875706562804224:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 56us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813465.492725:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 87 00000100:00080000:3.0:1788813465.493226:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813465.494003:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562804352 00000100:00100000:2.0:1788813465.494015:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562804352 00000100:00080000:3.0:1788813465.494232:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813465.494345:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562803968 00000100:00100000:0.0:1788813465.494529:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 150 00000100:00100000:0.0:1788813465.494553:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bf19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa21be5-2246-40d3-8e20-d34501daf545+5:2362:x1875706562804352:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813465.494656:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bf19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa21be5-2246-40d3-8e20-d34501daf545+5:2362:x1875706562804352:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 118us (7906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813465.494663:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 150 00000100:00100000:2.0:1788813465.495345:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562803968 00000100:00100000:2.0:1788813465.495466:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 151 00000100:00100000:2.0:1788813465.495475:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bf19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+13:2362:x1875706562803968:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813465.495553:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bf19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+13:2362:x1875706562803968:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 70us (7572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813465.495560:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 151 00000100:00080000:3.0:1788813465.500892:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813465.792424:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fa55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583785600:0@lo:400:kworker.0 00000100:00100000:1.0:1788813465.792493:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813465.792556:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788813465.792562:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877be46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583785216:0@lo:400:kworker.0 00000100:00100000:1.0:1788813465.792695:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813465.792715:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773ca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875706583785728:0@lo:400:kworker.0 00000100:00100000:1.0:1788813465.792737:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813465.792759:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583785344:0@lo:400:kworker.0 00000100:00100000:1.0:1788813465.792780:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813465.792793:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773ca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583785856:0@lo:400:kworker.0 00000100:00100000:1.0:1788813465.792810:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813465.792828:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813465.792833:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fa54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583785472:0@lo:400:kworker.0 00000100:00100000:1.0:1788813465.792853:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813465.792886:0:11247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583785216 00000100:00100000:1.0:1788813465.792900:0:11247:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583785216 00000100:00100000:1.0:1788813465.792946:0:11247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788813465.792955:0:11247:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3318:x1875706583785216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813465.793098:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583785728 00000100:00100000:2.0:1788813465.793103:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583785728 00000100:00100000:2.0:1788813465.793137:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583785344 00000100:00100000:2.0:1788813465.793145:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583785344 00000100:00100000:2.0:1788813465.793159:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583785472 00000100:00100000:2.0:1788813465.793161:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583785472 00000100:00100000:2.0:1788813465.793173:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788813465.793180:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875706583785728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813465.793232:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875706583785728:12345-0@lo:400:kworker.0 Request processed in 52us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813465.793239:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788813465.793255:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788813465.793260:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583785344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813465.793291:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583785344:12345-0@lo:400:kworker.0 Request processed in 31us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813465.793297:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788813465.793306:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788813465.793312:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583785472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813465.793334:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583785472:12345-0@lo:400:kworker.0 Request processed in 23us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813465.793339:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788813465.793377:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583785600 00000100:00100000:2.0:1788813465.793381:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583785600 00000100:00100000:2.0:1788813465.793402:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583785856 00000100:00100000:2.0:1788813465.793405:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583785856 00000100:00100000:2.0:1788813465.793426:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788813465.793432:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583785600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813465.793461:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583785600:12345-0@lo:400:kworker.0 Request processed in 29us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813465.793467:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788813465.793486:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788813465.793492:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583785856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813465.793521:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583785856:12345-0@lo:400:kworker.0 Request processed in 29us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813465.793526:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788813465.793777:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773ca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875706583785728:0@lo:400:kworker.0 00000100:00100000:2.0:1788813465.793787:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fa55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583785600:0@lo:400:kworker.0 00000100:00100000:2.0:1788813465.793821:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fa54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583785472:0@lo:400:kworker.0 00000100:00100000:2.0:1788813465.793830:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583785344:0@lo:400:kworker.0 00000100:00100000:2.0:1788813465.793839:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773ca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583785856:0@lo:400:kworker.0 00000100:00080000:3.0:1788813465.794241:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788813465.794247:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813465.794362:0:11247:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3318:x1875706583785216:12345-0@lo:400:kworker.0 Request processed in 1406us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813465.794370:0:11247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788813465.796137:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877be46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583785216:0@lo:400:kworker.0 00010000:00010000:0.0:1788813466.301069:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813466.301135:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877be7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583785984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813466.301216:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813466.301487:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583785984 00000100:00100000:3.0:1788813466.301496:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583785984 00000100:00100000:3.0:1788813466.301572:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788813466.301603:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583785984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788813466.301652:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813466.301712:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583785984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813466.301734:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788813466.302104:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877be7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583785984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813466.439018:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813466.445680:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562804608 00000100:00100000:2.0:1788813466.445697:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562804608 00000100:00100000:2.0:1788813466.445770:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 136 00000100:00100000:2.0:1788813466.445781:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+13:11288:x1875706562804608:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813466.445803:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813466.445825:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb20de lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483f9e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813466.445899:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb20e5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813466.445912:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb20e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813466.445943:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb20e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813466.445960:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb20ec lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813466.445967:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb20ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813466.445973:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb20ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813466.447699:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb20f3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813466.447720:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb20f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813466.447730:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb20f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813466.447742:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788813466.447899:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb20e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813466.447906:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb20e5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813466.447913:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb20e5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813466.447919:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369e00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813466.447933:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb20e5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813466.447941:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb20e5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813466.447954:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff908746516400) 00010000:00010000:2.0:1788813466.447957:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813466.447962:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb20e5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813466.447968:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb20e5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813466.447980:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb20ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813466.447987:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb20ec lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813466.447992:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb20ec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813466.447997:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813466.448014:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb20ec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813466.448020:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb20ec lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813466.448027:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff908743ce0d00) 00010000:00010000:2.0:1788813466.448029:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813466.448038:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb20ec lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813466.448044:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb20ec lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813466.448438:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb20de lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f9e expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813466.448455:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb20f3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f9e expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813466.448462:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff908743ce0800) 00010000:00010000:2.0:1788813466.448465:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813466.448468:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369600, rc 0) 00000100:00100000:2.0:1788813466.448548:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+15:11288:x1875706562804608:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 2768us (9551us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1788813466.448557:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 136 00000100:00100000:2.0:1788813466.452893:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813466.455267:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813466.458511:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562804864 00000100:00100000:2.0:1788813466.458529:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562804864 00000100:00100000:2.0:1788813466.458654:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 9 00000100:00100000:2.0:1788813466.458665:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+15:2362:x1875706562804864:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813466.458681:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813466.458708:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb20f3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f9e expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813466.458726:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff908743ce0800) 00010000:00010000:2.0:1788813466.458743:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813466.458817:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+14:2362:x1875706562804864:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 154us (3558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813466.458825:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 9 00000100:00100000:0.0:1788813466.459492:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562804736 00000100:00100000:0.0:1788813466.459500:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562804736 00000100:00100000:0.0:1788813466.459663:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 137 00000100:00100000:0.0:1788813466.459673:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908744578a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+14:11288:x1875706562804736:12345-192.168.204.47@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788813466.459818:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908744578a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+14:11288:x1875706562804736:12345-192.168.204.47@tcp:59:lhsmtool_posix.0 Request processed in 147us (6934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813466.459825:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 137 00000040:00080000:1.0:1788813466.876823:0:11711:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788813466.876832:0:11711:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788813466.877316:0:11711:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788813466.877326:0:11711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788813467.324841:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813468.352630:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813468.495852:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813468.495936:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562804992 00000100:00100000:0.0:1788813468.495948:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562804992 00000100:00100000:0.0:1788813468.496034:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 138 00000100:00100000:0.0:1788813468.496046:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+14:11330:x1875706562804992:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:0.0:1788813468.496077:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813468.496111:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2101 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483fa5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.496177:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb2108 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.496191:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb2108 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.496203:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb2108 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.496218:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb210f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.496225:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb210f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.496232:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb210f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.496443:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb2108 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.496452:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb2108 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.496459:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb2108 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.496466:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a1600 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813468.496475:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb2108 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.496496:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb2108 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.496510:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908746516a00) 00010000:00010000:0.0:1788813468.496513:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813468.496519:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb2108 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.496525:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb2108 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.496538:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb210f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.496545:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb210f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.496551:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb210f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.496557:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a1c00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813468.496560:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb210f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.496566:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb210f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.496573:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90874a4cbd00) 00010000:00010000:0.0:1788813468.496576:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813468.496614:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb210f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.496621:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb210f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.496655:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2101 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fa5 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.496666:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908746516a00) 00010000:00010000:0.0:1788813468.496668:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813468.496671:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2101 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fa5 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.496681:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9087413a0800, rc 0) 00000100:00100000:0.0:1788813468.496745:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+14:11330:x1875706562804992:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 702us (903us total) trans 0 rc 301/301 00000100:00100000:0.0:1788813468.496753:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 138 00000100:00080000:2.0:1788813468.498747:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813468.514544:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813468.514976:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562805248 00000100:00100000:0.0:1788813468.514988:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562805248 00000100:00100000:0.0:1788813468.515050:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 139 00000100:00100000:0.0:1788813468.515062:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bf18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+14:11330:x1875706562805248:12345-192.168.204.47@tcp:36:lfs.0 00010000:00010000:0.0:1788813468.515132:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813468.515163:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb1a8d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483de5 expref: 14 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.515181:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908746516a00) 00010000:00010000:0.0:1788813468.515191:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813468.515424:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2116 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.515440:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2116 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.515451:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2116 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.515463:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb211d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.515469:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb211d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.515474:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb211d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813468.517512:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788813468.517537:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2116 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.517549:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2116 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.517558:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2116 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.517565:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a0800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813468.517570:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2116 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.517602:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2116 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.517629:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90874a4cbd00) 00010000:00010000:0.0:1788813468.517632:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813468.517638:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2116 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.517644:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2116 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813468.517665:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d4713b1 reply state 0000000066e241a5 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb211d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813468.517674:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788813468.517799:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bf18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+15:11330:x1875706562805248:12345-192.168.204.47@tcp:36:lfs.0 Request processed in 2735us (3263us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1788813468.517810:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 139 00010000:00010000:2.0:1788813468.533428:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb211d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813468.533446:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb211d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813468.533453:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb211d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813468.533460:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a1c00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813468.533465:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb211d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813468.533473:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb211d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813468.533490:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff90874a4cbe00) 00010000:00010000:2.0:1788813468.533494:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813468.533498:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb211d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813468.533505:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb211d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813468.659573:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813468.660034:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562805376 00000100:00100000:0.0:1788813468.660044:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562805376 00000100:00100000:0.0:1788813468.660106:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 140 00000100:00100000:0.0:1788813468.660115:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bf1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+14:11338:x1875706562805376:12345-192.168.204.47@tcp:101:lctl.0 00010000:00010000:0.0:1788813468.660139:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813468.660160:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2124 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483fac expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.660219:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb212b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.660233:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb212b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.660261:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb212b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813468.660300:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788813468.660304:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788813468.660326:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb212b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.660352:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2124 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fac expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.660369:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb212b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fac expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.660377:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90874a4cbd00) 00010000:00010000:0.0:1788813468.660379:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788813468.660382:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9087413a1600, rc 0) 00000100:00100000:0.0:1788813468.660497:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bf1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+15:11338:x1875706562805376:12345-192.168.204.47@tcp:101:lctl.0 Request processed in 381us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813468.660504:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 140 00000100:00100000:1.0:1788813468.758437:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813468.758572:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562805504 00000100:00100000:3.0:1788813468.758607:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562805504 00000100:00100000:3.0:1788813468.758674:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 141 00000100:00100000:3.0:1788813468.758686:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+15:11344:x1875706562805504:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:3.0:1788813468.758709:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813468.758731:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb2132 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483fb3 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.758807:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2139 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.758821:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2139 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.758834:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2139 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.758848:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb2140 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.758854:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb2140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.758860:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb2140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.758978:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb2147 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.758986:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb2147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.758992:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb2147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813468.759017:0:8269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788813468.759020:0:8269:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813468.759036:0:8269:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb2147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.759047:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2139 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.759052:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2139 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.759059:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2139 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.759064:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813468.759067:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2139 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.759074:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2139 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.759084:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90874a4cbd00) 00010000:00010000:3.0:1788813468.759092:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813468.759097:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2139 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.759104:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2139 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.759116:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb2140 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.759121:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb2140 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.759126:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb2140 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.759130:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813468.759133:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb2140 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.759138:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb2140 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.759143:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff908745aca900) 00010000:00010000:3.0:1788813468.759146:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813468.759148:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb2140 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.759153:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb2140 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.759182:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb2132 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fb3 expref: 17 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.759205:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb2147 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fb3 expref: 16 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.759212:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:3.0:1788813468.759214:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788813468.759216:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad1c00, rc 0) 00000100:00100000:3.0:1788813468.759295:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+16:11344:x1875706562805504:12345-192.168.204.47@tcp:101:bash.0 Request processed in 611us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813468.759302:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 141 00000100:00100000:3.0:1788813468.761708:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813468.761946:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562805760 00000100:00100000:0.0:1788813468.761966:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562805760 00000100:00100000:0.0:1788813468.762084:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 142 00000100:00100000:0.0:1788813468.762094:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bf1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+16:11344:x1875706562805760:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:0.0:1788813468.762116:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813468.762137:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb214e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483fba expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.762280:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2155 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.762296:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2155 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.762306:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2155 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.762364:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb215c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.762372:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb215c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.762379:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb215c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788813468.763200:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1788813468.763359:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb2163 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.763372:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb2163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.763381:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb2163 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.763414:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2155 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.763430:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2155 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.763436:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2155 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.763443:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a1c00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813468.763447:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2155 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.763454:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2155 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.763466:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:0.0:1788813468.763469:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813468.763474:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2155 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.763682:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2155 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813468.763699:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f09d166 reply state 00000000ce43597b transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb215c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813468.763708:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788813468.763818:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb214e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fba expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.763838:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb2163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fba expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.763858:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90874a4cb800) 00010000:00010000:0.0:1788813468.763861:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813468.763863:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740031000, rc 0) 00000100:00100000:0.0:1788813468.764006:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bf1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+19:11344:x1875706562805760:12345-192.168.204.47@tcp:101:bash.0 Request processed in 1912us (2306us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788813468.764015:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 142 00010000:00010000:3.0:1788813468.767527:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb215c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.767545:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb215c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.767553:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb215c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.767559:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a0400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813468.767564:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb215c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.767571:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb215c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.768014:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90874a4cb700) 00010000:00010000:3.0:1788813468.768018:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813468.768036:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb215c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.768043:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb215c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813468.768946:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813468.769030:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562805888 00000100:00100000:2.0:1788813468.769039:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562805888 00000100:00100000:2.0:1788813468.769123:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 47 00000100:00100000:2.0:1788813468.769133:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bf1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+5:2360:x1875706562805888:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:2.0:1788813468.769150:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813468.769169:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e983a1a/0x6d74dbab2ddb2171 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483fc1 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788813468.769194:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813468.769214:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=411s v=(0 0) 00010000:00010000:2.0:1788813468.769218:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813468.769227:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e983a1a/0x6d74dbab2ddb2171 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fc1 expref: 6 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813468.769245:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004e983a1a/0x6d74dbab2ddb2171 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fc1 expref: 6 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813468.769258:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368000, rc 0) 00000100:00100000:2.0:1788813468.769314:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bf1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+6:2360:x1875706562805888:12345-192.168.204.47@tcp:101:bash.0 Request processed in 183us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813468.769321:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 47 00000100:00080000:3.0:1788813468.769458:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813468.776123:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813468.776303:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562806016 00000100:00100000:0.0:1788813468.776313:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562806016 00000100:00100000:0.0:1788813468.776384:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 48 00000100:00100000:0.0:1788813468.776395:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908744579880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+6:11344:x1875706562806016:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:0.0:1788813468.776415:0:8270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813468.776437:0:8270:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007067039a/0x6d74dbab2ddb2178 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483fc8 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.776485:0:8270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004e983a1a/0x6d74dbab2ddb2171 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fc1 expref: 7 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.776494:0:8270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813468.776499:0:8270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813468.776504:0:8270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007067039a/0x6d74dbab2ddb2178 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fc8 expref: 7 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.776550:0:8270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004e983a1a/0x6d74dbab2ddb2171 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fc1 expref: 7 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.776626:0:8270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004e983a1a/0x6d74dbab2ddb2171 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fc1 expref: 7 pid: 6705 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813468.776642:0:8270:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877be7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8270:1875706583786112:192.168.204.47@tcp:104: 00000100:00100000:0.0:1788813468.776740:0:8270:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876ea79540 going to sleep for 11 seconds 00000100:00100000:2.0:1788813468.780488:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813468.780626:0:8270:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877be7ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8270:1875706583786112:192.168.204.47@tcp:104: 00010000:00010000:0.0:1788813468.780660:0:8270:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007067039a/0x6d74dbab2ddb2178 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fc8 expref: 7 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.780682:0:8270:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740031400, rc 0) 00000100:00100000:0.0:1788813468.780753:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908744579880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+7:11344:x1875706562806016:12345-192.168.204.47@tcp:101:bash.0 Request processed in 4351us (4633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813468.780762:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 48 00000100:00100000:3.0:1788813468.781069:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562806144 00000100:00100000:3.0:1788813468.781077:0:8477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562806144 00010000:00010000:3.0:1788813468.781114:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004e983a1a/0x6d74dbab2ddb2171 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fc1 expref: 7 pid: 6705 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813468.781154:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 60 00000100:00100000:3.0:1788813468.781164:0:8477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874457b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+7:2360:x1875706562806144:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813468.781177:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813468.781198:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004e983a1a/0x6d74dbab2ddb2171 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fc1 expref: 7 pid: 6705 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.781211:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004e983a1a/0x6d74dbab2ddb2171 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fc1 expref: 7 pid: 6705 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.781234:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e983a1a/0x6d74dbab2ddb2171 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fc1 expref: 7 pid: 6705 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.781250:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813468.781255:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813468.781263:0:8477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007067039a/0x6d74dbab2ddb2178 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fc8 expref: 6 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.781289:0:8477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007067039a/0x6d74dbab2ddb2178 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fc8 expref: 6 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813468.781323:0:8477:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007067039a/0x6d74dbab2ddb2178 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fc8 expref: 6 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813468.781336:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877bf19880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8477:1875706583786240:192.168.204.47@tcp:105: 00000100:00100000:3.0:1788813468.781400:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff908641365f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813468.784215:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877bf19880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8477:1875706583786240:192.168.204.47@tcp:105: 00010000:00010000:0.0:1788813468.784241:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813468.784299:0:8477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874457b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+6:2360:x1875706562806144:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 3135us (3827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813468.784309:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 60 00000100:00100000:2.0:1788813468.786102:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813468.786235:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562806400 00000100:00100000:1.0:1788813468.786245:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562806400 00000100:00100000:1.0:1788813468.786307:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 36 00000100:00100000:1.0:1788813468.786317:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+18:11344:x1875706562806400:12345-192.168.204.47@tcp:35:bash.0 00000100:00100000:1.0:1788813468.787288:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+19:11344:x1875706562806400:12345-192.168.204.47@tcp:35:bash.0 Request processed in 968us (1190us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788813468.787298:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 36 00000100:00100000:3.0:1788813468.881831:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813468.883106:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562806656 00000100:00100000:0.0:1788813468.883122:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562806656 00000100:00100000:0.0:1788813468.883206:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 143 00000100:00100000:0.0:1788813468.883218:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bf19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+19:11354:x1875706562806656:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:0.0:1788813468.883245:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813468.883283:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb217f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483fcf expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813468.883401:0:8269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788813468.883690:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb217f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fcf expref: 21 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.883704:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90874a4cbd00) 00010000:00010000:0.0:1788813468.883707:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788813468.883712:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb217f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fcf expref: 21 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.883724:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740030a00, rc 0) 00000100:00100000:0.0:1788813468.883795:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bf19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+20:11354:x1875706562806656:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 578us (2059us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1788813468.883802:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 143 00000100:00100000:1.0:1788813468.886751:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813468.886821:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562806912 00000100:00100000:0.0:1788813468.886832:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562806912 00000100:00100000:0.0:1788813468.886882:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 37 00000100:00100000:0.0:1788813468.886893:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+20:11354:x1875706562806912:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:0.0:1788813468.887227:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+21:11354:x1875706562806912:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 334us (483us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1788813468.887236:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 37 00000001:00080000:0.0:1788813468.902867:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000001:00080000:0.0:1788813468.902886:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967418 is committed 00000100:00100000:0.0:1788813468.968009:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813468.968187:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562807040 00000100:00100000:1.0:1788813468.968199:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562807040 00000100:00100000:1.0:1788813468.968280:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 144 00000100:00100000:1.0:1788813468.968291:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+17:11360:x1875706562807040:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:1.0:1788813468.968317:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813468.968339:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72400/0x6d74dbab2ddb218d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483fd6 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813468.968408:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb2194 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813468.968421:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb2194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813468.968432:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb2194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813468.968465:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788813468.968469:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813468.968499:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb2194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813468.968527:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72400/0x6d74dbab2ddb218d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fd6 expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813468.968547:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb2194 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fd6 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813468.968555:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:1.0:1788813468.968557:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813468.968561:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908749d72800, rc 0) 00000100:00100000:1.0:1788813468.968681:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+18:11360:x1875706562807040:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 391us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813468.968693:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 144 00000100:00100000:3.0:1788813468.976182:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813468.976448:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562807296 00000100:00100000:0.0:1788813468.976473:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562807296 00000100:00100000:0.0:1788813468.976547:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 145 00000100:00100000:0.0:1788813468.976556:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bf19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+18:11360:x1875706562807296:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:0.0:1788813468.976606:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813468.976628:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb219b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483fdd expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.976730:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb21a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.976986:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb21a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.977002:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb21a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813468.977017:0:8269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788813468.977182:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb219b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fdd expref: 21 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.977206:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb21a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fdd expref: 20 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813468.977215:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90874a4cb800) 00010000:00010000:0.0:1788813468.977217:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813468.977221:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9087413a1c00, rc 0) 00000100:00100000:0.0:1788813468.977297:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bf19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+20:11360:x1875706562807296:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 741us (1125us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1788813468.977305:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 145 00000100:00100000:3.0:1788813468.980275:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813468.981015:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562807424 00000100:00100000:2.0:1788813468.981027:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562807424 00000100:00100000:2.0:1788813468.981103:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 10 00000100:00100000:2.0:1788813468.981113:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bf1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+20:2361:x1875706562807424:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813468.981147:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813468.981172:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb21a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fdd expref: 20 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813468.981193:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90874a4cb800) 00010000:00010000:2.0:1788813468.981198:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813468.981261:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bf1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+19:2361:x1875706562807424:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 149us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813468.981268:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 10 00000100:00100000:2.0:1788813468.984533:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813468.984637:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562807680 00000100:00100000:1.0:1788813468.984647:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562807680 00000100:00100000:1.0:1788813468.984703:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 146 00000100:00100000:1.0:1788813468.984714:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+19:11360:x1875706562807680:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:1.0:1788813468.984748:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813468.984768:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72400/0x6d74dbab2ddb21b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483fe4 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813468.984875:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72000/0x6d74dbab2ddb21b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813468.984905:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72000/0x6d74dbab2ddb21b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813468.984918:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72000/0x6d74dbab2ddb21b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813468.984932:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788813468.985078:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72400/0x6d74dbab2ddb21b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fe4 expref: 22 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813468.985098:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72000/0x6d74dbab2ddb21b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fe4 expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813468.985107:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90874a4cb800) 00010000:00010000:1.0:1788813468.985110:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788813468.985114:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908749d72000, rc 0) 00000100:00100000:1.0:1788813468.985202:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+21:11360:x1875706562807680:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 490us (679us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1788813468.985210:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 146 00000100:00100000:3.0:1788813469.004827:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813469.009322:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562807808 00000100:00100000:2.0:1788813469.009342:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562807808 00000100:00100000:3.0:1788813469.010359:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 49 00000100:00100000:3.0:1788813469.010377:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+6:2359:x1875706562807808:12345-192.168.204.47@tcp:1:lfs.0 00010000:00010000:3.0:1788813469.010428:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a579d66/0x6d74dbab2ddb21c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.010451:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007067039a/0x6d74dbab2ddb2178 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fc8 expref: 6 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.010461:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813469.010465:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788813469.010469:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a579d66/0x6d74dbab2ddb21c5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.010892:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007067039a/0x6d74dbab2ddb2178 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fc8 expref: 6 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.010908:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007067039a/0x6d74dbab2ddb2178 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fc8 expref: 6 pid: 8270 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813469.010924:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908761eb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1875706583786368:192.168.204.47@tcp:104: 00000100:00100000:3.0:1788813469.011045:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff908760309600 going to sleep for 11 seconds 00000100:00100000:1.0:1788813469.013408:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908761eb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1875706583786368:192.168.204.47@tcp:104: 00010000:00010000:1.0:1788813469.013437:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004a579d66/0x6d74dbab2ddb21c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813469.013702:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813469.013781:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562807936 00000100:00100000:1.0:1788813469.013789:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562807936 00002000:00100000:1.0:1788813469.013838:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff908761eb6680 x1875706562807936/t0(0) o4->e90f6370-8c16-4659-9369-1cd146993b4c@192.168.204.47@tcp:285/0 lens 504/0 e 0 to 0 dl 1788813480 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788813469.013847:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff908761eb6680 with x1875706562807936 ext(0->12) 00010000:00010000:1.0:1788813469.013855:0:6712:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007067039a/0x6d74dbab2ddb2178 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fc8 expref: 7 pid: 8270 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813469.013869:0:6712:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007067039a/0x6d74dbab2ddb2178 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fc8 expref: 7 pid: 8270 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788813469.013889:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff908761eb6680 00000100:00100000:1.0:1788813469.013919:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 2 00000100:00100000:1.0:1788813469.013929:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e90f6370-8c16-4659-9369-1cd146993b4c+7:2360:x1875706562807936:12345-192.168.204.47@tcp:4:lfs.0 00000100:00100000:1.0:1788813469.014509:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e90f6370-8c16-4659-9369-1cd146993b4c+9:2360:x1875706562807936:12345-192.168.204.47@tcp:4:lfs.0 Request processed in 579us (806us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788813469.014518:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 2 00002000:00100000:1.0:1788813469.014527:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff908761eb6680 x1875706562807936/t4294967305(0) o4->e90f6370-8c16-4659-9369-1cd146993b4c@192.168.204.47@tcp:285/0 lens 504/448 e 0 to 0 dl 1788813480 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788813469.014541:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff908761eb6680 with x1875706562807936 ext(0->12) 00010000:00010000:1.0:1788813469.014548:0:6712:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007067039a/0x6d74dbab2ddb2178 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fc8 expref: 9 pid: 8270 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813469.014561:0:6712:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007067039a/0x6d74dbab2ddb2178 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fc8 expref: 9 pid: 8270 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788813469.014569:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff908761eb6680 00000100:00100000:3.0:1788813469.021688:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813469.021967:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562808064 00000100:00100000:1.0:1788813469.021977:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562808064 00010000:00010000:1.0:1788813469.022025:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007067039a/0x6d74dbab2ddb2178 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fc8 expref: 9 pid: 8270 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813469.022120:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 61 00000100:00100000:1.0:1788813469.022132:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+9:2359:x1875706562808064:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813469.022148:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788813469.022168:0:5835:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788813469.022172:0:5835:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788813469 00002000:00010000:1.0:1788813469.022174:0:5835:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788813469 00002000:00010000:1.0:1788813469.022176:0:5835:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788813469 00010000:00010000:1.0:1788813469.022182:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007067039a/0x6d74dbab2ddb2178 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fc8 expref: 9 pid: 8270 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813469.022196:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007067039a/0x6d74dbab2ddb2178 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fc8 expref: 9 pid: 8270 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813469.022241:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007067039a/0x6d74dbab2ddb2178 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fc8 expref: 9 pid: 8270 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813469.022259:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788813469.022263:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788813469.022269:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004a579d66/0x6d74dbab2ddb21c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813469.022279:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a579d66/0x6d74dbab2ddb21c5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813469.022320:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813469.022387:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+8:2359:x1875706562808064:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 257us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813469.022395:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 61 00010000:00010000:3.0:1788813469.025342:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004a579d66/0x6d74dbab2ddb21c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.025364:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a579d66/0x6d74dbab2ddb21c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.025403:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a579d66/0x6d74dbab2ddb21c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.025412:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a579d66/0x6d74dbab2ddb21c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.025421:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a579d66/0x6d74dbab2ddb21c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.025450:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1200 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:3.0:1788813469.025455:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a579d66/0x6d74dbab2ddb21c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.025464:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a579d66/0x6d74dbab2ddb21c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.025486:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a579d66/0x6d74dbab2ddb21c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.025494:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a579d66/0x6d74dbab2ddb21c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813469.025651:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+7:2359:x1875706562807808:12345-192.168.204.47@tcp:1:lfs.0 Request processed in 15277us (20831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813469.025661:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 49 00000100:00100000:3.0:1788813469.029354:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813469.029883:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562808320 00000100:00100000:0.0:1788813469.029893:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562808320 00000100:00100000:0.0:1788813469.030002:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 38 00000100:00100000:0.0:1788813469.030013:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874ada9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+21:11360:x1875706562808320:12345-192.168.204.47@tcp:35:lfs.0 00000004:00010000:0.0:1788813469.030083:0:5852:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72000/0x6d74dbab2ddb21b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fe4 expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788813469.030384:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1788813469.030437:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1788813469.031982:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1788813469.032075:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb21cc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.032153:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb2163 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fba expref: 25 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.032162:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb21cc lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.032201:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb2163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fba expref: 25 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.032218:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb2163 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fba expref: 25 pid: 5851 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813469.032233:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb73800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5852:1875706583786496:192.168.204.47@tcp:104: 00000100:00100000:0.0:1788813469.032392:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876ea79900 going to sleep for 11 seconds 00000100:00100000:0.0:1788813469.040529:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813469.040663:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562808448 00000100:00100000:3.0:1788813469.040673:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562808448 00010000:00010000:3.0:1788813469.040717:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb2163 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fba expref: 26 pid: 5851 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813469.040767:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 62 00000100:00100000:3.0:1788813469.040777:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e877100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+26:2360:x1875706562808448:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813469.040792:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813469.040806:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb2163 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fba expref: 26 pid: 5851 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.040821:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb2163 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fba expref: 26 pid: 5851 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.040844:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90874a4cb800) 00010000:00010000:3.0:1788813469.040850:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb21cc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.040860:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb21cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.040869:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb21cc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.040889:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813469.040941:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e877100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+26:2360:x1875706562808448:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 165us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813469.040958:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 62 00010000:00010000:1.0:1788813469.041461:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb2163 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fba expref: 25 pid: 5851 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813469.041488:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb73800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5852:1875706583786496:192.168.204.47@tcp:104: 00010000:00010000:1.0:1788813469.041511:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb21cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813469.041520:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb21cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813469.041526:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb21cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788813469.041687:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788813469.042051:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1788813469.042176:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773ca2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1875706583786624:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788813469.042242:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813469.042280:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087480f5900 going to sleep for 11 seconds 00000100:00100000:3.0:1788813469.043219:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583786624 00000100:00100000:3.0:1788813469.043230:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583786624 00000100:00100000:3.0:1788813469.043305:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788813469.043315:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5852:x1875706583786624:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788813469.043436:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5852:x1875706583786624:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 122us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813469.043443:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788813469.043506:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773ca2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1875706583786624:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1788813469.043905:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788813469.044254:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1788813469.044348:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908761eb7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1875706583786752:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788813469.044402:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813469.044440:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff908760309600 going to sleep for 11 seconds 00000100:00100000:1.0:1788813469.044613:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583786752 00000100:00100000:1.0:1788813469.044621:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583786752 00000100:00100000:1.0:1788813469.044655:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788813469.044664:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875706583786752:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788813469.044852:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5852:x1875706583786752:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 188us (449us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788813469.044860:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788813469.045237:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908761eb7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1875706583786752:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788813469.045305:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1788813469.045344:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb21cc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.045355:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb21cc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.045362:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb21cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.045369:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a0800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813469.045373:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb21cc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.045382:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb21cc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.045400:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90874a4cb800) 00010000:00010000:3.0:1788813469.045403:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788813469.045409:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb21cc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.045415:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb21cc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788813469.045934:0:5852:0:(mdd_object.c:4181:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788813469.046056:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1788813469.046079:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 411288498728ns, next at 412288496446ns, rc = 0 00000001:00080000:3.0:1788813469.046087:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1788813469.046122:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90874a4cb800) 00010000:00010000:3.0:1788813469.046126:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788813469.046133:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72000/0x6d74dbab2ddb21b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fe4 expref: 29 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813469.046237:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874ada9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+28:11360:x1875706562808320:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 16226us (16892us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1788813469.046246:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 38 00000020:00080000:3.0:1788813469.046251:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788813469.048796:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813469.048968:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562808576 00000100:00100000:3.0:1788813469.048979:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562808576 00000100:00100000:3.0:1788813469.049030:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 147 00000100:00100000:3.0:1788813469.049040:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+28:11360:x1875706562808576:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:3.0:1788813469.049066:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813469.049088:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb21d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483feb expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.049150:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb21d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483feb expref: 29 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.049165:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb21d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483feb expref: 29 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.049186:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca900) 00010000:00010000:3.0:1788813469.049189:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813469.049193:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908750ad1200, rc 0) 00000100:00100000:3.0:1788813469.049271:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+29:11360:x1875706562808576:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 233us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813469.049279:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 147 00000100:00100000:0.0:1788813469.052496:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813469.052654:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562808832 00000100:00100000:1.0:1788813469.052664:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562808832 00000100:00100000:1.0:1788813469.052722:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 39 00000100:00100000:1.0:1788813469.052732:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+29:11360:x1875706562808832:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:1.0:1788813469.053013:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+30:11360:x1875706562808832:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 281us (539us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1788813469.053021:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 39 00000100:00100000:1.0:1788813469.147623:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813469.147732:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562809088 00000100:00100000:2.0:1788813469.147753:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562809088 00000100:00100000:2.0:1788813469.147806:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 148 00000100:00100000:2.0:1788813469.147817:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+30:11370:x1875706562809088:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:2.0:1788813469.147842:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813469.147864:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb21da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483ff2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813469.147964:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788813469.148080:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb21da lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ff2 expref: 32 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.148094:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90874a4cbd00) 00010000:00010000:2.0:1788813469.148097:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813469.148102:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb21da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ff2 expref: 32 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.148131:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369400, rc 0) 00000100:00100000:2.0:1788813469.148200:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+31:11370:x1875706562809088:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 384us (630us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788813469.148208:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 148 00000100:00100000:0.0:1788813469.151355:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813469.151453:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562809216 00000100:00100000:3.0:1788813469.151462:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562809216 00000100:00100000:3.0:1788813469.151525:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 149 00000100:00100000:3.0:1788813469.151535:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+31:11370:x1875706562809216:12345-192.168.204.47@tcp:34:lfs.0 00010000:00010000:0.0:1788813469.152294:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb21e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.152315:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb21e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.152328:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb21e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.152344:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb21ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.152351:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb21ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.152357:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb21ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.152903:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb21f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.152915:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb21f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.152923:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb21f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813469.152982:0:8269:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb21f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.152996:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb21e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.153011:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb21e8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.153017:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb21e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.153023:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a0400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813469.153028:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb21e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.153035:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb21e8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.153047:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:0.0:1788813469.153050:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813469.153056:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb21e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.153062:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb21e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.153076:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb21ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.153082:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb21ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.153087:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb21ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.153235:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a0800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813469.153244:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb21ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.153250:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb21ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.153259:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90874a4cbb00) 00010000:00010000:0.0:1788813469.153261:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813469.153264:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb21ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.153270:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb21ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.153285:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb21f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.153290:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb21f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.153296:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb21f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.153301:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a1c00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813469.153304:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb21f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.153310:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb21f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.153318:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca900) 00010000:00010000:0.0:1788813469.153320:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813469.153329:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb21f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.153335:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb21f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813469.153686:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+31:11370:x1875706562809216:12345-192.168.204.47@tcp:34:lfs.0 Request processed in 2147us (2335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813469.153697:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 149 00000100:00100000:1.0:1788813469.157716:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813469.157889:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562809472 00000100:00100000:2.0:1788813469.157900:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562809472 00000100:00100000:2.0:1788813469.158006:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 40 00000100:00100000:2.0:1788813469.158017:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+31:11370:x1875706562809472:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:2.0:1788813469.158281:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+32:11370:x1875706562809472:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 265us (575us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788813469.158289:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 40 00000100:00100000:1.0:1788813469.199725:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813469.199919:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562809728 00000100:00100000:2.0:1788813469.199930:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562809728 00000100:00100000:2.0:1788813469.199998:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 150 00000100:00100000:2.0:1788813469.200008:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+32:11373:x1875706562809728:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:2.0:1788813469.200035:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813469.200056:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb21fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e483ff9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.200150:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2204 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.200165:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2204 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.200177:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2204 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.200206:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb220b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.200214:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb220b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.200221:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb220b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.200963:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2212 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.200977:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.200986:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2212 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813469.200997:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788813469.201254:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2204 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.201263:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2204 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.201270:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2204 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.201276:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369e00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813469.201281:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2204 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.201303:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2204 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.201315:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:2.0:1788813469.201318:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813469.201323:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2204 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.201330:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2204 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.201343:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb220b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.201349:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb220b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.201355:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb220b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.201360:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813469.201363:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb220b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.201369:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb220b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.201376:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff908743ce0b00) 00010000:00010000:2.0:1788813469.201379:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813469.201381:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb220b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.201397:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb220b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.201443:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb21fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ff9 expref: 35 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.201456:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2212 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ff9 expref: 34 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.201463:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca900) 00010000:00010000:2.0:1788813469.201465:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813469.201467:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369a00, rc 0) 00000100:00100000:2.0:1788813469.202625:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+34:11373:x1875706562809728:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 2611us (2904us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788813469.202636:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 150 00000100:00100000:0.0:1788813469.207928:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813469.208107:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562809856 00000100:00100000:1.0:1788813469.208119:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562809856 00000100:00100000:1.0:1788813469.208178:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 151 00000100:00100000:1.0:1788813469.208190:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+34:11373:x1875706562809856:12345-192.168.204.47@tcp:54:lfs.0 00010000:00010000:1.0:1788813469.208287:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb2220 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813469.208306:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb2220 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813469.208319:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb2220 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813469.208347:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb2220 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813469.208354:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb2220 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813469.208361:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb2220 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813469.208367:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73c00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813469.208372:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb2220 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813469.208380:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb2220 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813469.208392:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca900) 00010000:00010000:1.0:1788813469.208395:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788813469.208400:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb2220 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813469.208407:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb2220 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813469.208495:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+34:11373:x1875706562809856:12345-192.168.204.47@tcp:54:lfs.0 Request processed in 307us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813469.208503:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 151 00000100:00100000:1.0:1788813469.212032:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813469.212183:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562810112 00000100:00100000:3.0:1788813469.212195:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562810112 00000100:00100000:3.0:1788813469.212256:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 41 00000100:00100000:3.0:1788813469.212268:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+34:11373:x1875706562810112:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:3.0:1788813469.212507:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+35:11373:x1875706562810112:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 240us (485us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788813469.212515:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 41 00000100:00100000:2.0:1788813469.373728:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908744579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583786880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813469.373832:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813469.375073:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583786880 00000100:00100000:0.0:1788813469.375086:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583786880 00000100:00100000:0.0:1788813469.375154:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788813469.375165:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877408cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1875706583786880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813469.375191:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00010000:00010000:1.0:1788813469.382967:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813469.386379:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877408cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1875706583786880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11203us (12533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813469.386397:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788813469.387005:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908744579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583786880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813469.542079:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813469.542185:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562810368 00000100:00100000:0.0:1788813469.542195:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562810368 00000100:00100000:0.0:1788813469.542284:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 152 00000100:00100000:0.0:1788813469.542294:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+35:11404:x1875706562810368:12345-192.168.204.47@tcp:101:cat.0 00010000:00010000:0.0:1788813469.542319:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813469.542341:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2227 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484000 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.542454:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb222e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.542497:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb222e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.542509:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb222e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813469.542523:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788813469.542705:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2227 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484000 expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.542722:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb222e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484000 expref: 37 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.542730:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca900) 00010000:00010000:0.0:1788813469.542733:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813469.542737:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740031400, rc 0) 00000100:00100000:0.0:1788813469.542804:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+37:11404:x1875706562810368:12345-192.168.204.47@tcp:101:cat.0 Request processed in 511us (736us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788813469.542811:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 152 00000100:00100000:0.0:1788813469.548307:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813469.548400:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813469.548504:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562810752 00000100:00100000:1.0:1788813469.548516:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562810752 00000100:00100000:1.0:1788813469.548652:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 42 00000100:00100000:1.0:1788813469.548663:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+37:11404:x1875706562810752:12345-192.168.204.47@tcp:35:cat.0 00000100:00100000:1.0:1788813469.549132:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+38:11404:x1875706562810752:12345-192.168.204.47@tcp:35:cat.0 Request processed in 469us (729us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1788813469.549141:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 42 00000100:00100000:3.0:1788813469.549446:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562810496 00000100:00100000:3.0:1788813469.549454:0:8477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562810496 00000100:00100000:3.0:1788813469.549616:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 11 00000100:00100000:3.0:1788813469.549626:0:8477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e874380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+38:2359:x1875706562810496:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813469.549639:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813469.549664:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb222e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484000 expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.549684:0:8477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca900) 00010000:00010000:3.0:1788813469.549690:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813469.549716:0:8477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e874380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+37:2359:x1875706562810496:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 93us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813469.549743:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 11 00000100:00100000:1.0:1788813469.624246:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813469.624343:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562811008 00000100:00100000:0.0:1788813469.624355:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562811008 00000100:00100000:0.0:1788813469.624428:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 153 00000100:00100000:0.0:1788813469.624438:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+37:11411:x1875706562811008:12345-192.168.204.47@tcp:101:dd.0 00010000:00010000:0.0:1788813469.624464:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813469.624479:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788813469.624525:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72800/0x6d74dbab2ddb2194 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fd6 expref: 37 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.624546:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:0.0:1788813469.624551:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813469.624565:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb223c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484007 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.624725:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2243 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.624739:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2212 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ff9 expref: 37 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.624749:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2243 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.624784:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2212 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ff9 expref: 37 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813469.624798:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2212 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ff9 expref: 37 pid: 5850 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813469.624812:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e875f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1875706583787008:192.168.204.47@tcp:104: 00000100:00100000:0.0:1788813469.624916:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876ea79b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788813469.627917:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e875f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1875706583787008:192.168.204.47@tcp:104: 00010000:00010000:1.0:1788813469.627957:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2243 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813469.630385:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813469.630615:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562811136 00000100:00100000:3.0:1788813469.630625:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562811136 00010000:00010000:3.0:1788813469.630663:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2212 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ff9 expref: 38 pid: 5850 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813469.630706:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 63 00000100:00100000:3.0:1788813469.630716:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+38:2360:x1875706562811136:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813469.630734:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813469.630741:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2212 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ff9 expref: 38 pid: 5850 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.630753:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2212 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ff9 expref: 38 pid: 5850 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.630775:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2212 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ff9 expref: 38 pid: 5850 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.630790:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca900) 00010000:00010000:3.0:1788813469.630796:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2243 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.630805:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2243 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.630812:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2243 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813469.630863:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813469.630947:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+37:2360:x1875706562811136:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 223us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813469.630955:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 63 00010000:00010000:1.0:1788813469.632115:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2243 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813469.632129:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2243 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813469.632153:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788813469.632336:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb223c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484007 expref: 38 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813469.632375:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2243 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484007 expref: 37 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813469.632384:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca900) 00010000:00010000:1.0:1788813469.632387:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788813469.632391:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740030a00, rc 0) 00000100:00100000:1.0:1788813469.632470:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+37:11411:x1875706562811008:12345-192.168.204.47@tcp:101:dd.0 Request processed in 8018us (8218us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1788813469.632479:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 153 00000100:00100000:1.0:1788813469.640924:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813469.641085:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562811392 00000100:00100000:2.0:1788813469.641107:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562811392 00000100:00100000:2.0:1788813469.641157:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 154 00000100:00100000:2.0:1788813469.641167:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+37:11411:x1875706562811392:12345-192.168.204.47@tcp:36:dd.0 00010000:00010000:2.0:1788813469.641454:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2251 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.641500:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2251 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.641511:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2251 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788813469.641566:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1788813469.641625:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f65e4b46 reply state 00000000cf7d2722 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2251 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813469.641634:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788813469.641741:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+40:11411:x1875706562811392:12345-192.168.204.47@tcp:36:dd.0 Request processed in 574us (827us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788813469.641748:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 154 00000020:00080000:2.0:1788813469.641753:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788813469.646113:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2251 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.646133:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2251 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.646141:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2251 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.646147:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369e00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813469.646152:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2251 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.646160:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2251 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.646196:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca900) 00010000:00010000:2.0:1788813469.646198:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813469.646204:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2251 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813469.646211:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2251 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813470.023755:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813470.023866:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562811520 00000100:00100000:2.0:1788813470.023876:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562811520 00000100:00100000:2.0:1788813470.023972:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 155 00000100:00100000:2.0:1788813470.023983:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+39:11425:x1875706562811520:12345-192.168.204.47@tcp:101:stat.0 00010000:00010000:2.0:1788813470.024008:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813470.024028:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2258 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e48400e expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.024095:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb225f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.024111:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb225f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.024124:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb225f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.024138:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2266 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.024145:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.024170:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.024407:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb226d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.024418:0:8269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2243 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484007 expref: 40 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.024425:0:8269:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb226d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.024472:0:8269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2243 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484007 expref: 40 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.024486:0:8269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2243 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484007 expref: 40 pid: 5849 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813470.024499:0:8269:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8269:1875706583787136:192.168.204.47@tcp:104: 00000100:00100000:2.0:1788813470.024641:0:8269:0:(client.c:2716:ptlrpc_set_wait()) set ffff908641365f00 going to sleep for 11 seconds 00000100:00080000:0.0:1788813470.024785:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813470.028291:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813470.028739:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562811776 00000100:00100000:1.0:1788813470.028750:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562811776 00000100:00100000:1.0:1788813470.028821:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 43 00000100:00100000:1.0:1788813470.028833:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+41:5600:x1875706562811776:12345-192.168.204.47@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788813470.029186:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+42:5600:x1875706562811776:12345-192.168.204.47@tcp:35:ldlm_bl.0 Request processed in 354us (905us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1788813470.029193:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 43 00000100:00100000:2.0:1788813470.030506:0:8269:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8269:1875706583787136:192.168.204.47@tcp:104: 00010000:00010000:2.0:1788813470.030535:0:8269:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb226d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813470.031673:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813470.031904:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562811904 00000100:00100000:0.0:1788813470.031913:0:8477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562811904 00010000:00010000:0.0:1788813470.031984:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2243 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484007 expref: 42 pid: 5849 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813470.032026:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 64 00000100:00100000:0.0:1788813470.032035:0:8477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600e1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+42:2360:x1875706562811904:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813470.032051:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813470.032058:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2243 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484007 expref: 42 pid: 5849 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.032073:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2243 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484007 expref: 42 pid: 5849 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.032096:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2243 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484007 expref: 42 pid: 5849 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.032112:0:8477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca900) 00010000:00010000:0.0:1788813470.032118:0:8477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb226d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.032128:0:8477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb226d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.032136:0:8477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb226d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.032170:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813470.032362:0:8477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600e1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+41:2360:x1875706562811904:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 327us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813470.032370:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 64 00010000:00010000:2.0:1788813470.033035:0:8269:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb226d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.033046:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb226d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813470.033106:0:8269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788813470.033109:0:8269:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788813470.033135:0:8269:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb226d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.033149:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb226d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.033159:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb225f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.033165:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb225f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.033171:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb225f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.033176:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813470.033180:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb225f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.033187:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb225f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.033198:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:2.0:1788813470.033201:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813470.033204:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb225f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.033209:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb225f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.033380:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.033386:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2266 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.033392:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2266 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.033398:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369600 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813470.033401:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2266 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.033407:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2266 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.033414:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff908743ce0b00) 00010000:00010000:2.0:1788813470.033417:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813470.033420:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2266 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.033510:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2266 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.033553:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2258 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48400e expref: 41 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.033568:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb226d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48400e expref: 40 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.033630:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca900) 00010000:00010000:2.0:1788813470.033632:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813470.033635:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368e00, rc 0) 00000100:00100000:2.0:1788813470.033686:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+40:11425:x1875706562811520:12345-192.168.204.47@tcp:101:stat.0 Request processed in 9705us (9942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813470.033694:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 155 00000100:00100000:3.0:1788813470.112346:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813470.112471:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562812160 00000100:00100000:2.0:1788813470.112481:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562812160 00000100:00100000:2.0:1788813470.112546:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 156 00000100:00100000:2.0:1788813470.112555:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874457b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+40:11431:x1875706562812160:12345-192.168.204.47@tcp:36:truncate.0 00010000:00010000:2.0:1788813470.112639:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813470.112680:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb226d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48400e expref: 40 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.112703:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca900) 00010000:00010000:2.0:1788813470.112708:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813470.113157:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2274 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.113171:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2274 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.113182:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2274 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788813470.113237:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788813470.113263:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c709ab5 reply state 00000000c3dea85f transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2274 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813470.113285:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788813470.113379:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874457b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+42:11431:x1875706562812160:12345-192.168.204.47@tcp:36:truncate.0 Request processed in 823us (1042us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788813470.113386:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 156 00000020:00080000:2.0:1788813470.113390:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788813470.116870:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2274 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.116887:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2274 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.116894:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2274 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.116901:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369e00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813470.116906:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2274 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.116914:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2274 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.116947:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca900) 00010000:00010000:3.0:1788813470.116951:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813470.116956:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2274 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.116963:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2274 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813470.333196:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813470.333654:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562812288 00000100:00100000:0.0:1788813470.333667:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562812288 00000100:00100000:0.0:1788813470.333742:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 157 00000100:00100000:0.0:1788813470.333753:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874457b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+41:11445:x1875706562812288:12345-192.168.204.47@tcp:101:stat.0 00010000:00010000:0.0:1788813470.333778:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813470.333799:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb227b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484015 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.333877:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb2282 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.333891:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb2282 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.333902:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb2282 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.333916:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb2289 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.333935:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb2289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.333942:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb2289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.334165:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2290 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.334175:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.334194:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813470.334246:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788813470.334250:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788813470.334274:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.334287:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.334295:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb2282 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.334301:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb2282 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.334308:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb2282 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.334314:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813470.334318:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb2282 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.334326:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb2282 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.334338:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:0.0:1788813470.334341:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813470.334346:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb2282 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.334362:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb2282 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.334376:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb2289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.334381:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb2289 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.334387:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb2289 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.334392:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813470.334395:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb2289 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.334401:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb2289 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.334408:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90874a4cbb00) 00010000:00010000:0.0:1788813470.334411:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813470.334414:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb2289 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.334420:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031000/0x6d74dbab2ddb2289 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.334453:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb227b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484015 expref: 43 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.334480:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2290 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484015 expref: 42 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.334493:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca900) 00010000:00010000:0.0:1788813470.334495:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813470.334498:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9087413a1c00, rc 0) 00000100:00100000:0.0:1788813470.334566:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874457b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+42:11445:x1875706562812288:12345-192.168.204.47@tcp:101:stat.0 Request processed in 814us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813470.334573:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 157 00010000:00010000:0.0:1788813470.397149:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813470.461274:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813470.461386:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562812544 00000100:00100000:2.0:1788813470.461396:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562812544 00000100:00100000:2.0:1788813470.461462:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 158 00000100:00100000:2.0:1788813470.461471:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+42:11455:x1875706562812544:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:2.0:1788813470.461490:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813470.461510:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb2297 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e48401c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813470.461619:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788813470.461757:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb2297 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48401c expref: 44 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.461771:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90874a4cbd00) 00010000:00010000:2.0:1788813470.461774:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813470.461778:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb2297 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48401c expref: 44 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.461792:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368e00, rc 0) 00000100:00100000:2.0:1788813470.462100:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+43:11455:x1875706562812544:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 628us (837us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1788813470.462108:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 158 00000100:00100000:3.0:1788813470.464662:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813470.464972:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562812800 00000100:00100000:2.0:1788813470.464982:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562812800 00000100:00100000:2.0:1788813470.465041:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 44 00000100:00100000:2.0:1788813470.465051:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874ada8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+43:11455:x1875706562812800:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:2.0:1788813470.465478:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874ada8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+44:11455:x1875706562812800:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 426us (825us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788813470.465487:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 44 00000100:00100000:3.0:1788813470.563331:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813470.563443:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562813056 00000100:00100000:0.0:1788813470.563462:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562813056 00000100:00100000:0.0:1788813470.563524:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 159 00000100:00100000:0.0:1788813470.563535:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908744579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+44:11461:x1875706562813056:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:0.0:1788813470.563558:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813470.563607:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb22a5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484023 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.563729:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb22ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.563744:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2290 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484015 expref: 45 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.563753:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb22ac lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.563786:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2290 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484015 expref: 45 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.563830:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2290 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484015 expref: 45 pid: 5849 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813470.563844:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e874380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1875706583787264:192.168.204.47@tcp:104: 00000100:00100000:0.0:1788813470.564320:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876ea79480 going to sleep for 11 seconds 00000100:00100000:3.0:1788813470.567388:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813470.567879:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562813184 00000100:00100000:2.0:1788813470.567889:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562813184 00010000:00010000:2.0:1788813470.567948:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2290 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484015 expref: 46 pid: 5849 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813470.567985:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 65 00000100:00100000:2.0:1788813470.567994:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908744579180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+46:2360:x1875706562813184:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813470.568008:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813470.568014:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2290 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484015 expref: 46 pid: 5849 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.568027:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2290 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484015 expref: 46 pid: 5849 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.568047:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca900) 00010000:00010000:2.0:1788813470.568052:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb22ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.568061:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb22ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.568084:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb22ac lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.568104:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813470.568153:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908744579180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+46:2360:x1875706562813184:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 160us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813470.568160:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 65 00010000:00010000:1.0:1788813470.568883:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2290 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484015 expref: 45 pid: 5849 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813470.568972:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e874380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1875706583787264:192.168.204.47@tcp:104: 00010000:00010000:1.0:1788813470.568994:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb22ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813470.569017:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb22ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813470.569023:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb22ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813470.569041:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788813470.569186:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb22a5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484023 expref: 46 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813470.569200:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb22ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484023 expref: 45 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813470.569208:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca900) 00010000:00010000:1.0:1788813470.569211:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788813470.569214:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9087413a0800, rc 0) 00000100:00100000:1.0:1788813470.569307:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908744579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+45:11461:x1875706562813056:12345-192.168.204.47@tcp:101:bash.0 Request processed in 5774us (5985us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788813470.569314:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 159 00000100:00100000:0.0:1788813470.579825:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813470.579948:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562813440 00000100:00100000:2.0:1788813470.579960:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562813440 00000100:00100000:2.0:1788813470.580053:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 160 00000100:00100000:2.0:1788813470.580065:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+45:11461:x1875706562813440:12345-192.168.204.47@tcp:36:bash.0 00010000:00010000:2.0:1788813470.580349:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb22ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.580368:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb22ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.580379:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb22ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788813470.580443:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1788813470.580478:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000667cec93 reply state 00000000f5b54c90 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb22ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813470.580487:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788813470.580618:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+48:11461:x1875706562813440:12345-192.168.204.47@tcp:36:bash.0 Request processed in 555us (804us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788813470.580626:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 160 00000020:00080000:2.0:1788813470.580631:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788813470.582808:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb22ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.582826:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb22ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.582834:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb22ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.582840:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368e00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813470.582845:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb22ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.582853:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb22ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.582871:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca900) 00010000:00010000:0.0:1788813470.582874:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813470.582880:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb22ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813470.582886:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb22ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813470.588948:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813470.589263:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562813568 00000100:00100000:1.0:1788813470.589274:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562813568 00000100:00100000:1.0:1788813470.589331:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 161 00000100:00100000:1.0:1788813470.589341:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+47:11461:x1875706562813568:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:1.0:1788813470.589366:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813470.589388:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72600/0x6d74dbab2ddb22c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e48402a expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813470.589506:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb22c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813470.589520:0:8269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb22ac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484023 expref: 48 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813470.589529:0:8269:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb22c8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813470.589561:0:8269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb22ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484023 expref: 48 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813470.589575:0:8269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb22ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484023 expref: 48 pid: 5849 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813470.589617:0:8269:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773ca0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8269:1875706583787392:192.168.204.47@tcp:104: 00000100:00100000:1.0:1788813470.589699:0:8269:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087480f5300 going to sleep for 11 seconds 00000100:00100000:1.0:1788813470.594405:0:8269:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773ca0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8269:1875706583787392:192.168.204.47@tcp:104: 00010000:00010000:1.0:1788813470.594437:0:8269:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb22c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813470.594944:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813470.595015:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562813696 00000100:00100000:3.0:1788813470.595022:0:8477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562813696 00010000:00010000:3.0:1788813470.595060:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb22ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484023 expref: 49 pid: 5849 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813470.595097:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 66 00000100:00100000:3.0:1788813470.595107:0:8477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e875c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+49:2360:x1875706562813696:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813470.595121:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813470.595128:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb22ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484023 expref: 49 pid: 5849 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.595139:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb22ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484023 expref: 49 pid: 5849 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.595161:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb22ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484023 expref: 49 pid: 5849 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.595176:0:8477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca900) 00010000:00010000:3.0:1788813470.595181:0:8477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb22c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.595190:0:8477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb22c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.595214:0:8477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb22c8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.595341:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813470.595392:0:8477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e875c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+48:2360:x1875706562813696:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 286us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813470.595400:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 66 00000100:00100000:3.0:1788813470.596128:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813470.596160:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813470.596184:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813470.596201:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813470.596224:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562813952 00000100:00100000:3.0:1788813470.596230:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562813952 00000100:00100000:3.0:1788813470.596274:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562814080 00000100:00100000:3.0:1788813470.596277:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562814080 00000100:00100000:3.0:1788813470.596298:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 90 00000100:00100000:3.0:1788813470.596305:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908744578700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+7:2362:x1875706562813952:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:3.0:1788813470.596354:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908744578700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+7:2362:x1875706562813952:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 48us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813470.596360:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 90 00000100:00100000:3.0:1788813470.596373:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 91 00000100:00100000:3.0:1788813470.596378:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874457a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+6:2362:x1875706562814080:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:3.0:1788813470.596399:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874457a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+6:2362:x1875706562814080:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 21us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813470.596405:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 91 00000100:00080000:3.0:1788813470.596433:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788813470.596451:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788813470.596529:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562814208 00000100:00100000:3.0:1788813470.596534:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562814208 00000100:00080000:3.0:1788813470.596548:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813470.596569:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 155 00000100:00100000:3.0:1788813470.596575:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874457b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa21be5-2246-40d3-8e20-d34501daf545+5:2362:x1875706562814208:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:3.0:1788813470.596623:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874457b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa21be5-2246-40d3-8e20-d34501daf545+5:2362:x1875706562814208:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 48us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813470.596629:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 155 00000100:00100000:0.0:1788813470.598082:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562813824 00000100:00100000:0.0:1788813470.598096:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562813824 00000100:00100000:0.0:1788813470.598146:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 293 00000100:00100000:0.0:1788813470.598155:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2362:x1875706562813824:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813470.598237:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2362:x1875706562813824:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 83us (2050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813470.598245:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 293 00010000:00010000:2.0:1788813470.601072:0:8269:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb22c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.601087:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb22c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813470.601136:0:8269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788813470.601140:0:8269:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788813470.601237:0:8269:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb22c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.601277:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72600/0x6d74dbab2ddb22c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48402a expref: 48 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.601296:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb22c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48402a expref: 47 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.601305:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca900) 00010000:00010000:2.0:1788813470.601308:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813470.601311:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908749d72e00, rc 0) 00000100:00100000:2.0:1788813470.601409:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+47:11461:x1875706562813568:12345-192.168.204.47@tcp:101:bash.0 Request processed in 12068us (12469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813470.601418:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 161 00000100:00100000:1.0:1788813470.607854:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813470.607973:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562814464 00000100:00100000:3.0:1788813470.607985:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562814464 00000100:00100000:3.0:1788813470.608099:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 45 00000100:00100000:3.0:1788813470.608110:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+47:11461:x1875706562814464:12345-192.168.204.47@tcp:35:bash.0 00000100:00100000:3.0:1788813470.608352:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+48:11461:x1875706562814464:12345-192.168.204.47@tcp:35:bash.0 Request processed in 243us (509us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1788813470.608360:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 45 00000100:00100000:3.0:1788813470.693111:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813470.693991:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562814720 00000100:00100000:2.0:1788813470.694003:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562814720 00000100:00100000:2.0:1788813470.694410:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 162 00000100:00100000:2.0:1788813470.694435:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908744578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+48:11471:x1875706562814720:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:2.0:1788813470.694474:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813470.694501:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb22cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484031 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813470.694670:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788813470.694812:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb22cf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484031 expref: 50 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.694827:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90874a4cbd00) 00010000:00010000:2.0:1788813470.694830:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813470.694835:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb22cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484031 expref: 50 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.694857:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369600, rc 0) 00000100:00100000:2.0:1788813470.695301:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908744578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+49:11471:x1875706562814720:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 878us (2198us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1788813470.695309:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 162 00000100:00100000:1.0:1788813470.703563:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813470.704208:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562814848 00000100:00100000:3.0:1788813470.704219:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562814848 00000100:00100000:3.0:1788813470.704340:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 163 00000100:00100000:3.0:1788813470.704351:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+49:11471:x1875706562814848:12345-192.168.204.47@tcp:34:lfs.0 00010000:00010000:3.0:1788813470.704433:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb22dd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.704454:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb22dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.704465:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb22dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.704493:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb22e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.704501:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb22e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.704507:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb22e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.704987:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb22eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.704999:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb22eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.705006:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb22eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813470.705180:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb22eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.705194:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb22dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.705202:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb22dd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.705208:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb22dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.705215:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813470.705218:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb22dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.705233:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb22dd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.705245:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:3.0:1788813470.705248:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813470.705254:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb22dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.705260:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb22dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.705272:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb22e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.705277:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb22e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.705284:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb22e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.705289:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813470.705292:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb22e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.705298:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb22e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.705304:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff908745aca600) 00010000:00010000:3.0:1788813470.705307:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813470.705309:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb22e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.705324:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb22e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.705338:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb22eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.705344:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb22eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.705350:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb22eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.705354:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad0c00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813470.705357:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb22eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.705363:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb22eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.705370:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca900) 00010000:00010000:3.0:1788813470.705373:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813470.705375:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb22eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.705381:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb22eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813470.706620:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+49:11471:x1875706562814848:12345-192.168.204.47@tcp:34:lfs.0 Request processed in 2262us (3057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813470.706633:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 163 00000100:00100000:1.0:1788813470.714680:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813470.715183:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562815104 00000100:00100000:2.0:1788813470.715195:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562815104 00000100:00100000:2.0:1788813470.715337:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 46 00000100:00100000:2.0:1788813470.715349:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+49:11471:x1875706562815104:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:2.0:1788813470.716379:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+50:11471:x1875706562815104:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 1027us (1705us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1788813470.716389:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 46 00000100:00100000:0.0:1788813470.756692:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813470.756798:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562815360 00000100:00100000:3.0:1788813470.756808:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562815360 00000100:00100000:3.0:1788813470.756876:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 164 00000100:00100000:3.0:1788813470.756886:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+50:11474:x1875706562815360:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:3.0:1788813470.756913:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813470.756944:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb22f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484038 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.757023:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb22f9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.757039:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb22f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.757050:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb22f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.757064:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2300 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.757071:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.757077:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.757370:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95c00/0x6d74dbab2ddb2307 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.757381:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95c00/0x6d74dbab2ddb2307 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.757399:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95c00/0x6d74dbab2ddb2307 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813470.757411:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788813470.757516:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb22f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.757525:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb22f9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.757532:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb22f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.757540:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813470.757545:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb22f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.757553:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb22f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.757564:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:3.0:1788813470.757567:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813470.757572:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb22f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.757622:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1800/0x6d74dbab2ddb22f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.757635:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.757642:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2300 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.757653:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2300 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.757658:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908750ad1a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813470.757660:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2300 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.757666:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2300 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.757674:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff908745aca600) 00010000:00010000:3.0:1788813470.757677:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813470.757679:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2300 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.757684:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1a00/0x6d74dbab2ddb2300 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.757728:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0c00/0x6d74dbab2ddb22f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484038 expref: 53 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.757744:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95c00/0x6d74dbab2ddb2307 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484038 expref: 52 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.757751:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca900) 00010000:00010000:3.0:1788813470.757753:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813470.757756:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c95c00, rc 0) 00000100:00100000:3.0:1788813470.757962:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+52:11474:x1875706562815360:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 1076us (1282us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1788813470.757980:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 164 00000100:00100000:1.0:1788813470.780698:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813470.780805:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813470.781232:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562815616 00000100:00100000:3.0:1788813470.781245:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562815616 00000100:00100000:3.0:1788813470.781304:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 165 00000100:00100000:3.0:1788813470.781314:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+52:11474:x1875706562815616:12345-192.168.204.47@tcp:54:lfs.0 00010000:00010000:3.0:1788813470.781384:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94400/0x6d74dbab2ddb2315 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.781403:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94400/0x6d74dbab2ddb2315 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.781429:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94400/0x6d74dbab2ddb2315 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.781467:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94400/0x6d74dbab2ddb2315 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.781475:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94400/0x6d74dbab2ddb2315 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.781482:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94400/0x6d74dbab2ddb2315 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.781488:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c94400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813470.781492:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94400/0x6d74dbab2ddb2315 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.781500:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94400/0x6d74dbab2ddb2315 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.781512:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca900) 00010000:00010000:3.0:1788813470.781529:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788813470.781536:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94400/0x6d74dbab2ddb2315 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813470.781543:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94400/0x6d74dbab2ddb2315 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813470.781642:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+52:11474:x1875706562815616:12345-192.168.204.47@tcp:54:lfs.0 Request processed in 328us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813470.781650:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 165 00000100:00100000:2.0:1788813470.782477:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562815488 00000100:00100000:2.0:1788813470.782489:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562815488 00000100:00100000:2.0:1788813470.782542:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 12 00000100:00100000:2.0:1788813470.782552:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+52:2360:x1875706562815488:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813470.782564:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813470.782613:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95c00/0x6d74dbab2ddb2307 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484038 expref: 52 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813470.782630:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca900) 00010000:00010000:2.0:1788813470.782635:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813470.782676:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+51:2360:x1875706562815488:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 125us (1990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813470.782683:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 12 00000100:00100000:1.0:1788813470.787631:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813470.788137:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562815872 00000100:00100000:2.0:1788813470.788149:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562815872 00000100:00100000:2.0:1788813470.788214:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 47 00000100:00100000:2.0:1788813470.788226:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+51:11474:x1875706562815872:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:2.0:1788813470.788635:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+52:11474:x1875706562815872:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 409us (1013us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1788813470.788643:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 47 00000100:00100000:1.0:1788813470.909394:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583787648:0@lo:400:kworker.0 00000100:00100000:1.0:1788813470.909472:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813470.909532:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773c76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583788160:0@lo:400:kworker.0 00000100:00100000:1.0:1788813470.909557:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813470.909606:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788813470.909612:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773c74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583787776:0@lo:400:kworker.0 00000100:00100000:1.0:1788813470.909633:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813470.909664:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583788160 00000100:00100000:1.0:1788813470.909672:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583788160 00000100:00100000:1.0:1788813470.909728:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788813470.909737:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583788160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813470.909786:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583788160:12345-0@lo:400:kworker.0 Request processed in 51us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813470.909793:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1788813470.909820:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788813470.909848:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773c76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583788160:0@lo:400:kworker.0 00000100:00100000:1.0:1788813470.909871:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583787648 00000100:00100000:1.0:1788813470.909874:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583787648 00000100:00100000:1.0:1788813470.909898:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583787776 00000100:00100000:1.0:1788813470.909900:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583787776 00000100:00080000:1.0:1788813470.909924:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813470.909945:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788813470.909951:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583787648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813470.909987:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583787648:12345-0@lo:400:kworker.0 Request processed in 36us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813470.909994:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788813470.910007:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788813470.910020:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583787776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813470.910048:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583787776:12345-0@lo:400:kworker.0 Request processed in 28us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813470.910054:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788813470.910079:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773c74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583787776:0@lo:400:kworker.0 00000100:00100000:1.0:1788813470.910089:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583787648:0@lo:400:kworker.0 00000100:00100000:3.0:1788813470.910612:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583787904:0@lo:400:kworker.0 00000100:00100000:3.0:1788813470.910647:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813470.910667:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788813470.910673:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583787520:0@lo:400:kworker.0 00000100:00100000:3.0:1788813470.910693:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813470.910722:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875706583788032:0@lo:400:kworker.0 00000100:00100000:3.0:1788813470.910742:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813470.910765:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583788032 00000100:00100000:3.0:1788813470.910769:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583788032 00000100:00080000:3.0:1788813470.910784:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813470.910804:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788813470.910810:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875706583788032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813470.910841:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875706583788032:12345-0@lo:400:kworker.0 Request processed in 31us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813470.910847:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788813470.910873:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875706583788032:0@lo:400:kworker.0 00000100:00100000:0.0:1788813470.910956:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583787904 00000100:00100000:0.0:1788813470.910960:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583787904 00000100:00100000:0.0:1788813470.910996:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788813470.911003:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908744579c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1875706583787904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813470.911043:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908744579c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1875706583787904:12345-0@lo:400:kworker.0 Request processed in 41us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813470.911048:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788813470.911089:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583787904:0@lo:400:kworker.0 00000100:00100000:1.0:1788813470.911825:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583787520 00000100:00100000:1.0:1788813470.911833:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583787520 00000100:00100000:1.0:1788813470.911929:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788813470.911938:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3318:x1875706583787520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813470.912006:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3318:x1875706583787520:12345-0@lo:400:kworker.0 Request processed in 69us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813470.912012:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788813470.912793:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583787520:0@lo:400:kworker.0 00000100:00100000:1.0:1788813471.036111:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813471.036211:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562816128 00000100:00100000:3.0:1788813471.036222:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562816128 00000100:00100000:3.0:1788813471.036447:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 166 00000100:00100000:3.0:1788813471.036460:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+52:11492:x1875706562816128:12345-192.168.204.47@tcp:101:cat.0 00010000:00010000:3.0:1788813471.036488:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813471.036510:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb231c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e48403f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813471.036652:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94400/0x6d74dbab2ddb2323 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813471.036667:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94400/0x6d74dbab2ddb2323 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813471.036679:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94400/0x6d74dbab2ddb2323 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813471.036691:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788813471.036826:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb231c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48403f expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813471.036845:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94400/0x6d74dbab2ddb2323 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48403f expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813471.036853:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca900) 00010000:00010000:3.0:1788813471.036856:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788813471.036860:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c94400, rc 0) 00000100:00100000:3.0:1788813471.036941:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+54:11492:x1875706562816128:12345-192.168.204.47@tcp:101:cat.0 Request processed in 484us (841us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788813471.036966:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 166 00000100:00100000:3.0:1788813471.093668:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813471.093832:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562816256 00000100:00100000:1.0:1788813471.093843:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562816256 00000100:00100000:1.0:1788813471.093907:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 167 00000100:00100000:1.0:1788813471.093927:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+54:11493:x1875706562816256:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:1.0:1788813471.093954:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813471.093978:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb2331 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484046 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.094047:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb2338 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.094064:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb2338 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.094091:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb2338 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813471.094128:0:8269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788813471.094131:0:8269:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813471.094151:0:8269:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb2338 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.094175:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb2331 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484046 expref: 56 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.094194:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb2338 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484046 expref: 55 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.094202:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:1.0:1788813471.094205:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813471.094209:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908749d72200, rc 0) 00000100:00100000:1.0:1788813471.094284:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+55:11493:x1875706562816256:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 358us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813471.094291:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 167 00000100:00100000:1.0:1788813471.101774:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813471.101857:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562816640 00000100:00100000:2.0:1788813471.101868:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562816640 00000100:00100000:2.0:1788813471.101949:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 48 00000100:00100000:2.0:1788813471.101961:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+55:11493:x1875706562816640:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:2.0:1788813471.102513:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+56:11493:x1875706562816640:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 552us (749us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788813471.102522:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 48 00000100:00100000:2.0:1788813471.124273:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813471.124409:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562816768 00000100:00100000:1.0:1788813471.124421:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562816768 00000100:00100000:1.0:1788813471.124492:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 13 00000100:00100000:1.0:1788813471.124502:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+56:11493:x1875706562816768:12345-192.168.204.47@tcp:103:lfs.0 00010000:00010000:1.0:1788813471.124518:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788813471.124543:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb22c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48402a expref: 56 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.124627:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94400/0x6d74dbab2ddb2323 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48403f expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.124643:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1200/0x6d74dbab2ddb21d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483feb expref: 54 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.124652:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca900) 00010000:00010000:1.0:1788813471.124664:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813471.124723:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+53:11493:x1875706562816768:12345-192.168.204.47@tcp:103:lfs.0 Request processed in 223us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813471.124731:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 13 00000100:00100000:0.0:1788813471.128437:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813471.128682:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562816896 00000100:00100000:3.0:1788813471.128694:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562816896 00000100:00100000:3.0:1788813471.128768:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 168 00000100:00100000:3.0:1788813471.128778:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+53:11493:x1875706562816896:12345-192.168.204.47@tcp:58:lfs.0 00010000:00010000:3.0:1788813471.129087:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb233f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813471.129104:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb233f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813471.129117:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb233f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788813471.129350:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788813471.129501:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+53:11493:x1875706562816896:12345-192.168.204.47@tcp:58:lfs.0 Request processed in 722us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813471.129510:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 168 00000100:00100000:2.0:1788813471.184627:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813471.184893:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562817024 00000100:00100000:1.0:1788813471.184904:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562817024 00000100:00100000:1.0:1788813471.184981:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 169 00000100:00100000:1.0:1788813471.184992:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+53:11495:x1875706562817024:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:1.0:1788813471.185016:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813471.185037:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb2346 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e48404d expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.185111:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb234d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.185139:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb234d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.185152:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb234d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.185187:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb2354 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.185195:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb2354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.185202:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb2354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.185454:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb235b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.185464:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb235b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.185472:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb235b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813471.185508:0:8269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788813471.185513:0:8269:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813471.185532:0:8269:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb235b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.185544:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb235b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.185552:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb234d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.185559:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb234d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.185576:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb234d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.185614:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813471.185619:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb234d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.185627:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb234d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.185639:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:1.0:1788813471.185643:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813471.185648:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb234d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.185654:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb234d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.185667:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb2354 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.185674:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb2354 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.185679:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb2354 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.185685:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73200 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813471.185688:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb2354 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.185705:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb2354 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.185714:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff908742cc6f00) 00010000:00010000:1.0:1788813471.185716:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813471.185719:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb2354 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.185725:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb2354 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.185758:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb2346 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48404d expref: 55 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.185773:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb235b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48404d expref: 54 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813471.185781:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca600) 00010000:00010000:1.0:1788813471.185784:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813471.185786:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908749d73e00, rc 0) 00000100:00100000:1.0:1788813471.185857:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+54:11495:x1875706562817024:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 867us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813471.185866:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 169 00000100:00100000:1.0:1788813471.420923:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583788288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813471.421014:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813471.421278:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583788288 00000100:00100000:0.0:1788813471.421288:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583788288 00000100:00100000:0.0:1788813471.421343:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788813471.421354:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583788288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788813471.421388:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813471.421455:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583788288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813471.421475:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788813471.421713:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583788288:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788813471.427204:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788813471.997854:0:11711:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788813471.997866:0:11711:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788813471.998104:0:11711:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788813471.998113:0:11711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788813471.998253:0:11711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e875180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11711:1875706583788416:192.168.204.47@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788813471.998367:0:11711:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876ea79480 going to sleep for 11 seconds 00000100:00100000:0.0:1788813472.017813:0:11711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e875180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11711:1875706583788416:192.168.204.47@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788813472.019054:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813472.030563:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562817152 00000100:00100000:1.0:1788813472.030614:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562817152 00000100:00100000:1.0:1788813472.030692:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 170 00000100:00100000:1.0:1788813472.030706:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+54:11506:x1875706562817152:12345-192.168.204.47@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788813472.030737:0:5849:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788813472.030864:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+54:11506:x1875706562817152:12345-192.168.204.47@tcp:53:lhsmtool_posix.0 Request processed in 162us (11814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813472.030872:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 170 00000100:00080000:1.0:1788813472.030911:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813472.044225:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813472.044406:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562817280 00000100:00100000:1.0:1788813472.044425:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562817280 00000100:00100000:1.0:1788813472.044492:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 171 00000100:00100000:1.0:1788813472.044503:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+54:11506:x1875706562817280:12345-192.168.204.47@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788813472.044606:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb2362 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.044625:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb2362 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.044640:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb2362 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.044656:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2369 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.044663:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2369 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.044668:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2369 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.044707:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb2370 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.044716:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb2370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.044723:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb2370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813472.044760:0:8269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788813472.044764:0:8269:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813472.044777:0:8269:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb2370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.044787:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb2362 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.044794:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb2362 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.044802:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb2362 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.044807:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813472.044811:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb2362 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.044819:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb2362 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.044831:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff908743ce0800) 00010000:00010000:1.0:1788813472.044840:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813472.044845:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb2362 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.044851:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb2362 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.044863:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2369 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.044869:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2369 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.044875:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2369 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.044880:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73600 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813472.044883:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2369 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.044888:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2369 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.044907:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff908742cc6b00) 00010000:00010000:1.0:1788813472.044909:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813472.044912:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2369 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.044918:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2369 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.044934:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb2370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.044949:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb2370 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.044955:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb2370 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.045231:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813472.045237:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb2370 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.045244:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb2370 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.045252:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca600) 00010000:00010000:1.0:1788813472.045254:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813472.045257:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb2370 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.045263:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb2370 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813472.045346:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+54:11506:x1875706562817280:12345-192.168.204.47@tcp:34:lhsmtool_posix.0 Request processed in 843us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813472.045355:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 171 00000100:00100000:0.0:1788813472.059188:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813472.059266:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562817536 00000100:00100000:3.0:1788813472.059275:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562817536 00000100:00100000:3.0:1788813472.059332:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 172 00000100:00100000:3.0:1788813472.059342:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+54:11506:x1875706562817536:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813472.059364:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813472.059390:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2377 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484054 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.059515:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb237e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.059785:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb237e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.059799:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb237e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813472.059813:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788813472.059932:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb237e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.059940:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb237e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.059946:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb237e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.059952:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c95600 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813472.059957:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb237e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.059974:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb237e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.059987:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca600) 00010000:00010000:3.0:1788813472.059991:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788813472.059996:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb237e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.060003:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb237e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.060047:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2377 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484054 expref: 56 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.060066:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff908743ce0800) 00010000:00010000:3.0:1788813472.060068:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788813472.060073:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2377 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484054 expref: 56 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.060083:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c94e00, rc 0) 00000100:00100000:3.0:1788813472.060160:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+55:11506:x1875706562817536:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 818us (980us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1788813472.060168:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 172 00000100:00100000:0.0:1788813472.075798:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813472.075888:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562817664 00000100:00100000:1.0:1788813472.075907:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562817664 00000100:00100000:1.0:1788813472.075977:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 173 00000100:00100000:1.0:1788813472.075987:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+55:11506:x1875706562817664:12345-192.168.204.47@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788813472.076031:0:8269:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788813472.076157:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+55:11506:x1875706562817664:12345-192.168.204.47@tcp:53:lhsmtool_posix.0 Request processed in 170us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813472.076165:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 173 00000100:00100000:3.0:1788813472.087870:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813472.088054:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562817920 00000100:00100000:2.0:1788813472.088065:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562817920 00000100:00100000:2.0:1788813472.088115:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 174 00000100:00100000:2.0:1788813472.088125:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877405b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+55:11506:x1875706562817920:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813472.088146:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813472.088150:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788813472.088177:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb2338 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484046 expref: 55 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.088197:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:2.0:1788813472.088202:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813472.088216:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb238c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e48405b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788813472.088826:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788813472.089043:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2393 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.089057:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2393 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.089069:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2393 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.089143:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb238c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48405b expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.089158:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2393 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48405b expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.089165:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff908745acaa00) 00010000:00010000:3.0:1788813472.089181:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813472.089184:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c94e00, rc 0) 00000100:00100000:3.0:1788813472.089256:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877405b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+56:11506:x1875706562817920:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 1131us (1395us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788813472.089264:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 174 00000100:00100000:0.0:1788813472.100241:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813472.100541:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562818176 00000100:00100000:1.0:1788813472.100552:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562818176 00000100:00100000:3.0:1788813472.100692:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 175 00000100:00100000:3.0:1788813472.100705:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+56:11506:x1875706562818176:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788813472.100813:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813472.100840:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2393 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48405b expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.100858:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff908745acaa00) 00010000:00010000:3.0:1788813472.100869:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813472.100907:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb23a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.100922:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb23a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.100932:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb23a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.100994:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb23a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xbbf53ea2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.101002:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb23a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbbf53ea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.101009:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb23a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbbf53ea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.101285:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb23a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.101294:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb23a1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.101300:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb23a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.101307:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c95600 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813472.101311:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb23a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.101318:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb23a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.101328:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:3.0:1788813472.101331:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813472.101336:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb23a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.101342:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb23a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.101351:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb23a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbbf53ea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.101357:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb23a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbbf53ea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.101363:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb23a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbbf53ea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.101375:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c95400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813472.101379:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb23a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbbf53ea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.101922:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb23a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbbf53ea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.101935:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xbbf53ea2 (ffff908745aca300) 00010000:00010000:3.0:1788813472.101938:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813472.101941:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb23a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbbf53ea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.101947:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb23a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbbf53ea2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813472.102076:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+55:11506:x1875706562818176:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 Request processed in 1372us (1844us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788813472.102085:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 175 00000100:00100000:2.0:1788813472.105188:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813472.105326:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562818304 00000100:00100000:3.0:1788813472.105339:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562818304 00000100:00100000:3.0:1788813472.105413:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 176 00000100:00100000:3.0:1788813472.105434:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+55:11506:x1875706562818304:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813472.105456:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813472.105482:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb23af lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484062 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.105518:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94200/0x6d74dbab2ddb23b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.105542:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94200/0x6d74dbab2ddb23b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.105554:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94200/0x6d74dbab2ddb23b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.105887:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb23af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484062 expref: 57 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.105917:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94200/0x6d74dbab2ddb23b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484062 expref: 56 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.105925:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff908745acae00) 00010000:00010000:3.0:1788813472.105928:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788813472.105932:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c94200, rc 0) 00000100:00100000:3.0:1788813472.105996:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+56:11506:x1875706562818304:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 565us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813472.106002:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 176 00000100:00100000:3.0:1788813472.112503:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813472.114078:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562818560 00000100:00100000:0.0:1788813472.114094:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562818560 00000100:00100000:0.0:1788813472.114178:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 177 00000100:00100000:0.0:1788813472.114189:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877405aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+56:11506:x1875706562818560:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788813472.114272:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb23bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.114290:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb23bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.114302:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb23bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788813472.114837:0:8269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1788813472.114848:0:8269:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 414357267216ns, next at 415357264881ns, rc = 0 00000004:00010000:0.0:1788813472.114953:0:8269:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e73c39ff reply state 00000000ba4914ab transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb23bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813472.115102:0:8269:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788813472.115218:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877405aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+58:11506:x1875706562818560:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 Request processed in 1029us (2725us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1788813472.115226:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 177 00010000:00010000:1.0:1788813472.117677:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb23bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.117694:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb23bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.117703:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb23bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.117709:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a1c00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813472.117714:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb23bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.117722:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb23bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.117739:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff908745acae00) 00010000:00010000:1.0:1788813472.117742:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788813472.117747:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb23bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.117752:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb23bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813472.118923:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813472.119620:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562818688 00000100:00100000:1.0:1788813472.119633:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562818688 00000100:00100000:1.0:1788813472.119690:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 178 00000100:00100000:1.0:1788813472.119712:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+57:11506:x1875706562818688:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788813472.119737:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813472.119758:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb23c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484069 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.119821:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb23c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484069 expref: 58 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.119836:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb23c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484069 expref: 58 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.119856:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff908745acae00) 00010000:00010000:1.0:1788813472.119859:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788813472.119863:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908749d73800, rc 0) 00000100:00100000:1.0:1788813472.119939:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+58:11506:x1875706562818688:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 229us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813472.119947:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 178 00000100:00100000:1.0:1788813472.124247:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813472.124329:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562818816 00000100:00100000:3.0:1788813472.124340:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562818816 00000100:00100000:3.0:1788813472.124413:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 50 00000100:00100000:3.0:1788813472.124432:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+6:2359:x1875706562818816:12345-192.168.204.47@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788813472.124806:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+7:2359:x1875706562818816:12345-192.168.204.47@tcp:2:lhsmtool_posix.0 Request processed in 375us (568us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788813472.124814:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 50 00000100:00080000:1.0:1788813472.125220:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788813472.145762:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813472.145863:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562819072 00000100:00100000:3.0:1788813472.145873:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562819072 00000100:00100000:3.0:1788813472.145947:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 49 00000100:00100000:3.0:1788813472.145958:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+58:11506:x1875706562819072:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788813472.146197:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+59:11506:x1875706562819072:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 Request processed in 239us (441us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788813472.146206:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 49 00000100:00100000:3.0:1788813472.152994:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813472.153077:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562819328 00000100:00100000:2.0:1788813472.153087:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562819328 00000100:00100000:2.0:1788813472.153165:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 179 00000100:00100000:2.0:1788813472.153176:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+59:11506:x1875706562819328:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788813472.153287:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+59:11506:x1875706562819328:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 Request processed in 112us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813472.153294:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 179 00000100:00100000:1.0:1788813472.164613:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813472.164730:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562819456 00000100:00100000:3.0:1788813472.164742:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562819456 00000100:00100000:3.0:1788813472.164799:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 180 00000100:00100000:3.0:1788813472.164810:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+59:11506:x1875706562819456:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813472.164836:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813472.164859:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb23cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484070 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.164958:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb23d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.164977:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb23d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.164990:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb23d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813472.165034:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813472.165054:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb23d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.165101:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb23cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484070 expref: 61 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.165119:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb23d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484070 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.165128:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff908745acae00) 00010000:00010000:3.0:1788813472.165131:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788813472.165135:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c95400, rc 0) 00000100:00100000:3.0:1788813472.165282:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+60:11506:x1875706562819456:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 473us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813472.165289:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 180 00000100:00100000:0.0:1788813472.171799:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813472.172522:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562819584 00000100:00100000:3.0:1788813472.172536:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562819584 00000100:00100000:3.0:1788813472.172611:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 51 00000100:00100000:3.0:1788813472.172621:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+7:2360:x1875706562819584:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813472.172640:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813472.172661:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e3b500e/0x6d74dbab2ddb23d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484077 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788813472.172692:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f20a0, blocks: 0x1 00010000:00010000:3.0:1788813472.172711:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1788813472.172715:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813472.172724:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e3b500e/0x6d74dbab2ddb23d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484077 expref: 8 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.172758:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e3b500e/0x6d74dbab2ddb23d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484077 expref: 8 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.172771:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c95600, rc 0) 00000100:00100000:3.0:1788813472.172832:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+8:2360:x1875706562819584:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 213us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813472.172840:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 51 00000100:00100000:1.0:1788813472.202704:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813472.202759:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562819840 00000100:00100000:1.0:1788813472.202771:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562819840 00000100:00100000:1.0:1788813472.202835:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 181 00000100:00100000:1.0:1788813472.202848:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+60:11506:x1875706562819840:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788813472.202981:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+60:11506:x1875706562819840:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 Request processed in 135us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813472.202998:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 181 00000040:00080000:2.0:1788813472.208976:0:12478:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788813472.208988:0:12478:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788813472.209028:0:12478:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788813472.209035:0:12478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788813472.214818:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813472.214857:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562819968 00000100:00100000:1.0:1788813472.214865:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562819968 00000100:00100000:1.0:1788813472.214931:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 52 00000100:00100000:1.0:1788813472.214942:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+8:11506:x1875706562819968:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788813472.214962:0:8270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813472.214982:0:8270:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7a98abf/0x6d74dbab2ddb23e0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e48407e expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.215017:0:8270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e3b500e/0x6d74dbab2ddb23d9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484077 expref: 9 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.215026:0:8270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813472.215031:0:8270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813472.215036:0:8270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7a98abf/0x6d74dbab2ddb23e0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48407e expref: 9 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.215069:0:8270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e3b500e/0x6d74dbab2ddb23d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484077 expref: 9 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.215083:0:8270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e3b500e/0x6d74dbab2ddb23d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484077 expref: 9 pid: 6705 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813472.215096:0:8270:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773c76a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8270:1875706583788544:192.168.204.47@tcp:104: 00000100:00100000:1.0:1788813472.215193:0:8270:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087480f5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788813472.221680:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813472.221709:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562820096 00000100:00100000:3.0:1788813472.221717:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562820096 00010000:00010000:3.0:1788813472.221755:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e3b500e/0x6d74dbab2ddb23d9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484077 expref: 10 pid: 6705 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813472.221789:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 67 00000100:00100000:3.0:1788813472.221797:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e927100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+10:2359:x1875706562820096:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813472.221815:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813472.221837:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e3b500e/0x6d74dbab2ddb23d9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484077 expref: 10 pid: 6705 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.221852:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e3b500e/0x6d74dbab2ddb23d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484077 expref: 10 pid: 6705 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.221877:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813472.221881:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813472.221910:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7a98abf/0x6d74dbab2ddb23e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48407e expref: 10 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.221920:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7a98abf/0x6d74dbab2ddb23e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48407e expref: 10 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.221961:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f7a98abf/0x6d74dbab2ddb23e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48407e expref: 10 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813472.221976:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e926300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5834:1875706583788672:192.168.204.47@tcp:105: 00000100:00100000:3.0:1788813472.222049:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff908641365a80 going to sleep for 11 seconds 00010000:00010000:3.0:1788813472.222155:0:8270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e3b500e/0x6d74dbab2ddb23d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484077 expref: 10 pid: 6705 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813472.222168:0:8270:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773c76a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8270:1875706583788544:192.168.204.47@tcp:104: 00010000:00010000:3.0:1788813472.222192:0:8270:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f7a98abf/0x6d74dbab2ddb23e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48407e expref: 9 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.222202:0:8270:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908749d72400, rc 0) 00000100:00100000:3.0:1788813472.222237:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+9:11506:x1875706562819968:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 7297us (7430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813472.222244:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 52 00000100:00100000:3.0:1788813472.227768:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813472.227867:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e926300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5834:1875706583788672:192.168.204.47@tcp:105: 00010000:00010000:3.0:1788813472.227902:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813472.228204:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562820224 00000100:00100000:2.0:1788813472.228217:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562820224 00002000:00100000:2.0:1788813472.228268:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff90876e926680 x1875706562820224/t0(0) o4->e90f6370-8c16-4659-9369-1cd146993b4c@192.168.204.47@tcp:288/0 lens 504/0 e 0 to 0 dl 1788813483 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788813472.228279:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90876e926680 with x1875706562820224 ext(0->8) 00002000:00010000:2.0:1788813472.228284:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90876e926680 00000100:00100000:2.0:1788813472.228326:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 4 00000100:00100000:2.0:1788813472.228339:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e90f6370-8c16-4659-9369-1cd146993b4c+9:2359:x1875706562820224:12345-192.168.204.47@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788813472.228494:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e927100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+9:2359:x1875706562820096:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 6696us (6821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813472.228504:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 67 00000100:00100000:2.0:1788813472.232353:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e90f6370-8c16-4659-9369-1cd146993b4c+10:2359:x1875706562820224:12345-192.168.204.47@tcp:4:lhsmtool_posix.0 Request processed in 4007us (4584us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788813472.232369:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 4 00002000:00100000:2.0:1788813472.232382:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff90876e926680 x1875706562820224/t4294967314(0) o4->e90f6370-8c16-4659-9369-1cd146993b4c@192.168.204.47@tcp:288/0 lens 504/448 e 0 to 0 dl 1788813483 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788813472.232394:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90876e926680 with x1875706562820224 ext(0->8) 00002000:00010000:2.0:1788813472.232400:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90876e926680 00000100:00100000:3.0:1788813472.237621:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813472.237712:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562820352 00000100:00100000:1.0:1788813472.237723:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562820352 00000100:00100000:1.0:1788813472.237784:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 182 00000100:00100000:1.0:1788813472.237795:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+60:11506:x1875706562820352:12345-192.168.204.47@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788813472.312926:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:0.0:1788813472.312938:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000100:00100000:3.0:1788813472.313201:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+59:11506:x1875706562820352:12345-192.168.204.47@tcp:44:lhsmtool_posix.0 Request processed in 74616us (74832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813472.313214:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 182 00000100:00100000:2.0:1788813472.313310:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773c77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583788800:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788813472.313371:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:0.0:1788813472.313683:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:0.0:1788813472.313701:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788813472.313716:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff908760309cc0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1788813472.313721:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9087466a3400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff908760309240 00000020:00080000:0.0:1788813472.313724:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9087466a3100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff908773c9cc00 00000020:00080000:0.0:1788813472.313920:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1788813472.314097:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788813472.314758:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583788928:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788813472.314814:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813472.320792:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583788800 00000100:00100000:1.0:1788813472.320807:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583788800 00000100:00100000:1.0:1788813472.320932:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583788928 00000100:00100000:1.0:1788813472.320937:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583788928 00000100:00100000:3.0:1788813472.321940:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788813472.321955:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583788800:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788813472.322154:0:6704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788813472.322158:0:6704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788813472 00002000:00010000:3.0:1788813472.322160:0:6704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788813472.322163:0:6704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788813472 -> 1788813472 00002000:00010000:3.0:1788813472.322165:0:6704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788813472.322239:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3318:x1875706583788800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 289us (8867us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788813472.322246:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00080000:3.0:1788813472.322360:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff908773c77480/2, rc 0, transno 4294967315 00000100:00100000:3.0:1788813472.322368:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773c77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583788800:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1788813472.322552:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788813472.322557:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813472.322753:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813472.323278:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562820480 00000100:00100000:3.0:1788813472.323286:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562820480 00000100:00100000:3.0:1788813472.323334:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 54 00000100:00100000:3.0:1788813472.323344:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+10:2360:x1875706562820480:12345-192.168.204.47@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788813472.329695:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788813472.329714:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1875706583788928:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788813472.329750:0:6705:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1788813472.329786:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f209d, atime: 0x6a9f209d, ctime: 0x6a9f209d, blocks: 0x1 00010000:00010000:1.0:1788813472.329796:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b428191f/0x6d74dbab2ddb23e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.329812:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=414s v=(0 0) 00010000:00010000:1.0:1788813472.329817:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813472.329823:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b428191f/0x6d74dbab2ddb23e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.329843:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b428191f/0x6d74dbab2ddb23e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.329856:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b428191f/0x6d74dbab2ddb23e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.329897:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b428191f/0x6d74dbab2ddb23e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.329919:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788813472.330469:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3319:x1875706583788928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 759us (15652us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788813472.330479:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00010000:1.0:1788813472.330511:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813472.330534:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b428191f/0x6d74dbab2ddb23e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.330544:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73c00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813472.330550:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b428191f/0x6d74dbab2ddb23e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.330560:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b428191f/0x6d74dbab2ddb23e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.330607:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b428191f/0x6d74dbab2ddb23e7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.330616:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b428191f/0x6d74dbab2ddb23e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.330640:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813472.330647:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813472.330650:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788813472.331814:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90876e876680/2, rc 0, transno 4294967307 00000100:00100000:2.0:1788813472.331827:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583788928:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788813472.413682:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+10:2360:x1875706562820480:12345-192.168.204.47@tcp:16:lhsmtool_posix.0 Request processed in 90327us (90918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813472.413697:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 54 00000001:00080000:3.0:1788813472.413763:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:3.0:1788813472.413778:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:0.0:1788813472.417860:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813472.417952:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562820736 00000100:00100000:1.0:1788813472.417962:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562820736 00000100:00100000:1.0:1788813472.418018:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 183 00000100:00100000:1.0:1788813472.418028:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+18:11506:x1875706562820736:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788813472.418085:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813472.418113:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb23d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484070 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.418133:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff908745acae00) 00010000:00010000:1.0:1788813472.418139:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788813472.418167:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb23ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.418181:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb23ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.418190:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb23ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788813472.418420:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070d601e7 reply state 000000009ad9cca5 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb23ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813472.418429:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788813472.418530:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+19:11506:x1875706562820736:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 Request processed in 503us (679us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788813472.418538:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 183 00000100:00100000:3.0:1788813472.422865:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00010000:00010000:0.0:1788813472.422990:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb23ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.423003:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb23ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.423011:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb23ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.423018:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73c00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813472.423022:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb23ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.423043:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb23ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.423057:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff908745acae00) 00010000:00010000:0.0:1788813472.423060:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813472.423066:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb23ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.423073:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb23ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813472.423226:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562820864 00000100:00100000:1.0:1788813472.423236:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562820864 00000100:00100000:1.0:1788813472.423286:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 56 00000100:00100000:1.0:1788813472.423295:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e925880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+7:2360:x1875706562820864:12345-192.168.204.47@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788813472.423560:0:6704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788813472.423564:0:6704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788813472 -> 1788813471 00002000:00010000:1.0:1788813472.423566:0:6704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788813469 00002000:00010000:1.0:1788813472.423568:0:6704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788813472 -> 1788813471 00002000:00010000:1.0:1788813472.423570:0:6704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788813472.423645:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e925880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+8:2360:x1875706562820864:12345-192.168.204.47@tcp:2:lhsmtool_posix.0 Request processed in 350us (789us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788813472.423653:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 56 00000100:00100000:2.0:1788813472.429167:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813472.429242:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562821120 00000100:00100000:3.0:1788813472.429253:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562821120 00000100:00100000:3.0:1788813472.429313:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 184 00000100:00100000:3.0:1788813472.429324:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+18:11506:x1875706562821120:12345-192.168.204.47@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788813472.429413:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb23f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.429433:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94200/0x6d74dbab2ddb23b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484062 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.429443:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb23f5 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.429477:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94200/0x6d74dbab2ddb23b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484062 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.429493:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94200/0x6d74dbab2ddb23b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484062 expref: 18 pid: 5849 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813472.429506:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e927b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1875706583789056:192.168.204.47@tcp:104: 00000100:00100000:3.0:1788813472.429825:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dff900 going to sleep for 11 seconds 00000100:00100000:0.0:1788813472.441160:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e927b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1875706583789056:192.168.204.47@tcp:104: 00010000:00010000:0.0:1788813472.441191:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb23f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813472.442285:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813472.442386:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562821248 00000100:00100000:0.0:1788813472.442395:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562821248 00010000:00010000:0.0:1788813472.442435:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94200/0x6d74dbab2ddb23b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484062 expref: 19 pid: 5849 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813472.442474:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 68 00000100:00100000:0.0:1788813472.442483:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+19:2359:x1875706562821248:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813472.442497:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813472.442504:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94200/0x6d74dbab2ddb23b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484062 expref: 19 pid: 5849 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.442517:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94200/0x6d74dbab2ddb23b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484062 expref: 19 pid: 5849 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.442649:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94200/0x6d74dbab2ddb23b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484062 expref: 19 pid: 5849 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.442664:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff908745acae00) 00010000:00010000:0.0:1788813472.442669:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb23f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.442679:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb23f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.442687:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb23f5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.442732:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813472.442783:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+18:2359:x1875706562821248:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 300us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813472.442790:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 68 00010000:00010000:1.0:1788813472.443857:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb23f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.443870:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb23f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.443911:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb23f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.443919:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb23f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.443926:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb23f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.443932:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c95600 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813472.443936:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb23f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.443943:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb23f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.443967:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff908745acae00) 00010000:00010000:1.0:1788813472.443970:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788813472.443975:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb23f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.443981:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95600/0x6d74dbab2ddb23f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813472.444055:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+17:11506:x1875706562821120:12345-192.168.204.47@tcp:55:lhsmtool_posix.0 Request processed in 14730us (14895us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788813472.444065:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 184 00000100:00100000:2.0:1788813472.447298:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813472.447368:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562821376 00000100:00100000:3.0:1788813472.447385:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562821376 00000100:00100000:3.0:1788813472.447453:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 57 00000100:00100000:3.0:1788813472.447463:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+8:2360:x1875706562821376:12345-192.168.204.47@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788813472.447519:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d35997a6/0x6d74dbab2ddb23fc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.447540:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7a98abf/0x6d74dbab2ddb23e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48407e expref: 8 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.447549:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813472.447553:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788813472.447557:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d35997a6/0x6d74dbab2ddb23fc lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.447620:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f7a98abf/0x6d74dbab2ddb23e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48407e expref: 8 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.447634:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f7a98abf/0x6d74dbab2ddb23e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48407e expref: 8 pid: 8270 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813472.447649:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e924380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1875706583789184:192.168.204.47@tcp:104: 00000100:00100000:3.0:1788813472.447720:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dffe40 going to sleep for 11 seconds 00010000:00010000:0.0:1788813472.449148:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813472.452095:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e924380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1875706583789184:192.168.204.47@tcp:104: 00010000:00010000:3.0:1788813472.452125:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d35997a6/0x6d74dbab2ddb23fc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813472.472869:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813472.477767:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562821504 00000100:00100000:2.0:1788813472.477787:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562821504 00010000:00010000:2.0:1788813472.477833:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f7a98abf/0x6d74dbab2ddb23e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48407e expref: 9 pid: 8270 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813472.477878:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 69 00000100:00100000:2.0:1788813472.477900:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90875873b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e90f6370-8c16-4659-9369-1cd146993b4c+9:2359:x1875706562821504:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813472.477917:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813472.477943:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f7a98abf/0x6d74dbab2ddb23e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48407e expref: 9 pid: 8270 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.477969:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f7a98abf/0x6d74dbab2ddb23e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48407e expref: 9 pid: 8270 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.477996:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7a98abf/0x6d74dbab2ddb23e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48407e expref: 9 pid: 8270 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.478015:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813472.478019:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813472.478025:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d35997a6/0x6d74dbab2ddb23fc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.478034:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d35997a6/0x6d74dbab2ddb23fc lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.478074:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813472.478129:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90875873b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e90f6370-8c16-4659-9369-1cd146993b4c+8:2359:x1875706562821504:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 231us (5269us total) trans 0 rc 0/0 00010000:00010000:3.0:1788813472.478131:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d35997a6/0x6d74dbab2ddb23fc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813472.478137:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 69 00010000:00010000:3.0:1788813472.478151:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d35997a6/0x6d74dbab2ddb23fc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.478175:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d35997a6/0x6d74dbab2ddb23fc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.478183:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d35997a6/0x6d74dbab2ddb23fc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.478191:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d35997a6/0x6d74dbab2ddb23fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.478199:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c94e00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:3.0:1788813472.478203:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d35997a6/0x6d74dbab2ddb23fc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.478212:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d35997a6/0x6d74dbab2ddb23fc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.478224:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d35997a6/0x6d74dbab2ddb23fc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813472.478231:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d35997a6/0x6d74dbab2ddb23fc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813472.478284:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+7:2360:x1875706562821376:12345-192.168.204.47@tcp:1:lhsmtool_posix.0 Request processed in 30822us (30996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813472.478292:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 57 00000100:00100000:1.0:1788813472.490046:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813472.490084:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562821760 00000100:00100000:1.0:1788813472.490093:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562821760 00000100:00100000:1.0:1788813472.490150:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 185 00000100:00100000:1.0:1788813472.490161:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+17:11506:x1875706562821760:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788813472.490249:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb2403 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.490269:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb2403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.490281:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb2403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.490486:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb240a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.490497:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb23c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484069 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.490514:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb240a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.490561:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb23c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484069 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.490575:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb23c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484069 expref: 18 pid: 5851 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813472.490611:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773c75180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875706583789312:192.168.204.47@tcp:104: 00000100:00100000:1.0:1788813472.490693:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087480f5480 going to sleep for 11 seconds 00000100:00100000:1.0:1788813472.499000:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773c75180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875706583789312:192.168.204.47@tcp:104: 00010000:00010000:1.0:1788813472.499034:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb240a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813472.499663:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813472.505299:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562821888 00000100:00100000:0.0:1788813472.505315:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562821888 00010000:00010000:0.0:1788813472.505370:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb23c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484069 expref: 19 pid: 5851 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813472.505562:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 70 00000100:00100000:0.0:1788813472.505574:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+19:2360:x1875706562821888:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813472.505661:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813472.505669:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb23c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484069 expref: 19 pid: 5851 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.505699:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb23c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484069 expref: 19 pid: 5851 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.505722:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73800/0x6d74dbab2ddb23c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484069 expref: 19 pid: 5851 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.505739:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff908745acae00) 00010000:00010000:0.0:1788813472.505744:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb240a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.505753:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb240a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.505760:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb240a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.505790:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813472.505902:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+18:2360:x1875706562821888:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 330us (6241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813472.505910:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 70 00010000:00010000:1.0:1788813472.505913:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb240a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813472.505921:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb240a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788813472.506139:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1788813472.506293:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1788813472.506340:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1788813472.506438:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773c77800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1875706583789440:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788813472.506505:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813472.506554:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087480f5840 going to sleep for 11 seconds 00000100:00100000:0.0:1788813472.506613:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583789440 00000100:00100000:0.0:1788813472.506619:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583789440 00000100:00100000:0.0:1788813472.506654:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788813472.506663:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1875706583789440:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788813472.506736:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1875706583789440:12345-0@lo:1000:mdt00_001.0 Request processed in 73us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813472.506742:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788813472.507555:0:5850:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1788813472.507564:0:5850:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff908773c77480, transno 4294967315 00000100:00100000:2.0:1788813472.507648:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773c77800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1875706583789440:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788813472.508080:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1788813472.508151:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877be45500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1875706583789568:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788813472.508200:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813472.508270:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876faa0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813472.508547:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583789568 00000100:00100000:0.0:1788813472.508554:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583789568 00000100:00100000:0.0:1788813472.508605:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788813472.508613:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1875706583789568:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788813472.508824:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1875706583789568:12345-0@lo:1000:mdt00_001.0 Request processed in 210us (622us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788813472.508831:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788813472.509154:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877be45500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5850:1875706583789568:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788813472.509189:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb240a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.509199:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb240a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.509208:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb240a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.509214:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73c00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813472.509219:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb240a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.509227:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb240a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.509256:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff908745acae00) 00010000:00010000:2.0:1788813472.509259:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788813472.509264:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb240a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.509271:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73c00/0x6d74dbab2ddb240a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.509300:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb233f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.509305:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb233f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.509310:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb233f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.509315:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c94800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813472.509317:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb233f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.509322:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb233f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.509328:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca600) 00010000:00010000:2.0:1788813472.509331:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788813472.509333:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb233f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.509338:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb233f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.509368:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2411 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.509512:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb235b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48404d expref: 21 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.509522:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2411 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.509555:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb235b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48404d expref: 21 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.509569:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb235b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48404d expref: 21 pid: 8269 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813472.509852:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908744579180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875706583789696:192.168.204.47@tcp:104: 00000100:00100000:2.0:1788813472.510044:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876faa0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813472.513316:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813472.513513:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562822016 00000100:00100000:0.0:1788813472.513524:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562822016 00010000:00010000:0.0:1788813472.513566:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb235b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48404d expref: 22 pid: 8269 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813472.513645:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 71 00000100:00100000:0.0:1788813472.513656:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e924380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+22:2359:x1875706562822016:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813472.513673:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813472.513680:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb235b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48404d expref: 22 pid: 8269 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.513693:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb235b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48404d expref: 22 pid: 8269 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.513713:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca600) 00010000:00010000:0.0:1788813472.513719:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2411 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.513730:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2411 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.513738:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2411 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.513771:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813472.513822:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e924380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+22:2359:x1875706562822016:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 167us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813472.513829:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 71 00010000:00010000:2.0:1788813472.514154:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb235b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48404d expref: 21 pid: 8269 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813472.514173:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908744579180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875706583789696:192.168.204.47@tcp:104: 00010000:00010000:2.0:1788813472.514197:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2411 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.514205:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2411 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.514211:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2411 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.514231:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2411 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.514237:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2411 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.514243:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2411 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.514248:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369e00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813472.514253:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2411 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.514260:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2411 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.514270:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca600) 00010000:00010000:2.0:1788813472.514273:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813472.514276:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2411 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.514281:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2411 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.514291:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb2403 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.514297:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb2403 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.514302:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb2403 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.514313:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813472.514316:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb2403 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.514322:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb2403 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.514330:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908745aca600) 00010000:00010000:2.0:1788813472.514332:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788813472.514335:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb2403 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.514341:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73a00/0x6d74dbab2ddb2403 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813472.514599:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+20:11506:x1875706562821760:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 Request processed in 24417us (24538us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1788813472.514608:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 185 00000020:00080000:2.0:1788813472.514612:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788813472.515005:0:11711:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788813472.515011:0:11711:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788813472.515559:0:11711:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788813472.515569:0:11711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788813472.519336:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813472.519425:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562822272 00000100:00100000:2.0:1788813472.519437:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562822272 00000100:00100000:2.0:1788813472.519487:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 50 00000100:00100000:2.0:1788813472.519495:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874adaa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+20:11506:x1875706562822272:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788813472.520308:0:5853:0:(mdd_object.c:4181:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788813472.520418:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1788813472.520469:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2418 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.520487:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2418 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.520508:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2418 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.520517:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2418 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.520524:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2418 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.520530:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2418 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813472.520678:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788813472.520785:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874adaa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+22:11506:x1875706562822272:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 Request processed in 1286us (1454us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1788813472.520794:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 50 00000020:00080000:2.0:1788813472.520799:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788813472.522796:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813472.522809:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2418 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.522819:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369600 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813472.522824:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2418 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.522834:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2418 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.522851:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff908743ce0b00) 00010000:00010000:0.0:1788813472.522854:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788813472.522859:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2418 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.522865:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2418 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813472.522898:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813472.522900:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813472.522901:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813473.469067:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788813474.061113:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:1.0:1788813474.061129:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000040:00080000:2.0:1788813474.218240:0:12531:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788813474.218250:0:12531:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788813474.218288:0:12531:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788813474.218293:0:12531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788813474.368413:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813474.368474:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562822528 00000100:00100000:1.0:1788813474.368488:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562822528 00000100:00100000:1.0:1788813474.368564:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 186 00000100:00100000:1.0:1788813474.368574:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908744579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+22:11524:x1875706562822528:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:1.0:1788813474.368619:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813474.368640:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73000/0x6d74dbab2ddb241f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484085 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.368770:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72600/0x6d74dbab2ddb2426 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.368786:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72600/0x6d74dbab2ddb2426 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.368799:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72600/0x6d74dbab2ddb2426 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813474.368812:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788813474.368945:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73000/0x6d74dbab2ddb241f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484085 expref: 25 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.368962:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72600/0x6d74dbab2ddb2426 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484085 expref: 24 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.368970:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:1.0:1788813474.368973:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788813474.368981:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908749d72600, rc 0) 00000100:00100000:1.0:1788813474.369047:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908744579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+24:11524:x1875706562822528:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 474us (642us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1788813474.369054:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 186 00000100:00080000:2.0:1788813474.370019:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813474.372074:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813474.372242:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562822656 00000100:00100000:2.0:1788813474.372252:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562822656 00000100:00100000:2.0:1788813474.372318:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 187 00000100:00100000:2.0:1788813474.372329:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+24:11524:x1875706562822656:12345-192.168.204.47@tcp:34:lfs.0 00010000:00010000:2.0:1788813474.372404:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb2434 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.372433:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb2434 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.372445:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb2434 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.372460:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb243b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.372467:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb243b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.372473:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb243b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.372736:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2442 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.372745:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2442 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.372752:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2442 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788813474.372794:0:8269:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2442 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.372969:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb2434 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.372978:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb2434 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.372994:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb2434 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.373000:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368e00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813474.373005:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb2434 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.373013:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb2434 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.373026:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:2.0:1788813474.373029:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813474.373034:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb2434 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.373041:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb2434 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.373054:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb243b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.373061:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb243b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.373067:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb243b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.373071:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813474.373074:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb243b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.373088:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb243b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.373096:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff908743ce0a00) 00010000:00010000:2.0:1788813474.373099:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813474.373102:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb243b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.373108:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb243b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.373123:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2442 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.373130:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2442 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.373136:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2442 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.373142:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813474.373144:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2442 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.373150:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2442 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.373157:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908743ce0000) 00010000:00010000:2.0:1788813474.373160:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813474.373162:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2442 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.373178:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2442 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813474.373271:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+24:11524:x1875706562822656:12345-192.168.204.47@tcp:34:lfs.0 Request processed in 941us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813474.373280:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 187 00000100:00100000:2.0:1788813474.437513:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813474.437612:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562822912 00000100:00100000:1.0:1788813474.437623:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562822912 00000100:00100000:1.0:1788813474.437677:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 188 00000100:00100000:1.0:1788813474.437687:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+24:11527:x1875706562822912:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:1.0:1788813474.437709:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813474.437730:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73000/0x6d74dbab2ddb2449 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e48408c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.437805:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb2450 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.437820:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb2450 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.437832:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb2450 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.437933:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2457 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.437941:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2457 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.437948:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2457 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.438194:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb245e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.438208:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb245e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.438216:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb245e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813474.438227:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788813474.438314:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb2450 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.438322:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb2450 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.438329:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb2450 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.438335:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d72a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813474.438339:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb2450 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.438346:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb2450 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.438357:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:1.0:1788813474.438360:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813474.438366:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb2450 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.438372:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb2450 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.438381:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2457 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.438393:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2457 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.438399:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2457 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.438403:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73600 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813474.438406:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2457 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.438412:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2457 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.438419:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff908742cc6d00) 00010000:00010000:1.0:1788813474.438421:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813474.438424:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2457 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.438429:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb2457 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.438475:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73000/0x6d74dbab2ddb2449 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48408c expref: 27 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.438488:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb245e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48408c expref: 26 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.438494:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908742cc6e00) 00010000:00010000:1.0:1788813474.438497:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813474.438504:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908749d73400, rc 0) 00000100:00100000:1.0:1788813474.438598:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+26:11527:x1875706562822912:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 892us (1073us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1788813474.438607:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 188 00000100:00100000:2.0:1788813474.452615:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813474.452705:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562823040 00000100:00100000:3.0:1788813474.452716:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562823040 00000100:00100000:3.0:1788813474.452786:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 189 00000100:00100000:3.0:1788813474.452798:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+26:11527:x1875706562823040:12345-192.168.204.47@tcp:54:lfs.0 00010000:00010000:3.0:1788813474.452878:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb246c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.452899:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb246c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.452913:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb246c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.452941:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb246c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.452949:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb246c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.452956:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb246c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.452977:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c94600 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813474.452982:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb246c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.452990:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb246c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.453003:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908742cc6e00) 00010000:00010000:3.0:1788813474.453006:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788813474.453012:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb246c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.453018:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb246c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813474.453099:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+26:11527:x1875706562823040:12345-192.168.204.47@tcp:54:lfs.0 Request processed in 303us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813474.453107:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 189 00000100:00100000:3.0:1788813474.457889:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813474.458418:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562823296 00000100:00100000:2.0:1788813474.458429:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562823296 00000100:00100000:2.0:1788813474.458495:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 51 00000100:00100000:2.0:1788813474.458506:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+26:11527:x1875706562823296:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:2.0:1788813474.458799:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+27:11527:x1875706562823296:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 294us (922us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788813474.458809:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 51 00000100:00100000:1.0:1788813474.494717:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813474.494741:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583789824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813474.494818:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813474.494895:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583789824 00000100:00100000:3.0:1788813474.494904:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583789824 00000100:00100000:3.0:1788813474.494970:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788813474.494979:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583789824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813474.495015:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813474.495071:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583789824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813474.495078:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1788813474.495135:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788813474.497779:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813474.498217:0:3321:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1788813474.498225:0:3321:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1788813474.498246:0:3321:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90876e876680, transno 4294967307 00000100:00100000:1.0:1788813474.498278:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583789824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813474.503243:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813474.503313:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562823552 00000100:00100000:1.0:1788813474.503322:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562823552 00000100:00100000:1.0:1788813474.503384:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 190 00000100:00100000:1.0:1788813474.503393:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+27:11053:x1875706562823552:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:1.0:1788813474.503416:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813474.503436:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73000/0x6d74dbab2ddb2473 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484093 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.503530:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb247a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.503544:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb245e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48408c expref: 28 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.503552:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb247a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.503632:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb245e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48408c expref: 28 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.503646:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb245e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48408c expref: 28 pid: 5849 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813474.503660:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773c76300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1875706583789952:192.168.204.47@tcp:104: 00000100:00100000:1.0:1788813474.503747:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff908781d18a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813474.509390:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813474.509838:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773c76300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1875706583789952:192.168.204.47@tcp:104: 00010000:00010000:1.0:1788813474.509882:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb247a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813474.510283:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562823680 00000100:00100000:2.0:1788813474.510292:0:8477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562823680 00010000:00010000:2.0:1788813474.510345:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb245e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48408c expref: 29 pid: 5849 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813474.510500:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 72 00000100:00100000:2.0:1788813474.510511:0:8477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e876680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+29:2360:x1875706562823680:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813474.510528:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813474.510536:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb245e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48408c expref: 29 pid: 5849 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.510564:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb245e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48408c expref: 29 pid: 5849 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.510668:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb245e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48408c expref: 29 pid: 5849 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.510686:0:8477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908742cc6e00) 00010000:00010000:2.0:1788813474.510690:0:8477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb247a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.510700:0:8477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb247a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.510708:0:8477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb247a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.510778:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813474.510854:0:8477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e876680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+28:2360:x1875706562823680:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 333us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813474.510863:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 72 00010000:00010000:1.0:1788813474.512041:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb247a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.512054:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb247a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813474.512075:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788813474.512938:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73000/0x6d74dbab2ddb2473 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484093 expref: 29 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.512962:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb247a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484093 expref: 28 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.512971:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908742cc6e00) 00010000:00010000:1.0:1788813474.512973:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788813474.512989:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908749d73600, rc 0) 00000100:00100000:1.0:1788813474.513062:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+28:11053:x1875706562823552:12345-192.168.204.47@tcp:101:bash.0 Request processed in 9669us (9829us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788813474.513071:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 190 00000100:00100000:0.0:1788813474.515032:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813474.515119:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562823936 00000100:00100000:2.0:1788813474.515140:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562823936 00000100:00100000:2.0:1788813474.515197:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 191 00000100:00100000:2.0:1788813474.515207:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+28:11053:x1875706562823936:12345-192.168.204.47@tcp:36:bash.0 00010000:00010000:2.0:1788813474.515487:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb2488 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.515504:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb2488 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.515531:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb2488 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788813474.515625:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1788813474.515653:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1b53ea5 reply state 00000000dc29b5cf transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb2488 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813474.515661:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788813474.515715:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1788813474.515823:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+32:11053:x1875706562823936:12345-192.168.204.47@tcp:36:bash.0 Request processed in 615us (800us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1788813474.515831:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 191 00000020:00080000:2.0:1788813474.515836:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1788813474.517613:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb2488 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.517629:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb2488 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.517636:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb2488 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.517642:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368e00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813474.517647:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb2488 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.517654:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb2488 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.517670:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908742cc6e00) 00010000:00010000:0.0:1788813474.517673:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813474.517679:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb2488 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.517685:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368e00/0x6d74dbab2ddb2488 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813474.518425:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813474.519042:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562824064 00000100:00100000:2.0:1788813474.519054:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562824064 00000100:00100000:2.0:1788813474.519121:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 192 00000100:00100000:2.0:1788813474.519131:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+31:11053:x1875706562824064:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:2.0:1788813474.519154:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813474.519174:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb248f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e48409a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.519233:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb248f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48409a expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.519247:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb248f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48409a expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.519265:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908742cc6e00) 00010000:00010000:2.0:1788813474.519281:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788813474.519285:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369a00, rc 0) 00000100:00100000:2.0:1788813474.519476:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+32:11053:x1875706562824064:12345-192.168.204.47@tcp:101:bash.0 Request processed in 344us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813474.519484:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 192 00000100:00100000:3.0:1788813474.523295:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813474.523877:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562824192 00000100:00100000:1.0:1788813474.523889:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562824192 00000100:00100000:2.0:1788813474.524272:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 58 00000100:00100000:2.0:1788813474.524286:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+7:11053:x1875706562824192:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:2.0:1788813474.524305:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813474.524327:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb2496 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4840a1 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788813474.524374:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f209f, atime: 0x6a9f209d, ctime: 0x6a9f209f, blocks: 0xb 00010000:00010000:2.0:1788813474.524402:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=416s v=(0 0) 00010000:00010000:2.0:1788813474.524407:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813474.524415:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb2496 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840a1 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.524432:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb2496 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840a1 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.524444:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369400, rc 0) 00000100:00100000:2.0:1788813474.524511:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+8:11053:x1875706562824192:12345-192.168.204.47@tcp:101:bash.0 Request processed in 229us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813474.524517:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 58 00000100:00080000:3.0:1788813474.526651:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788813474.526794:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813474.526882:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562824320 00000100:00100000:3.0:1788813474.526891:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562824320 00002000:00010000:3.0:1788813474.526931:0:6711:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1788813474.526936:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90876e875c00 with x1875706562824320 ext(0->18446744073709551615) 00002000:00010000:3.0:1788813474.526947:0:6711:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90876e875c00. 00000100:00100000:3.0:1788813474.527018:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 5 00000100:00100000:3.0:1788813474.527028:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e90f6370-8c16-4659-9369-1cd146993b4c+8:2360:x1875706562824320:12345-192.168.204.47@tcp:10:bash.0 00002000:00010000:3.0:1788813474.527350:0:6711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788813474.527354:0:6711:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788813471 -> 1788813475 00002000:00010000:3.0:1788813474.527356:0:6711:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788813469 -> 1788813469 00002000:00010000:3.0:1788813474.527358:0:6711:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788813471 -> 1788813475 00002000:00010000:3.0:1788813474.527360:0:6711:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788813474.527748:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e90f6370-8c16-4659-9369-1cd146993b4c+9:2360:x1875706562824320:12345-192.168.204.47@tcp:10:bash.0 Request processed in 718us (957us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788813474.527756:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 5 00002000:00010000:3.0:1788813474.527761:0:6711:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1788813474.527763:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90876e875c00 with x1875706562824320 ext(0->18446744073709551615) 00002000:00010000:3.0:1788813474.527769:0:6711:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90876e875c00. 00000100:00100000:0.0:1788813474.604823:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813474.604934:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562824448 00000100:00100000:2.0:1788813474.604944:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562824448 00000100:00100000:2.0:1788813474.605016:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 193 00000100:00100000:2.0:1788813474.605026:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c232680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+32:11541:x1875706562824448:12345-192.168.204.47@tcp:34:lfs.0 00010000:00010000:2.0:1788813474.605119:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb249d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605139:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb249d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605150:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb249d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605165:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb24a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605171:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb24a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605177:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb24a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605434:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb24ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605444:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb24ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605451:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb24ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788813474.605497:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb24ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605510:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb249d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605522:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb249d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605529:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb249d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605535:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813474.605540:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb249d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605547:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb249d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605561:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:2.0:1788813474.605564:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813474.605569:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb249d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605575:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb249d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605638:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb24a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605644:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb24a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605649:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb24a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605654:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369600 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813474.605663:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb24a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605670:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb24a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605678:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff908743ce0600) 00010000:00010000:2.0:1788813474.605680:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813474.605683:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb24a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605689:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb24a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605703:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb24ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605709:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb24ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605714:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb24ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605719:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369e00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813474.605722:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb24ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605728:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb24ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605735:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908742cc6e00) 00010000:00010000:2.0:1788813474.605737:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813474.605745:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb24ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.605752:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb24ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813474.605816:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c232680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+32:11541:x1875706562824448:12345-192.168.204.47@tcp:34:lfs.0 Request processed in 790us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813474.605823:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 193 00000100:00100000:3.0:1788813474.635865:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813474.635988:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562824704 00000100:00100000:1.0:1788813474.635999:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562824704 00000100:00100000:1.0:1788813474.636063:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 194 00000100:00100000:1.0:1788813474.636074:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+32:11544:x1875706562824704:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:1.0:1788813474.636111:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813474.636133:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73000/0x6d74dbab2ddb24b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4840a8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.636205:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb24b9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.636220:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb24b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.636230:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb24b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.636244:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb24c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.636250:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb24c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.636255:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb24c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.640709:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb24c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.640729:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb24c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.640741:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb24c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813474.640753:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788813474.640862:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb24b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.640869:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb24b9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.640877:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb24b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.640883:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d72a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813474.640888:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb24b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.640895:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb24b9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.640908:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:1.0:1788813474.640911:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813474.640916:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb24b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.640936:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72a00/0x6d74dbab2ddb24b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.640949:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb24c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.640956:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb24c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.640962:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb24c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.640966:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d72200 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813474.640970:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb24c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.640975:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb24c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.640982:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff908742cc6d00) 00010000:00010000:1.0:1788813474.640984:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813474.640987:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb24c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.640993:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb24c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.641048:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73000/0x6d74dbab2ddb24b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840a8 expref: 35 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.641831:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb24c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840a8 expref: 34 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.641859:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908742cc6e00) 00010000:00010000:1.0:1788813474.641862:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788813474.641865:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908749d73200, rc 0) 00000100:00100000:1.0:1788813474.641925:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+34:11544:x1875706562824704:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 5853us (6070us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1788813474.641934:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 194 00000100:00100000:0.0:1788813474.645305:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813474.645640:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562824832 00000100:00100000:2.0:1788813474.645651:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562824832 00000100:00100000:2.0:1788813474.645713:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 195 00000100:00100000:2.0:1788813474.645725:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c233480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+34:11544:x1875706562824832:12345-192.168.204.47@tcp:54:lfs.0 00010000:00010000:2.0:1788813474.645800:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb24d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.645818:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb247a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484093 expref: 34 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.645827:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb24d5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.645872:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb247a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484093 expref: 34 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.645887:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb247a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484093 expref: 34 pid: 5849 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813474.645901:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875706583790080:192.168.204.47@tcp:104: 00000100:00100000:2.0:1788813474.646006:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876e623240 going to sleep for 11 seconds 00000100:00100000:0.0:1788813474.649377:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813474.649834:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5850:1875706583790080:192.168.204.47@tcp:104: 00010000:00010000:2.0:1788813474.649872:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb24d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813474.649946:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562825088 00000100:00100000:3.0:1788813474.649956:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562825088 00000100:00100000:3.0:1788813474.650017:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 52 00000100:00100000:3.0:1788813474.650027:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c230a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+35:5600:x1875706562825088:12345-192.168.204.47@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788813474.650359:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c230a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+36:5600:x1875706562825088:12345-192.168.204.47@tcp:35:ldlm_bl.0 Request processed in 333us (1000us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788813474.650533:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 52 00000100:00100000:0.0:1788813474.656300:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813474.656751:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562825216 00000100:00100000:3.0:1788813474.656762:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562825216 00010000:00010000:3.0:1788813474.656810:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb247a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484093 expref: 36 pid: 5849 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813474.657041:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 73 00000100:00100000:3.0:1788813474.657053:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c231500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+36:2362:x1875706562825216:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813474.657071:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813474.657080:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb247a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484093 expref: 36 pid: 5849 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.657107:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb247a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484093 expref: 36 pid: 5849 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.657130:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73600/0x6d74dbab2ddb247a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484093 expref: 36 pid: 5849 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.657146:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908742cc6e00) 00010000:00010000:3.0:1788813474.657152:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb24d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.657163:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb24d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.657172:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb24d5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.657225:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813474.657289:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c231500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+35:2362:x1875706562825216:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 238us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813474.657298:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 73 00010000:00010000:2.0:1788813474.657671:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb24d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.657681:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb24d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.657713:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb24d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.657720:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb24d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.657727:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb24d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.657733:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369e00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813474.657737:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb24d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.657744:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb24d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.657754:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908742cc6e00) 00010000:00010000:2.0:1788813474.657756:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813474.657759:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb24d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.657777:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb24d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813474.657851:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c233480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+34:11544:x1875706562824832:12345-192.168.204.47@tcp:54:lfs.0 Request processed in 12116us (12544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813474.657859:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 195 00000100:00100000:0.0:1788813474.661775:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813474.661889:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562825472 00000100:00100000:2.0:1788813474.661900:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562825472 00000100:00100000:2.0:1788813474.661983:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 53 00000100:00100000:2.0:1788813474.661994:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+34:11544:x1875706562825472:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:2.0:1788813474.662239:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+35:11544:x1875706562825472:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 247us (473us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788813474.662247:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 53 00000100:00100000:1.0:1788813474.769799:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813474.771871:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562825728 00000100:00100000:3.0:1788813474.771886:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562825728 00000100:00100000:3.0:1788813474.771961:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 196 00000100:00100000:3.0:1788813474.771972:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+35:11556:x1875706562825728:12345-192.168.204.47@tcp:101:cat.0 00010000:00010000:3.0:1788813474.771999:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813474.772022:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb24dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4840af expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.772094:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb24e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.772109:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb24e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.772123:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb24e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.772137:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb24ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.772144:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb24ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.772150:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb24ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.772936:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb24f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.772950:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb24f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.772959:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb24f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813474.772970:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788813474.773065:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb24e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.773073:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb24e3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.773080:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb24e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.773086:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c94600 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813474.773091:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb24e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.773098:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb24e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.773110:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:3.0:1788813474.773113:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813474.773117:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb24e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.773135:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb24e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.773148:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb24ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.773154:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb24ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.773160:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb24ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.773165:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c95800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813474.773168:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb24ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.773173:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb24ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.773181:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff908745acaa00) 00010000:00010000:3.0:1788813474.773184:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813474.773187:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb24ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.773192:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb24ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.773236:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb24dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840af expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.773249:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb24f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840af expref: 37 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.773263:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908742cc6e00) 00010000:00010000:3.0:1788813474.773265:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813474.773268:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c95200, rc 0) 00000100:00100000:3.0:1788813474.773503:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+37:11556:x1875706562825728:12345-192.168.204.47@tcp:101:cat.0 Request processed in 1530us (3713us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788813474.773512:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 196 00000100:00100000:1.0:1788813474.781946:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813474.783748:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562825984 00000100:00100000:3.0:1788813474.783761:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562825984 00000100:00100000:3.0:1788813474.783828:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 54 00000100:00100000:3.0:1788813474.783851:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+37:11556:x1875706562825984:12345-192.168.204.47@tcp:35:cat.0 00000100:00100000:3.0:1788813474.784571:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+38:11556:x1875706562825984:12345-192.168.204.47@tcp:35:cat.0 Request processed in 729us (2631us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788813474.784752:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 54 00000100:00100000:0.0:1788813474.806293:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813474.806760:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562826240 00000100:00100000:3.0:1788813474.806772:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562826240 00000100:00100000:3.0:1788813474.806852:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 197 00000100:00100000:3.0:1788813474.806864:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+38:11557:x1875706562826240:12345-192.168.204.47@tcp:36:rm.0 00010000:00010000:3.0:1788813474.806928:0:8269:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788813474.806956:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb24f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840af expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.806977:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb24c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840a8 expref: 37 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.806989:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb248f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48409a expref: 36 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.807010:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff908742cc6e00) 00010000:00010000:3.0:1788813474.807024:0:8269:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813474.807046:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb24ff lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.807060:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb24ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.807070:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb24ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.807083:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb2506 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.807424:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb2506 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.807433:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb2506 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.811297:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb250d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.811320:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb250d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.811331:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb250d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788813474.816208:0:8269:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1788813474.816226:0:8269:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 417058645443ns, next at 418058640804ns, rc = 0 00010000:00010000:0.0:1788813474.816321:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb2514 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.816339:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb2514 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.816351:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb2514 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.816431:0:8269:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb2514 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.816442:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb2514 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.816518:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb2514 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.816809:0:8269:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813474.816858:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb250d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.816866:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb250d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.816873:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb250d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.816878:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a0800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813474.816882:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb250d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.816890:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb250d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.816902:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90874a4cb200) 00010000:00010000:0.0:1788813474.816905:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788813474.816910:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb250d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.816916:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb250d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.816936:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb24ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.816943:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb24ff lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.816948:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb24ff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.816953:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c94e00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813474.816962:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb24ff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.816967:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb24ff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.816977:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:0.0:1788813474.816979:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813474.816981:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb24ff lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.816986:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb24ff lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813474.816996:0:8269:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d1adb16 reply state 000000000e714ec8 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb2506 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813474.817004:0:8269:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788813474.817110:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+37:11557:x1875706562826240:12345-192.168.204.47@tcp:36:rm.0 Request processed in 10245us (10823us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788813474.817120:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 197 00010000:00010000:1.0:1788813474.820288:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813474.820303:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb2514 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.820315:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a0400 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813474.820320:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb2514 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.820330:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb2514 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.820348:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff90874a4cb200) 00010000:00010000:1.0:1788813474.820350:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788813474.820356:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb2514 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.820362:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb2514 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.820521:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813474.820540:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813474.820542:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813474.823558:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb2506 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.823611:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb2506 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.823620:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb2506 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.823635:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c95800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813474.823640:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb2506 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.823663:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb2506 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.823679:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff908745acaa00) 00010000:00010000:0.0:1788813474.823682:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813474.823692:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb2506 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.823698:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb2506 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813474.872002:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813474.872169:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562826496 00000100:00100000:1.0:1788813474.872179:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562826496 00000100:00100000:1.0:1788813474.872308:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 198 00000100:00100000:1.0:1788813474.872319:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+36:11563:x1875706562826496:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:1.0:1788813474.872345:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813474.872427:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb251b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4840b6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.872573:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb2522 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.872825:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb2522 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813474.872848:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb2522 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.873072:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2529 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.873081:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2529 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.873148:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2529 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788813474.874028:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788813474.874292:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2530 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.874307:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.874330:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.874456:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb2522 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.874464:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb2522 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.874470:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb2522 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.874476:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d72e00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813474.874480:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb2522 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.874486:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb2522 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.874499:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:2.0:1788813474.874502:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813474.874507:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb2522 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.874513:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72e00/0x6d74dbab2ddb2522 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788813474.874527:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6da3ee8 reply state 000000005eefe4bd transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2529 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813474.874537:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788813474.874779:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73200/0x6d74dbab2ddb251b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840b6 expref: 39 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.874800:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2530 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840b6 expref: 38 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.874808:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908743ce0d00) 00010000:00010000:2.0:1788813474.874810:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813474.874813:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368800, rc 0) 00000100:00100000:2.0:1788813474.874974:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+39:11563:x1875706562826496:12345-192.168.204.47@tcp:101:bash.0 Request processed in 2656us (2981us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788813474.874983:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 198 00010000:00010000:0.0:1788813474.892758:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2529 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.892777:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2529 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.892786:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2529 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.892791:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369600 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813474.892796:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2529 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.892804:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2529 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.892819:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff908743ce0600) 00010000:00010000:0.0:1788813474.892822:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813474.892858:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2529 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.892865:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2529 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813474.893255:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813474.897791:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562826624 00000100:00100000:2.0:1788813474.897807:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562826624 00000100:00100000:2.0:1788813474.898045:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 59 00000100:00100000:2.0:1788813474.898059:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+5:2359:x1875706562826624:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:2.0:1788813474.898077:0:8270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813474.898388:0:8270:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e983a1a/0x6d74dbab2ddb253e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4840bd expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788813474.898417:0:8270:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788813474.898439:0:8270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=417s v=(0 0) 00010000:00010000:2.0:1788813474.898572:0:8270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813474.898744:0:8270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e983a1a/0x6d74dbab2ddb253e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840bd expref: 6 pid: 8270 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.898772:0:8270:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004e983a1a/0x6d74dbab2ddb253e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840bd expref: 6 pid: 8270 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813474.898801:0:8270:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368000, rc 0) 00000100:00100000:2.0:1788813474.899030:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+6:2359:x1875706562826624:12345-192.168.204.47@tcp:101:bash.0 Request processed in 973us (5777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813474.899039:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 59 00000100:00080000:3.0:1788813474.902250:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813474.903169:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813474.903287:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562826752 00000100:00100000:3.0:1788813474.903298:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562826752 00000100:00100000:3.0:1788813474.903616:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 60 00000100:00100000:3.0:1788813474.903704:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+6:11563:x1875706562826752:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:3.0:1788813474.903723:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813474.903743:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c475bc92/0x6d74dbab2ddb2545 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4840c4 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.903793:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004e983a1a/0x6d74dbab2ddb253e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840bd expref: 7 pid: 8270 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.903803:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813474.903807:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813474.903812:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c475bc92/0x6d74dbab2ddb2545 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840c4 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.903865:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004e983a1a/0x6d74dbab2ddb253e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840bd expref: 7 pid: 8270 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.903881:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004e983a1a/0x6d74dbab2ddb253e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840bd expref: 7 pid: 8270 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813474.903895:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e925c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1875706583790208:192.168.204.47@tcp:104: 00000100:00100000:3.0:1788813474.905009:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dffe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788813474.916246:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813474.916416:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e925c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1875706583790208:192.168.204.47@tcp:104: 00010000:00010000:3.0:1788813474.916450:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c475bc92/0x6d74dbab2ddb2545 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840c4 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813474.916472:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c95200, rc 0) 00000100:00100000:3.0:1788813474.916531:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+7:11563:x1875706562826752:12345-192.168.204.47@tcp:101:bash.0 Request processed in 12904us (13369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813474.916540:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 60 00000100:00100000:2.0:1788813474.916558:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562826880 00000100:00100000:2.0:1788813474.916566:0:8477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562826880 00010000:00010000:1.0:1788813474.916787:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004e983a1a/0x6d74dbab2ddb253e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840bd expref: 7 pid: 8270 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813474.916824:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 74 00000100:00100000:0.0:1788813474.916981:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+7:2360:x1875706562826880:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813474.916997:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813474.917022:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004e983a1a/0x6d74dbab2ddb253e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840bd expref: 7 pid: 8270 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.917036:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004e983a1a/0x6d74dbab2ddb253e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840bd expref: 7 pid: 8270 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.917059:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e983a1a/0x6d74dbab2ddb253e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840bd expref: 7 pid: 8270 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.917073:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813474.917078:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813474.917086:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c475bc92/0x6d74dbab2ddb2545 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840c4 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.917096:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c475bc92/0x6d74dbab2ddb2545 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840c4 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813474.917132:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c475bc92/0x6d74dbab2ddb2545 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840c4 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813474.917156:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5835:1875706583790336:192.168.204.47@tcp:105: 00000100:00100000:0.0:1788813474.917264:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876ea790c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813474.924206:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5835:1875706583790336:192.168.204.47@tcp:105: 00010000:00010000:0.0:1788813474.924238:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813474.924305:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+6:2360:x1875706562826880:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 7328us (8067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813474.924316:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 74 00000100:00100000:2.0:1788813474.927017:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813474.927128:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562827136 00000100:00100000:3.0:1788813474.927141:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562827136 00000100:00100000:3.0:1788813474.927233:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 55 00000100:00100000:3.0:1788813474.927244:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+38:11563:x1875706562827136:12345-192.168.204.47@tcp:35:bash.0 00000100:00100000:3.0:1788813474.927926:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+39:11563:x1875706562827136:12345-192.168.204.47@tcp:35:bash.0 Request processed in 680us (914us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788813474.927936:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 55 00000100:00100000:2.0:1788813475.133219:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813475.133369:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562827264 00000100:00100000:3.0:1788813475.133379:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562827264 00000100:00100000:3.0:1788813475.133437:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 199 00000100:00100000:3.0:1788813475.133448:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+39:11579:x1875706562827264:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:3.0:1788813475.133473:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813475.133496:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb254c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4840cb expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.133561:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95e00/0x6d74dbab2ddb2553 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.133576:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95e00/0x6d74dbab2ddb2553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.133929:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95e00/0x6d74dbab2ddb2553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813475.133966:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788813475.133969:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813475.133988:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95e00/0x6d74dbab2ddb2553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.134012:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb254c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840cb expref: 41 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.134047:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95e00/0x6d74dbab2ddb2553 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840cb expref: 40 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.134055:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:3.0:1788813475.134058:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788813475.134061:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c95e00, rc 0) 00000100:00100000:3.0:1788813475.134218:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+40:11579:x1875706562827264:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 769us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813475.134226:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 199 00000100:00100000:1.0:1788813475.145098:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813475.145490:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562827520 00000100:00100000:3.0:1788813475.145500:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562827520 00000100:00100000:3.0:1788813475.145571:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 200 00000100:00100000:3.0:1788813475.145812:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+40:11579:x1875706562827520:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:3.0:1788813475.145843:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813475.145866:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb255a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4840d2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.145973:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2561 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.146204:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2561 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.146217:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2561 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813475.146230:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788813475.146442:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb255a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840d2 expref: 43 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.146461:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2561 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840d2 expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.146470:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908743ce0d00) 00010000:00010000:3.0:1788813475.146472:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813475.146476:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c94c00, rc 0) 00000100:00100000:3.0:1788813475.146628:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+42:11579:x1875706562827520:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 1047us (1538us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788813475.146636:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 200 00000100:00100000:2.0:1788813475.161144:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813475.161264:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813475.161851:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562827904 00000100:00100000:1.0:1788813475.161861:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562827904 00000100:00100000:1.0:1788813475.161951:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 14 00000100:00100000:1.0:1788813475.161962:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e90f6370-8c16-4659-9369-1cd146993b4c+42:2359:x1875706562827904:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813475.161992:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813475.162016:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2561 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840d2 expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.162033:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908743ce0d00) 00010000:00010000:1.0:1788813475.162038:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813475.162090:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e90f6370-8c16-4659-9369-1cd146993b4c+41:2359:x1875706562827904:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 130us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813475.162097:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 14 00000100:00100000:0.0:1788813475.163974:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562827776 00000100:00100000:0.0:1788813475.163989:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562827776 00000100:00100000:0.0:1788813475.164054:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 201 00000100:00100000:0.0:1788813475.164065:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+41:11579:x1875706562827776:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:0.0:1788813475.164088:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813475.164107:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb256f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4840d9 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.164206:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2576 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.164221:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2576 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.164233:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2576 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813475.164245:0:8269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788813475.164393:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb256f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840d9 expref: 44 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.164428:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2576 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840d9 expref: 43 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.164437:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908743ce0d00) 00010000:00010000:0.0:1788813475.164440:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788813475.164444:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9087413a1c00, rc 0) 00000100:00100000:0.0:1788813475.164517:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+43:11579:x1875706562827776:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 454us (3381us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788813475.164524:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 201 00000100:00100000:2.0:1788813475.171571:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813475.171719:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562828032 00000100:00100000:1.0:1788813475.171729:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562828032 00000100:00100000:1.0:1788813475.171792:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 61 00000100:00100000:1.0:1788813475.171802:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+6:2359:x1875706562828032:12345-192.168.204.47@tcp:1:lfs.0 00010000:00010000:1.0:1788813475.171860:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070ba3a6c/0x6d74dbab2ddb2584 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.171883:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c475bc92/0x6d74dbab2ddb2545 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840c4 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.171893:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813475.171898:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788813475.171903:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070ba3a6c/0x6d74dbab2ddb2584 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.171940:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c475bc92/0x6d74dbab2ddb2545 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840c4 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.171975:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c475bc92/0x6d74dbab2ddb2545 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840c4 expref: 6 pid: 6705 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813475.171990:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1875706583790464:192.168.204.47@tcp:104: 00000100:00100000:1.0:1788813475.172098:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff908781d18a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788813475.176503:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813475.176645:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562828160 00000100:00100000:3.0:1788813475.176656:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562828160 00002000:00100000:3.0:1788813475.176721:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff90877fa55880 x1875706562828160/t0(0) o4->e90f6370-8c16-4659-9369-1cd146993b4c@192.168.204.47@tcp:291/0 lens 504/0 e 0 to 0 dl 1788813486 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788813475.176733:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90877fa55880 with x1875706562828160 ext(0->8) 00010000:00010000:3.0:1788813475.176742:0:6710:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c475bc92/0x6d74dbab2ddb2545 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840c4 expref: 7 pid: 6705 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.176760:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c475bc92/0x6d74dbab2ddb2545 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840c4 expref: 7 pid: 6705 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788813475.176769:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90877fa55880 00000100:00100000:3.0:1788813475.176792:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 3 00000100:00100000:3.0:1788813475.176802:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e90f6370-8c16-4659-9369-1cd146993b4c+7:2359:x1875706562828160:12345-192.168.204.47@tcp:4:lfs.0 00000100:00100000:3.0:1788813475.177331:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e90f6370-8c16-4659-9369-1cd146993b4c+9:2359:x1875706562828160:12345-192.168.204.47@tcp:4:lfs.0 Request processed in 529us (836us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788813475.177344:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 3 00002000:00100000:3.0:1788813475.177352:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff90877fa55880 x1875706562828160/t4294967308(0) o4->e90f6370-8c16-4659-9369-1cd146993b4c@192.168.204.47@tcp:291/0 lens 504/448 e 0 to 0 dl 1788813486 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788813475.177360:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90877fa55880 with x1875706562828160 ext(0->8) 00010000:00010000:3.0:1788813475.177365:0:6710:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c475bc92/0x6d74dbab2ddb2545 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840c4 expref: 9 pid: 6705 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.177376:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c475bc92/0x6d74dbab2ddb2545 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840c4 expref: 9 pid: 6705 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788813475.177383:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90877fa55880 00000100:00100000:1.0:1788813475.177930:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1875706583790464:192.168.204.47@tcp:104: 00010000:00010000:1.0:1788813475.177958:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000070ba3a6c/0x6d74dbab2ddb2584 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813475.181177:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813475.181283:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562828288 00000100:00100000:1.0:1788813475.181293:0:8477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562828288 00010000:00010000:1.0:1788813475.181353:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c475bc92/0x6d74dbab2ddb2545 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840c4 expref: 9 pid: 6705 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813475.181407:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 75 00000100:00100000:1.0:1788813475.181416:0:8477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908758739850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+9:2361:x1875706562828288:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813475.181433:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788813475.181453:0:8477:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788813475.181456:0:8477:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788813475 00002000:00010000:1.0:1788813475.181458:0:8477:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788813475 00002000:00010000:1.0:1788813475.181460:0:8477:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788813475 00010000:00010000:1.0:1788813475.181466:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c475bc92/0x6d74dbab2ddb2545 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840c4 expref: 9 pid: 6705 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.181498:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c475bc92/0x6d74dbab2ddb2545 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840c4 expref: 9 pid: 6705 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.181520:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c475bc92/0x6d74dbab2ddb2545 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840c4 expref: 9 pid: 6705 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.181536:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788813475.181540:0:8477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788813475.181546:0:8477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000070ba3a6c/0x6d74dbab2ddb2584 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.181557:0:8477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070ba3a6c/0x6d74dbab2ddb2584 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.181882:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813475.181940:0:8477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908758739850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+8:2361:x1875706562828288:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 524us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813475.181948:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 75 00010000:00010000:3.0:1788813475.182043:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000070ba3a6c/0x6d74dbab2ddb2584 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.182054:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070ba3a6c/0x6d74dbab2ddb2584 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.182081:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070ba3a6c/0x6d74dbab2ddb2584 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.182167:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070ba3a6c/0x6d74dbab2ddb2584 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.182176:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070ba3a6c/0x6d74dbab2ddb2584 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.182195:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d72000 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:3.0:1788813475.182199:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070ba3a6c/0x6d74dbab2ddb2584 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.182208:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070ba3a6c/0x6d74dbab2ddb2584 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.182221:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070ba3a6c/0x6d74dbab2ddb2584 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.182228:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070ba3a6c/0x6d74dbab2ddb2584 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813475.182281:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e90f6370-8c16-4659-9369-1cd146993b4c+7:2359:x1875706562828032:12345-192.168.204.47@tcp:1:lfs.0 Request processed in 10481us (10719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813475.182290:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 61 00000100:00100000:2.0:1788813475.189039:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813475.191169:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562828544 00000100:00100000:0.0:1788813475.191183:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562828544 00000100:00100000:0.0:1788813475.191256:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 56 00000100:00100000:0.0:1788813475.191267:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874adaa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+43:11579:x1875706562828544:12345-192.168.204.47@tcp:35:lfs.0 00000004:00010000:0.0:1788813475.191790:0:5852:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2576 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840d9 expref: 43 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788813475.192056:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1788813475.192565:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1788813475.193007:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1788813475.193066:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb258b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.193082:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2530 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840b6 expref: 47 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.193206:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb258b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.193260:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2530 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840b6 expref: 47 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.193279:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2530 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840b6 expref: 47 pid: 5849 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813475.193296:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbca680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5852:1875706583790592:192.168.204.47@tcp:104: 00000100:00100000:0.0:1788813475.193416:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876ea790c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813475.197317:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbca680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5852:1875706583790592:192.168.204.47@tcp:104: 00010000:00010000:0.0:1788813475.197367:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb258b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813475.197539:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813475.197715:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562828672 00000100:00100000:1.0:1788813475.197724:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562828672 00010000:00010000:1.0:1788813475.197765:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2530 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840b6 expref: 48 pid: 5849 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813475.197800:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 76 00000100:00100000:1.0:1788813475.197809:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fa56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e90f6370-8c16-4659-9369-1cd146993b4c+48:2360:x1875706562828672:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813475.197848:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813475.197856:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2530 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840b6 expref: 48 pid: 5849 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.197868:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2530 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840b6 expref: 48 pid: 5849 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.197888:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2530 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840b6 expref: 48 pid: 5849 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.197903:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908743ce0d00) 00010000:00010000:1.0:1788813475.197908:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb258b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.197917:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb258b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.197925:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb258b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.197955:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813475.198016:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fa56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e90f6370-8c16-4659-9369-1cd146993b4c+47:2360:x1875706562828672:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 207us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813475.198023:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 76 00010000:00010000:0.0:1788813475.199222:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb258b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.199235:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb258b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788813475.199401:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788813475.199780:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1788813475.199912:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fbca680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1875706583790720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788813475.199981:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813475.200013:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876ea79000 going to sleep for 11 seconds 00000100:00100000:1.0:1788813475.200207:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583790720 00000100:00100000:1.0:1788813475.200215:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583790720 00000100:00100000:1.0:1788813475.200261:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788813475.200270:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875706583790720:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788813475.200366:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875706583790720:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 97us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813475.200388:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788813475.200857:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fbca680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1875706583790720:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788813475.201337:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1788813475.201417:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773ad8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1875706583790848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788813475.201472:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813475.201501:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876ea790c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813475.203518:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583790848 00000100:00100000:1.0:1788813475.203534:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583790848 00000100:00100000:1.0:1788813475.203635:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788813475.203647:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773adad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5852:x1875706583790848:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788813475.203931:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773adad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5852:x1875706583790848:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 285us (2457us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788813475.203939:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788813475.204194:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773ad8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5852:1875706583790848:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788813475.204271:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1788813475.204319:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb258b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.204331:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb258b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.204339:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb258b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.204345:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a0800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813475.204350:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb258b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.204358:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb258b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.204374:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908743ce0d00) 00010000:00010000:0.0:1788813475.204378:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788813475.204383:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb258b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.204390:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb258b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788813475.204888:0:5852:0:(mdd_object.c:4181:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788813475.204991:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1788813475.205002:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 417447421803ns, next at 418447419719ns, rc = 0 00000001:00080000:0.0:1788813475.205024:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1788813475.205063:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908743ce0d00) 00010000:00010000:0.0:1788813475.205067:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788813475.205074:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2576 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840d9 expref: 51 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813475.205177:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874adaa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+50:11579:x1875706562828544:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 13911us (16147us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1788813475.205185:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 56 00000020:00080000:0.0:1788813475.205190:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788813475.212791:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813475.212895:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562828800 00000100:00100000:3.0:1788813475.212906:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562828800 00000100:00100000:3.0:1788813475.212972:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 202 00000100:00100000:3.0:1788813475.212982:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bb5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+50:11579:x1875706562828800:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:3.0:1788813475.213006:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813475.213031:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb2592 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4840e0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.213099:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb2592 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840e0 expref: 51 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.213123:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb2592 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840e0 expref: 51 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.213147:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:3.0:1788813475.213151:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813475.213155:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c94600, rc 0) 00000100:00100000:3.0:1788813475.213320:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bb5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+51:11579:x1875706562828800:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 338us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813475.213326:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 202 00000100:00100000:2.0:1788813475.219061:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813475.219203:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562829056 00000100:00100000:3.0:1788813475.219213:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562829056 00000100:00100000:3.0:1788813475.219282:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 57 00000100:00100000:3.0:1788813475.219294:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bb5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+51:11579:x1875706562829056:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:3.0:1788813475.219850:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bb5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+52:11579:x1875706562829056:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 555us (798us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1788813475.219859:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 57 00000100:00100000:1.0:1788813475.333712:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813475.333891:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562829184 00000100:00100000:0.0:1788813475.333900:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562829184 00000100:00100000:0.0:1788813475.333974:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 203 00000100:00100000:0.0:1788813475.333984:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+52:11589:x1875706562829184:12345-192.168.204.47@tcp:34:lfs.0 00010000:00010000:0.0:1788813475.334084:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2599 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334110:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2599 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334127:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2599 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334151:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb25a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334158:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb25a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334168:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb25a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334304:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334313:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334480:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813475.334528:0:8269:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334541:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2599 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334548:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2599 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334555:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2599 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334561:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a1c00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813475.334565:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2599 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334572:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2599 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334620:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:0.0:1788813475.334624:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813475.334629:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2599 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334642:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb2599 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334655:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb25a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334661:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb25a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334667:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb25a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334672:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a0800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813475.334675:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb25a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334681:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb25a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334687:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90874a4cbb00) 00010000:00010000:0.0:1788813475.334689:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813475.334692:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb25a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334697:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb25a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334712:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334718:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334729:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334734:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a0400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813475.334736:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334743:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334751:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:0.0:1788813475.334753:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813475.334756:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.334762:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813475.334847:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+52:11589:x1875706562829184:12345-192.168.204.47@tcp:34:lfs.0 Request processed in 863us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813475.334855:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 203 00000100:00100000:2.0:1788813475.380316:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813475.380413:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562829440 00000100:00100000:3.0:1788813475.380423:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562829440 00000100:00100000:3.0:1788813475.380497:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 204 00000100:00100000:3.0:1788813475.380508:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bb5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+52:11592:x1875706562829440:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:3.0:1788813475.380530:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813475.380552:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95a00/0x6d74dbab2ddb25ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4840e7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.380664:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb25b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.380705:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb25b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.380718:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb25b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.380733:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb25bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.380740:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb25bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.380745:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb25bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.380876:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb25c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.380885:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb25c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.380893:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb25c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813475.380903:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788813475.381002:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb25b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.381010:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb25b5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.381016:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb25b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.381028:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c94a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813475.381032:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb25b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.381041:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb25b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.381053:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:3.0:1788813475.381057:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813475.381062:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb25b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.381068:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb25b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.381081:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb25bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.381087:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb25bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.381343:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb25bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.381350:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c94000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813475.381354:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb25bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.381360:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb25bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.381381:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff908745acac00) 00010000:00010000:3.0:1788813475.381384:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813475.381387:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb25bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.381394:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb25bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.381510:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95a00/0x6d74dbab2ddb25ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840e7 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.381526:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb25c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840e7 expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.381533:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:3.0:1788813475.381536:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813475.381538:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c95000, rc 0) 00000100:00100000:3.0:1788813475.381660:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bb5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+54:11592:x1875706562829440:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 1153us (1352us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1788813475.381667:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 204 00000100:00100000:2.0:1788813475.401555:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813475.401867:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562829568 00000100:00100000:0.0:1788813475.401878:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562829568 00000100:00100000:0.0:1788813475.401946:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 205 00000100:00100000:0.0:1788813475.401957:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bb5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+54:11592:x1875706562829568:12345-192.168.204.47@tcp:54:lfs.0 00010000:00010000:0.0:1788813475.402024:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.402041:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.402067:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.402106:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.402114:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.402120:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.402126:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a0400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813475.402130:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.402137:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.402148:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:0.0:1788813475.402151:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788813475.402156:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.402162:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813475.402238:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bb5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+54:11592:x1875706562829568:12345-192.168.204.47@tcp:54:lfs.0 Request processed in 282us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813475.402247:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 205 00000100:00100000:1.0:1788813475.410379:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813475.410538:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562829824 00000100:00100000:0.0:1788813475.410563:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562829824 00000100:00100000:0.0:1788813475.410655:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 58 00000100:00100000:0.0:1788813475.410665:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+54:11592:x1875706562829824:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:0.0:1788813475.410935:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+55:11592:x1875706562829824:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 270us (563us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788813475.410945:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 58 00000100:00100000:2.0:1788813475.505889:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813475.506010:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562830080 00000100:00100000:3.0:1788813475.506021:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562830080 00000100:00100000:3.0:1788813475.506170:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 206 00000100:00100000:3.0:1788813475.506182:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bb5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+55:11602:x1875706562830080:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:3.0:1788813475.506209:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813475.506211:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788813475.506240:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95e00/0x6d74dbab2ddb2553 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840cb expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.506274:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:3.0:1788813475.506280:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813475.506294:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95a00/0x6d74dbab2ddb25d8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4840ee expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.506421:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb25df lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.506451:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb25c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840e7 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.506460:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb25df lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.506497:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb25c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840e7 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.506512:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb25c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840e7 expref: 55 pid: 5851 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813475.506529:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e925c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1875706583790976:192.168.204.47@tcp:104: 00000100:00100000:3.0:1788813475.506806:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dff180 going to sleep for 11 seconds 00000100:00100000:3.0:1788813475.510738:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e925c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1875706583790976:192.168.204.47@tcp:104: 00010000:00010000:3.0:1788813475.510771:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb25df lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813475.511706:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813475.511870:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562830208 00000100:00100000:0.0:1788813475.511881:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562830208 00010000:00010000:0.0:1788813475.511922:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb25c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840e7 expref: 56 pid: 5851 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813475.511968:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 77 00000100:00100000:0.0:1788813475.511978:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bb5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+56:2360:x1875706562830208:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813475.511993:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813475.512000:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb25c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840e7 expref: 56 pid: 5851 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.512013:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb25c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840e7 expref: 56 pid: 5851 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.512034:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb25c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840e7 expref: 56 pid: 5851 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.512050:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:0.0:1788813475.512055:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb25df lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.512084:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb25df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.512106:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb25df lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.512138:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813475.512180:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb25df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.512194:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb25df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813475.512198:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bb5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+55:2360:x1875706562830208:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 221us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813475.512205:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 77 00000004:00200000:3.0:1788813475.512213:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788813475.512423:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95a00/0x6d74dbab2ddb25d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840ee expref: 56 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.512495:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb25df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840ee expref: 55 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.512503:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:3.0:1788813475.512506:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788813475.512508:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c94000, rc 0) 00000100:00100000:3.0:1788813475.512538:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bb5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+55:11602:x1875706562830080:12345-192.168.204.47@tcp:101:bash.0 Request processed in 6359us (6660us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788813475.512545:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 206 00000100:00100000:2.0:1788813475.515994:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00010000:00010000:2.0:1788813475.517744:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813475.519231:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562830464 00000100:00100000:0.0:1788813475.519245:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562830464 00000100:00100000:0.0:1788813475.519855:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 207 00000100:00100000:0.0:1788813475.519868:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bb5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+55:11602:x1875706562830464:12345-192.168.204.47@tcp:36:bash.0 00010000:00010000:0.0:1788813475.520153:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.520171:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.520182:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788813475.520237:0:8269:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1788813475.520262:0:8269:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ad162c5 reply state 00000000f5ef49bb transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813475.520271:0:8269:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788813475.520401:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bb5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+58:11602:x1875706562830464:12345-192.168.204.47@tcp:36:bash.0 Request processed in 535us (4417us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788813475.520426:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 207 00000020:00080000:0.0:1788813475.520431:0:8269:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788813475.524195:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00010000:00010000:0.0:1788813475.524305:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.524335:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.524343:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.524353:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a0400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813475.524358:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.524366:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.524383:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:0.0:1788813475.524386:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813475.524391:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.524397:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb25ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813475.527549:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562830592 00000100:00100000:3.0:1788813475.527565:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562830592 00000100:00100000:3.0:1788813475.527848:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 208 00000100:00100000:3.0:1788813475.527859:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bb5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+57:11602:x1875706562830592:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:3.0:1788813475.527884:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813475.527904:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95e00/0x6d74dbab2ddb25f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4840f5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.527989:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb25fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.528022:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb25df lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840ee expref: 58 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.528031:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb25fb lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.528067:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb25df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840ee expref: 58 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.528081:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb25df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840ee expref: 58 pid: 5849 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813475.528095:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e925c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1875706583791104:192.168.204.47@tcp:104: 00000100:00100000:3.0:1788813475.528192:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dffe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788813475.532047:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e925c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1875706583791104:192.168.204.47@tcp:104: 00010000:00010000:3.0:1788813475.532081:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb25fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813475.532329:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813475.532398:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562830720 00000100:00100000:0.0:1788813475.532407:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562830720 00010000:00010000:0.0:1788813475.532455:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb25df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840ee expref: 59 pid: 5849 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813475.532513:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 78 00000100:00100000:0.0:1788813475.532523:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e876680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e90f6370-8c16-4659-9369-1cd146993b4c+59:2359:x1875706562830720:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813475.532538:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813475.532545:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb25df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840ee expref: 59 pid: 5849 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.532557:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb25df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840ee expref: 59 pid: 5849 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.532605:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb25df lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840ee expref: 59 pid: 5849 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.532620:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:0.0:1788813475.532625:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb25fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.532634:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb25fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.532642:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb25fb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.532664:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813475.532848:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e876680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e90f6370-8c16-4659-9369-1cd146993b4c+58:2359:x1875706562830720:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 325us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813475.532857:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 78 00010000:00010000:3.0:1788813475.534100:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb25fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.534113:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb25fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813475.534162:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788813475.534166:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813475.534189:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb25fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.534244:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95e00/0x6d74dbab2ddb25f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840f5 expref: 58 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.534262:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb25fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840f5 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813475.534270:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:3.0:1788813475.534273:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813475.534277:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c94a00, rc 0) 00000100:00100000:3.0:1788813475.534517:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bb5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+57:11602:x1875706562830592:12345-192.168.204.47@tcp:101:bash.0 Request processed in 6657us (10329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813475.534526:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 208 00000100:00100000:1.0:1788813475.538487:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813475.538980:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562830976 00000100:00100000:0.0:1788813475.539004:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562830976 00000100:00100000:0.0:1788813475.539113:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 59 00000100:00100000:0.0:1788813475.539124:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c230a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+57:11602:x1875706562830976:12345-192.168.204.47@tcp:35:bash.0 00000100:00100000:0.0:1788813475.539408:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c230a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+58:11602:x1875706562830976:12345-192.168.204.47@tcp:35:bash.0 Request processed in 285us (930us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788813475.539417:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 59 00000100:00100000:1.0:1788813475.619061:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813475.619853:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562831104 00000100:00100000:2.0:1788813475.619865:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562831104 00000100:00100000:2.0:1788813475.619986:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 209 00000100:00100000:2.0:1788813475.619997:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c231500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+58:11608:x1875706562831104:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:2.0:1788813475.620021:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813475.620043:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2602 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4840fc expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813475.620122:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2609 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813475.620137:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813475.620148:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813475.620182:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788813475.620186:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788813475.620204:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2609 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813475.620228:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2602 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840fc expref: 60 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813475.620246:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2609 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840fc expref: 59 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813475.620254:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:2.0:1788813475.620257:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813475.620260:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368800, rc 0) 00000100:00100000:2.0:1788813475.620331:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c231500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+59:11608:x1875706562831104:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 335us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813475.620343:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 209 00000100:00100000:1.0:1788813475.623715:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813475.624227:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562831232 00000100:00100000:0.0:1788813475.624238:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562831232 00000100:00100000:0.0:1788813475.624300:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 210 00000100:00100000:0.0:1788813475.624311:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+59:11608:x1875706562831232:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:0.0:1788813475.624511:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813475.624533:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb2610 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484103 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.624756:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2617 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.624771:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2617 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.624783:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2617 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.624797:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb261e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.624804:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb261e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.624810:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb261e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.624925:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2625 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.624934:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2625 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.624941:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2625 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813475.624977:0:8269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788813475.624982:0:8269:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788813475.625001:0:8269:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2625 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.625012:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2625 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.625022:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2617 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.625028:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2617 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.625035:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2617 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.625041:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a0800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813475.625045:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2617 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.625053:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2617 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.625071:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:0.0:1788813475.625074:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813475.625079:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2617 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.625085:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0800/0x6d74dbab2ddb2617 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.625099:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb261e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.625105:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb261e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.625110:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb261e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.625115:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a1c00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813475.625118:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb261e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.625124:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb261e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.625131:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff90874a4cbb00) 00010000:00010000:0.0:1788813475.625133:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813475.625136:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb261e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.625142:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1c00/0x6d74dbab2ddb261e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.625187:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a0400/0x6d74dbab2ddb2610 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484103 expref: 61 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.625202:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2625 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484103 expref: 60 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.625208:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:0.0:1788813475.625210:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813475.625212:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740030a00, rc 0) 00000100:00100000:0.0:1788813475.625281:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+60:11608:x1875706562831232:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 971us (1575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813475.625288:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 210 00000100:00100000:1.0:1788813475.633055:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813475.633135:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562831360 00000100:00100000:0.0:1788813475.633144:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562831360 00000100:00100000:0.0:1788813475.633216:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 15 00000100:00100000:0.0:1788813475.633227:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+60:2359:x1875706562831360:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813475.633244:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813475.633269:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2625 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484103 expref: 60 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.633288:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:0.0:1788813475.633294:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813475.633372:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+59:2359:x1875706562831360:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 147us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813475.633379:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 15 00000100:00100000:0.0:1788813475.636242:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813475.636372:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562831616 00000100:00100000:2.0:1788813475.636382:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562831616 00000100:00100000:2.0:1788813475.636429:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 211 00000100:00100000:2.0:1788813475.636439:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+59:11608:x1875706562831616:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:2.0:1788813475.636460:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813475.636480:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb262c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e48410a expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813475.636612:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2633 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813475.636629:0:8269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb25fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840f5 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813475.636638:0:8269:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2633 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813475.636672:0:8269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb25fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840f5 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813475.636814:0:8269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb25fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840f5 expref: 60 pid: 5851 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813475.636843:0:8269:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877bb5c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8269:1875706583791232:192.168.204.47@tcp:104: 00000100:00100000:2.0:1788813475.636943:0:8269:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876e623240 going to sleep for 11 seconds 00000100:00100000:2.0:1788813475.644409:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813475.644644:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562831744 00000100:00100000:1.0:1788813475.644654:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562831744 00010000:00010000:1.0:1788813475.644707:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb25fb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840f5 expref: 61 pid: 5851 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813475.644752:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 79 00000100:00100000:1.0:1788813475.644762:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bb5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e90f6370-8c16-4659-9369-1cd146993b4c+61:2360:x1875706562831744:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813475.644778:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813475.644785:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb25fb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840f5 expref: 61 pid: 5851 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.644811:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb25fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840f5 expref: 61 pid: 5851 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.644847:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:1.0:1788813475.644853:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2633 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.644864:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2633 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.644873:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2633 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.644896:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813475.644955:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bb5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e90f6370-8c16-4659-9369-1cd146993b4c+61:2360:x1875706562831744:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 194us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813475.644963:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 79 00010000:00010000:0.0:1788813475.648018:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb25fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840f5 expref: 60 pid: 5851 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813475.648044:0:8269:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877bb5c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8269:1875706583791232:192.168.204.47@tcp:104: 00010000:00010000:0.0:1788813475.648072:0:8269:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2633 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.653329:0:8269:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2633 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.653355:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2633 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813475.653383:0:8269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788813475.653925:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb262c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48410a expref: 61 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.653947:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2633 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48410a expref: 60 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.653975:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:1.0:1788813475.653978:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788813475.653982:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369600, rc 0) 00000100:00100000:1.0:1788813475.654050:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+60:11608:x1875706562831616:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 17612us (17818us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788813475.654058:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 211 00000100:00100000:2.0:1788813475.657976:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813475.658042:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562832000 00000100:00100000:0.0:1788813475.658052:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562832000 00000100:00100000:0.0:1788813475.658114:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 16 00000100:00100000:0.0:1788813475.658123:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bb5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+60:11608:x1875706562832000:12345-192.168.204.47@tcp:103:lfs.0 00010000:00010000:0.0:1788813475.658142:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813475.658180:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb2592 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840e0 expref: 60 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813475.658199:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:0.0:1788813475.658204:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813475.658262:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bb5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+59:11608:x1875706562832000:12345-192.168.204.47@tcp:103:lfs.0 Request processed in 140us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813475.658270:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 16 00000100:00100000:3.0:1788813475.662224:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813475.666274:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562832128 00000100:00100000:2.0:1788813475.666291:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562832128 00000100:00100000:2.0:1788813475.666555:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 212 00000100:00100000:2.0:1788813475.666567:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+59:11608:x1875706562832128:12345-192.168.204.47@tcp:58:lfs.0 00010000:00010000:2.0:1788813475.666802:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2641 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813475.666831:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2641 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813475.666844:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2641 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788813475.667025:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788813475.667164:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+59:11608:x1875706562832128:12345-192.168.204.47@tcp:58:lfs.0 Request processed in 598us (4948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813475.667172:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 212 00000100:00100000:3.0:1788813475.673749:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813475.673943:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562832256 00000100:00100000:1.0:1788813475.673953:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562832256 00000100:00100000:1.0:1788813475.674009:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 213 00000100:00100000:1.0:1788813475.674019:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+59:11608:x1875706562832256:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:1.0:1788813475.674038:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813475.674058:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb2648 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484111 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.674119:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2641 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.674130:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb2648 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484111 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.674149:0:5851:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2641 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.674164:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb2648 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484111 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.674200:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:1.0:1788813475.674203:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788813475.674207:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb2648 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484111 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813475.674215:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908749d73e00, rc 0) 00000100:00100000:1.0:1788813475.674276:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+60:11608:x1875706562832256:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 257us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813475.674283:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 213 00000100:00100000:1.0:1788813475.717801:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813475.717894:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813475.717933:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813475.718018:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562832512 00000100:00100000:2.0:1788813475.718028:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562832512 00000100:00100000:2.0:1788813475.718089:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 94 00000100:00100000:2.0:1788813475.718099:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876fac9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+9:2361:x1875706562832512:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813475.718175:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876fac9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+9:2361:x1875706562832512:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 77us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813475.718182:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 94 00000100:00100000:3.0:1788813475.718845:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562832640 00000100:00100000:3.0:1788813475.718850:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562832640 00000100:00100000:3.0:1788813475.718900:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 159 00000100:00100000:3.0:1788813475.718909:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa21be5-2246-40d3-8e20-d34501daf545+5:2362:x1875706562832640:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:3.0:1788813475.718955:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa21be5-2246-40d3-8e20-d34501daf545+5:2362:x1875706562832640:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 48us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813475.718962:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 159 00000100:00080000:2.0:1788813475.721024:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813475.723471:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562832384 00000100:00100000:0.0:1788813475.723487:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562832384 00000100:00100000:0.0:1788813475.723716:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 295 00000100:00100000:0.0:1788813475.723729:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2361:x1875706562832384:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813475.723829:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2361:x1875706562832384:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 93us (6145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813475.723838:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 295 00000100:00100000:2.0:1788813476.031961:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877bb5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875706583791616:0@lo:400:kworker.0 00000100:00100000:2.0:1788813476.032035:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813476.032115:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788813476.032121:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877bb5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875706583791488:0@lo:400:kworker.0 00000100:00100000:2.0:1788813476.032145:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813476.032161:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877bb5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583792000:0@lo:400:kworker.0 00000100:00100000:2.0:1788813476.032181:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813476.032209:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583792000 00000100:00100000:2.0:1788813476.032216:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583792000 00000100:00100000:2.0:1788813476.032268:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788813476.032278:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3319:x1875706583792000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813476.032330:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3319:x1875706583792000:12345-0@lo:400:kworker.0 Request processed in 54us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813476.032347:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1788813476.032370:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813476.032398:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877bb5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583792000:0@lo:400:kworker.0 00000100:00100000:2.0:1788813476.032421:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583791616 00000100:00100000:2.0:1788813476.032425:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583791616 00000100:00080000:2.0:1788813476.032440:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813476.032460:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788813476.032466:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bb5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875706583791616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813476.032789:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877bb5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583791360:0@lo:400:kworker.0 00000100:00100000:1.0:1788813476.032840:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813476.032872:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877bb5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875706583791872:0@lo:400:kworker.0 00000100:00100000:1.0:1788813476.032894:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813476.032915:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813476.032921:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877bb5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583791744:0@lo:400:kworker.0 00000100:00100000:1.0:1788813476.032943:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813476.032971:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583791744 00000100:00100000:1.0:1788813476.032976:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583791744 00000100:00100000:1.0:1788813476.033010:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788813476.033018:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3321:x1875706583791744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813476.033056:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3321:x1875706583791744:12345-0@lo:400:kworker.0 Request processed in 39us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813476.033075:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1788813476.033107:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813476.033131:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877bb5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583791744:0@lo:400:kworker.0 00000100:00100000:1.0:1788813476.033148:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583791488 00000100:00100000:1.0:1788813476.033152:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583791488 00000100:00100000:1.0:1788813476.033167:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583791872 00000100:00100000:1.0:1788813476.033169:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583791872 00000100:00080000:1.0:1788813476.033182:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813476.033196:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788813476.033201:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bb5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875706583791488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813476.033242:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bb5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875706583791488:12345-0@lo:400:kworker.0 Request processed in 40us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813476.033248:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788813476.033260:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788813476.033266:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875706583791872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813476.033295:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875706583791872:12345-0@lo:400:kworker.0 Request processed in 30us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813476.033300:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788813476.033322:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877bb5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875706583791872:0@lo:400:kworker.0 00000100:00100000:1.0:1788813476.033374:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877bb5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875706583791488:0@lo:400:kworker.0 00000100:00100000:0.0:1788813476.033684:0:11247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583791360 00000100:00100000:0.0:1788813476.033690:0:11247:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583791360 00000100:00100000:0.0:1788813476.033726:0:11247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788813476.033734:0:11247:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3321:x1875706583791360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813476.033776:0:11247:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3321:x1875706583791360:12345-0@lo:400:kworker.0 Request processed in 43us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813476.033782:0:11247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788813476.033838:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877bb5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583791360:0@lo:400:kworker.0 00000100:00100000:2.0:1788813476.034009:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bb5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875706583791616:12345-0@lo:400:kworker.0 Request processed in 1541us (1971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813476.034016:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788813476.034228:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877bb5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875706583791616:0@lo:400:kworker.0 00000004:00080000:0.0:1788813476.541601:0:8118:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 418784017392ns, next at 419783995598ns, rc = 0 00000100:00100000:2.0:1788813476.541826:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813476.541848:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908749ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583792128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813476.541926:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788813476.542554:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813476.542568:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583792128 00000100:00100000:0.0:1788813476.542576:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583792128 00000100:00100000:0.0:1788813476.542659:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788813476.542669:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bb5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1875706583792128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788813476.542708:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813476.542772:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bb5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1875706583792128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813476.542778:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788813476.542940:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908749ac2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583792128:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1788813476.605023:0:11711:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788813476.605034:0:11711:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788813476.605229:0:11711:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1788813476.605238:0:11711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788813476.605442:0:11711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773c75c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11711:1875706583792256:192.168.204.47@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788813476.606273:0:11711:0:(client.c:2716:ptlrpc_set_wait()) set ffff908781d18cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813476.614676:0:11711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773c75c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11711:1875706583792256:192.168.204.47@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788813476.615618:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813476.615841:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562832768 00000100:00100000:2.0:1788813476.615863:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562832768 00000100:00100000:2.0:1788813476.615935:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 214 00000100:00100000:2.0:1788813476.615946:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+60:11609:x1875706562832768:12345-192.168.204.47@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788813476.615979:0:5851:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788813476.616172:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+60:11609:x1875706562832768:12345-192.168.204.47@tcp:53:lhsmtool_posix.0 Request processed in 226us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813476.616181:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 214 00000100:00080000:1.0:1788813476.616427:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813476.630842:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813476.631107:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562832896 00000100:00100000:3.0:1788813476.631118:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562832896 00000100:00100000:3.0:1788813476.631199:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 215 00000100:00100000:3.0:1788813476.631210:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+60:11609:x1875706562832896:12345-192.168.204.47@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788813476.631301:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95e00/0x6d74dbab2ddb264f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631320:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95e00/0x6d74dbab2ddb264f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631334:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95e00/0x6d74dbab2ddb264f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631355:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95a00/0x6d74dbab2ddb2656 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631361:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95a00/0x6d74dbab2ddb2656 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631368:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95a00/0x6d74dbab2ddb2656 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631393:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb265d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631401:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb265d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631406:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb265d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813476.631442:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788813476.631446:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813476.631458:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb265d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631467:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95e00/0x6d74dbab2ddb264f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631478:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95e00/0x6d74dbab2ddb264f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631485:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95e00/0x6d74dbab2ddb264f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631491:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c95e00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813476.631495:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95e00/0x6d74dbab2ddb264f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631503:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95e00/0x6d74dbab2ddb264f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631513:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff908743ce0800) 00010000:00010000:3.0:1788813476.631516:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813476.631520:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95e00/0x6d74dbab2ddb264f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631526:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95e00/0x6d74dbab2ddb264f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631537:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95a00/0x6d74dbab2ddb2656 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631543:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95a00/0x6d74dbab2ddb2656 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631549:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95a00/0x6d74dbab2ddb2656 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631553:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c95a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813476.631560:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95a00/0x6d74dbab2ddb2656 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631566:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95a00/0x6d74dbab2ddb2656 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631572:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff908745acac00) 00010000:00010000:3.0:1788813476.631574:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813476.631576:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95a00/0x6d74dbab2ddb2656 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631615:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95a00/0x6d74dbab2ddb2656 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631630:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb265d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631635:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb265d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631641:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb265d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631645:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c94600 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813476.631648:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb265d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631654:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb265d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631661:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:3.0:1788813476.631663:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813476.631673:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb265d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.631679:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb265d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813476.631753:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+60:11609:x1875706562832896:12345-192.168.204.47@tcp:34:lhsmtool_posix.0 Request processed in 544us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813476.631762:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 215 00000100:00100000:0.0:1788813476.634733:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813476.634839:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562833152 00000100:00100000:2.0:1788813476.634849:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562833152 00000100:00100000:2.0:1788813476.634908:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 216 00000100:00100000:2.0:1788813476.634917:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+60:11609:x1875706562833152:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813476.634940:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813476.634961:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2664 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484118 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.635057:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb266b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.635072:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb266b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.635083:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb266b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813476.635095:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788813476.635200:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb266b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.635209:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb266b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.635230:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb266b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.635237:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813476.635241:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb266b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.635249:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb266b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.635261:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:2.0:1788813476.635264:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788813476.635269:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb266b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.635275:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb266b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.635320:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2664 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484118 expref: 62 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.635330:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff908743ce0800) 00010000:00010000:2.0:1788813476.635333:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813476.635336:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2664 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484118 expref: 62 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.635345:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369a00, rc 0) 00000100:00100000:2.0:1788813476.635412:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749ac2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+61:11609:x1875706562833152:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 495us (696us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1788813476.635429:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 216 00000100:00100000:1.0:1788813476.642844:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813476.643055:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562833280 00000100:00100000:0.0:1788813476.643066:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562833280 00000100:00100000:0.0:1788813476.643122:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 217 00000100:00100000:0.0:1788813476.643131:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+61:11609:x1875706562833280:12345-192.168.204.47@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788813476.643178:0:8269:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788813476.643280:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+61:11609:x1875706562833280:12345-192.168.204.47@tcp:53:lhsmtool_posix.0 Request processed in 150us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813476.643288:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 217 00000100:00100000:1.0:1788813476.651646:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813476.651729:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562833536 00000100:00100000:2.0:1788813476.651740:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562833536 00000100:00100000:2.0:1788813476.651814:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 218 00000100:00100000:2.0:1788813476.651825:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+61:11609:x1875706562833536:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813476.651847:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813476.651851:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788813476.651879:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368800/0x6d74dbab2ddb2609 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840fc expref: 61 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.651900:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:2.0:1788813476.651905:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813476.651917:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2679 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e48411f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788813476.652337:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1788813476.652521:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2680 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.652535:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2680 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.652546:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2680 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.652658:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2679 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48411f expref: 63 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.652693:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2680 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48411f expref: 62 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.652701:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff908743ce0e00) 00010000:00010000:2.0:1788813476.652704:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813476.652707:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368000, rc 0) 00000100:00100000:2.0:1788813476.652781:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+62:11609:x1875706562833536:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 957us (1142us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788813476.652789:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 218 00000100:00100000:1.0:1788813476.656681:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813476.656763:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562833792 00000100:00100000:0.0:1788813476.656774:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562833792 00000100:00100000:0.0:1788813476.656845:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 219 00000100:00100000:0.0:1788813476.656856:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+62:11609:x1875706562833792:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788813476.656917:0:8269:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813476.656946:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2680 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48411f expref: 62 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.656966:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff908743ce0e00) 00010000:00010000:0.0:1788813476.656979:0:8269:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788813476.657006:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb268e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.657021:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb268e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.657030:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb268e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.657097:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2695 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xa1268b2b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.657105:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2695 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa1268b2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.657131:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2695 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa1268b2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.657246:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb268e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.657255:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb268e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.657261:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb268e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.657266:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813476.657270:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb268e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.657277:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb268e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.657285:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:0.0:1788813476.657288:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813476.657291:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb268e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.657297:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb268e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.657306:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2695 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa1268b2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.657316:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2695 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa1268b2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.657397:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2695 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa1268b2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.657408:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740030a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813476.657411:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2695 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa1268b2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.657743:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2695 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa1268b2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.657753:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xa1268b2b (ffff90874a4cbb00) 00010000:00010000:0.0:1788813476.657755:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813476.657758:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2695 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa1268b2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.657764:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740030a00/0x6d74dbab2ddb2695 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa1268b2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813476.657915:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+61:11609:x1875706562833792:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 Request processed in 1058us (1242us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788813476.657923:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 219 00000100:00100000:1.0:1788813476.667686:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813476.667899:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562833920 00000100:00100000:3.0:1788813476.667911:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562833920 00000100:00100000:3.0:1788813476.667980:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 220 00000100:00100000:3.0:1788813476.667992:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+61:11609:x1875706562833920:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813476.668014:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813476.668042:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb269c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484126 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.668079:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95a00/0x6d74dbab2ddb26a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.668093:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95a00/0x6d74dbab2ddb26a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.668106:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95a00/0x6d74dbab2ddb26a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.668225:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb269c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484126 expref: 63 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.668246:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95a00/0x6d74dbab2ddb26a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484126 expref: 62 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.668262:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff908745acac00) 00010000:00010000:3.0:1788813476.668265:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788813476.668269:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c95a00, rc 0) 00000100:00100000:3.0:1788813476.668330:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+62:11609:x1875706562833920:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 340us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813476.668336:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 220 00000100:00100000:1.0:1788813476.685190:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813476.685469:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562834176 00000100:00100000:2.0:1788813476.685481:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562834176 00000100:00100000:2.0:1788813476.685550:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 221 00000100:00100000:2.0:1788813476.685561:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+62:11609:x1875706562834176:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788813476.685707:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb26aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.685726:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb26aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.685739:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb26aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788813476.686018:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:2.0:1788813476.686110:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e3ca821 reply state 000000007d265018 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb26aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813476.686120:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788813476.686474:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+64:11609:x1875706562834176:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 Request processed in 912us (1292us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1788813476.686482:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 221 00010000:00010000:0.0:1788813476.690268:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb26aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.690286:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb26aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.690303:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb26aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.690339:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813476.690345:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb26aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.690354:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb26aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.690370:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff908745acac00) 00010000:00010000:0.0:1788813476.690373:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788813476.690377:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb26aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.690383:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb26aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813476.692899:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813476.693235:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562834304 00000100:00100000:3.0:1788813476.693246:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562834304 00000100:00100000:3.0:1788813476.693332:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 222 00000100:00100000:3.0:1788813476.693343:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+63:11609:x1875706562834304:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813476.693369:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813476.693391:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb26b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e48412d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.693454:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb26b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48412d expref: 64 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.693469:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb26b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48412d expref: 64 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.693489:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff908745acac00) 00010000:00010000:3.0:1788813476.693492:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813476.693496:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c94600, rc 0) 00000100:00100000:3.0:1788813476.693560:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+64:11609:x1875706562834304:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 220us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813476.693632:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 222 00000100:00100000:1.0:1788813476.700790:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813476.700893:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562834432 00000100:00100000:2.0:1788813476.700907:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562834432 00000100:00100000:2.0:1788813476.700988:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 62 00000100:00100000:2.0:1788813476.700998:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+9:2359:x1875706562834432:12345-192.168.204.47@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788813476.701293:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774396a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+10:2359:x1875706562834432:12345-192.168.204.47@tcp:2:lhsmtool_posix.0 Request processed in 295us (512us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788813476.701301:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 62 00000100:00080000:1.0:1788813476.701942:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788813476.706410:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813476.706544:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562834688 00000100:00100000:3.0:1788813476.706554:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562834688 00000100:00100000:3.0:1788813476.706639:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 60 00000100:00100000:3.0:1788813476.706649:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+64:11609:x1875706562834688:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788813476.706896:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+65:11609:x1875706562834688:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 Request processed in 247us (495us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1788813476.706904:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 60 00000100:00100000:0.0:1788813476.709920:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813476.710013:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562834944 00000100:00100000:3.0:1788813476.710022:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562834944 00000100:00100000:3.0:1788813476.710099:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 223 00000100:00100000:3.0:1788813476.710115:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+65:11609:x1875706562834944:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788813476.710235:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+65:11609:x1875706562834944:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 Request processed in 127us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813476.710243:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 223 00000100:00100000:1.0:1788813476.714844:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813476.715634:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562835072 00000100:00100000:3.0:1788813476.715647:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562835072 00000100:00100000:3.0:1788813476.715713:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 224 00000100:00100000:3.0:1788813476.715723:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+65:11609:x1875706562835072:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813476.715743:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813476.715763:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95e00/0x6d74dbab2ddb26b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484134 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.715863:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb26bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.715896:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb26bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.715907:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb26bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813476.715948:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813476.715970:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb26bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.715999:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95e00/0x6d74dbab2ddb26b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484134 expref: 67 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.716018:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb26bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484134 expref: 66 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.716026:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff908745acac00) 00010000:00010000:3.0:1788813476.716029:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788813476.716033:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c94a00, rc 0) 00000100:00100000:3.0:1788813476.716090:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+66:11609:x1875706562835072:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 368us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813476.716097:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 224 00000100:00100000:1.0:1788813476.720094:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813476.720175:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562835200 00000100:00100000:2.0:1788813476.720186:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562835200 00000100:00100000:2.0:1788813476.720238:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 63 00000100:00100000:2.0:1788813476.720248:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+10:2360:x1875706562835200:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813476.720267:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813476.720288:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1115ad4/0x6d74dbab2ddb26c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e48413b expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788813476.720333:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f20a5, blocks: 0x1 00010000:00010000:2.0:1788813476.720353:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=418s v=(0 0) 00010000:00010000:2.0:1788813476.720357:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813476.720366:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1115ad4/0x6d74dbab2ddb26c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48413b expref: 11 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.720382:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e1115ad4/0x6d74dbab2ddb26c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48413b expref: 11 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.720414:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368800, rc 0) 00000100:00100000:2.0:1788813476.720475:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+11:2360:x1875706562835200:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 227us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813476.720482:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 63 00000100:00100000:0.0:1788813476.730468:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813476.730663:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562835456 00000100:00100000:3.0:1788813476.730672:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562835456 00000100:00100000:3.0:1788813476.730832:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 225 00000100:00100000:3.0:1788813476.730843:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fbca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+66:11609:x1875706562835456:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788813476.730968:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fbca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+66:11609:x1875706562835456:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 Request processed in 127us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813476.730993:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 225 00000100:00100000:1.0:1788813476.740433:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813476.740564:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562835584 00000100:00100000:2.0:1788813476.740576:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562835584 00000100:00100000:2.0:1788813476.741961:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 64 00000100:00100000:2.0:1788813476.741974:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+11:11609:x1875706562835584:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813476.741994:0:8270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813476.742015:0:8270:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b915df3d/0x6d74dbab2ddb26cd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484142 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.742053:0:8270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1115ad4/0x6d74dbab2ddb26c6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48413b expref: 12 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.742062:0:8270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813476.742066:0:8270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788813476.742071:0:8270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b915df3d/0x6d74dbab2ddb26cd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484142 expref: 12 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.742104:0:8270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e1115ad4/0x6d74dbab2ddb26c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48413b expref: 12 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.742119:0:8270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e1115ad4/0x6d74dbab2ddb26c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48413b expref: 12 pid: 6705 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813476.742160:0:8270:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877bb5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8270:1875706583792384:192.168.204.47@tcp:104: 00000100:00100000:2.0:1788813476.742736:0:8270:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876e623d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813476.751760:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813476.752341:0:8270:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877bb5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8270:1875706583792384:192.168.204.47@tcp:104: 00010000:00010000:2.0:1788813476.752381:0:8270:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b915df3d/0x6d74dbab2ddb26cd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484142 expref: 12 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.752403:0:8270:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369a00, rc 0) 00000100:00100000:2.0:1788813476.752456:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+12:11609:x1875706562835584:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 10485us (12036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813476.752465:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 64 00000100:00100000:0.0:1788813476.752701:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562835712 00000100:00100000:0.0:1788813476.752710:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562835712 00010000:00010000:0.0:1788813476.752744:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e1115ad4/0x6d74dbab2ddb26c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48413b expref: 12 pid: 6705 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813476.752777:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 80 00000100:00100000:0.0:1788813476.752794:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908758739050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e90f6370-8c16-4659-9369-1cd146993b4c+12:2359:x1875706562835712:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813476.752820:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813476.752843:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e1115ad4/0x6d74dbab2ddb26c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48413b expref: 12 pid: 6705 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.752879:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e1115ad4/0x6d74dbab2ddb26c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48413b expref: 12 pid: 6705 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.752900:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1115ad4/0x6d74dbab2ddb26c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48413b expref: 12 pid: 6705 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.752914:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813476.752918:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813476.752926:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b915df3d/0x6d74dbab2ddb26cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484142 expref: 11 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.752934:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b915df3d/0x6d74dbab2ddb26cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484142 expref: 11 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.752966:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b915df3d/0x6d74dbab2ddb26cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484142 expref: 11 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813476.752980:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877fb02680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5836:1875706583792512:192.168.204.47@tcp:105: 00000100:00100000:0.0:1788813476.753037:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876ea79a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813476.759417:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813476.759729:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562835840 00000100:00100000:3.0:1788813476.759739:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562835840 00002000:00100000:3.0:1788813476.759818:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff90877fb00380 x1875706562835840/t0(0) o4->e90f6370-8c16-4659-9369-1cd146993b4c@192.168.204.47@tcp:292/0 lens 504/0 e 0 to 0 dl 1788813487 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788813476.759829:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90877fb00380 with x1875706562835840 ext(0->12) 00002000:00010000:3.0:1788813476.759836:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90877fb00380 00000100:00100000:3.0:1788813476.759867:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 6 00000100:00100000:3.0:1788813476.759878:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e90f6370-8c16-4659-9369-1cd146993b4c+12:2359:x1875706562835840:12345-192.168.204.47@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788813476.760383:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e90f6370-8c16-4659-9369-1cd146993b4c+14:2359:x1875706562835840:12345-192.168.204.47@tcp:4:lhsmtool_posix.0 Request processed in 504us (973us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788813476.760391:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 6 00002000:00100000:3.0:1788813476.760398:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff90877fb00380 x1875706562835840/t4294967320(0) o4->e90f6370-8c16-4659-9369-1cd146993b4c@192.168.204.47@tcp:292/0 lens 504/448 e 0 to 0 dl 1788813487 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788813476.760405:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90877fb00380 with x1875706562835840 ext(0->12) 00002000:00010000:3.0:1788813476.760409:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90877fb00380 00000100:00100000:1.0:1788813476.762337:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877fb02680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5836:1875706583792512:192.168.204.47@tcp:105: 00010000:00010000:1.0:1788813476.762369:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813476.762438:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908758739050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e90f6370-8c16-4659-9369-1cd146993b4c+13:2359:x1875706562835712:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 9652us (10686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813476.762453:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 80 00000100:00100000:0.0:1788813476.769186:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813476.769440:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562835968 00000100:00100000:3.0:1788813476.769451:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562835968 00000100:00100000:3.0:1788813476.769529:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 226 00000100:00100000:3.0:1788813476.769541:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+66:11609:x1875706562835968:12345-192.168.204.47@tcp:44:lhsmtool_posix.0 00000004:00080000:0.0:1788813476.840059:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000001:00080000:0.0:1788813476.840086:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967501 is committed 00000004:00080000:0.0:1788813476.840102:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:2.0:1788813476.840316:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788813476.840347:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877bb5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583792640:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788813476.840413:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813476.840475:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583792640 00000100:00100000:2.0:1788813476.840483:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583792640 00000100:00100000:2.0:1788813476.840529:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788813476.840539:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bb5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1875706583792640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788813476.840566:0:6705:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1788813476.840621:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.840641:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb2496 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840a1 expref: 12 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.840670:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1788813476.840674:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813476.840679:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26d4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.840708:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb2496 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840a1 expref: 12 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.840740:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb2496 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840a1 expref: 12 pid: 6704 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813476.840753:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877bb5ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1875706583792768:192.168.204.47@tcp:104: 00000100:00100000:2.0:1788813476.840825:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876e623d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813476.842975:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+61:11609:x1875706562835968:12345-192.168.204.47@tcp:44:lhsmtool_posix.0 Request processed in 73427us (73790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813476.842988:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 226 00000100:00100000:2.0:1788813476.843373:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877bb5ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1875706583792768:192.168.204.47@tcp:104: 00010000:00010000:2.0:1788813476.843401:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813476.846397:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813476.847125:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562836096 00000100:00100000:3.0:1788813476.847137:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562836096 00000100:00100000:3.0:1788813476.847199:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 66 00000100:00100000:3.0:1788813476.847304:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bb5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+13:2360:x1875706562836096:12345-192.168.204.47@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788813476.848859:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813476.848897:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562836224 00000100:00100000:2.0:1788813476.848906:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562836224 00010000:00010000:2.0:1788813476.848944:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb2496 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840a1 expref: 14 pid: 6704 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813476.849003:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 81 00000100:00100000:2.0:1788813476.849012:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bb5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+14:2360:x1875706562836224:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813476.849026:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813476.849031:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb2496 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840a1 expref: 14 pid: 6704 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.849043:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb2496 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840a1 expref: 14 pid: 6704 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.849068:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000281981a8/0x6d74dbab2ddb2496 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4840a1 expref: 14 pid: 6704 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.849083:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813476.849088:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813476.849105:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.849115:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26d4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.849142:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813476.849191:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bb5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+13:2360:x1875706562836224:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 181us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813476.849199:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 81 00010000:00010000:2.0:1788813476.849438:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.849449:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.849459:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.849467:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.849482:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788813476.850016:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bb5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3321:x1875706583792640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9477us (9601us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788813476.850025:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:2.0:1788813476.850089:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90877bb5e680/2, rc 0, transno 4294967321 00000100:00100000:2.0:1788813476.850110:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877bb5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583792640:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788813476.852576:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813476.852606:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813476.852620:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368e00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813476.852640:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813476.852653:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813476.852676:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813476.852683:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813476.852706:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813476.852707:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813476.852709:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813476.852844:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908774394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583792896:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788813476.852908:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813476.853630:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583792896 00000100:00100000:3.0:1788813476.853639:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583792896 00000100:00100000:3.0:1788813476.853856:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788813476.853867:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3321:x1875706583792896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788813476.853897:0:6706:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1788813476.853930:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f20a3, atime: 0x6a9f20a3, ctime: 0x6a9f20a3, blocks: 0x1 00010000:00010000:3.0:1788813476.853938:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000215e2c89/0x6d74dbab2ddb26db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.853951:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1788813476.853956:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813476.853962:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000215e2c89/0x6d74dbab2ddb26db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.853979:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000215e2c89/0x6d74dbab2ddb26db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.853989:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000215e2c89/0x6d74dbab2ddb26db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.853996:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000215e2c89/0x6d74dbab2ddb26db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.854039:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:0.0:1788813476.854264:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90876ea79000 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788813476.854277:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90876eb58d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90876ea79540 00000020:00080000:0.0:1788813476.854281:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90876eb58300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90877c369800 00000004:00080000:0.0:1788813476.854331:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:0.0:1788813476.854346:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:0.0:1788813476.854361:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000001:00080000:0.0:1788813476.854414:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000020:00080000:0.0:1788813476.854444:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90877c234f00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788813476.854447:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90876e584c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90877c2346c0 00000020:00080000:0.0:1788813476.854449:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90876e584800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90877fc08000 00000001:00080000:0.0:1788813476.854456:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:0.0:1788813476.854485:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1788813476.854665:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:1.0:1788813476.854907:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813476.854916:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000215e2c89/0x6d74dbab2ddb26db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813476.854925:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c95e00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813476.854929:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000215e2c89/0x6d74dbab2ddb26db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813476.854939:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000215e2c89/0x6d74dbab2ddb26db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813476.854969:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000215e2c89/0x6d74dbab2ddb26db lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813476.854976:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000215e2c89/0x6d74dbab2ddb26db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813476.854993:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813476.854995:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813476.854996:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813476.856027:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3321:x1875706583792896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2156us (3112us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788813476.856039:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:1.0:1788813476.856045:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff908774394700/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788813476.856053:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908774394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583792896:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788813476.898167:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bb5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+12:2360:x1875706562836096:12345-192.168.204.47@tcp:16:lhsmtool_posix.0 Request processed in 50856us (51770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813476.898180:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 66 00000001:00080000:1.0:1788813476.898261:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:1.0:1788813476.898274:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:1.0:1788813476.898288:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:1.0:1788813476.898294:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:2.0:1788813476.902678:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813476.902792:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562836480 00000100:00100000:3.0:1788813476.902812:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562836480 00000100:00100000:2.0:1788813476.906130:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 227 00000100:00100000:2.0:1788813476.906155:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bb5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+20:11609:x1875706562836480:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788813476.906209:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813476.906240:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb26bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484134 expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.906260:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff908745acac00) 00010000:00010000:2.0:1788813476.906278:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813476.906309:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb26e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.906323:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb26e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.906333:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb26e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788813476.906575:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba9886cc reply state 00000000b0cf238c transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb26e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813476.906624:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788813476.906733:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bb5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+21:11609:x1875706562836480:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 Request processed in 589us (4062us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788813476.906740:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 227 00000100:00100000:0.0:1788813476.913084:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00010000:00010000:1.0:1788813476.913367:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb26e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813476.913382:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb26e2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813476.913389:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb26e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813476.913395:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813476.913400:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb26e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813476.913428:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb26e2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813476.913446:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff908745acac00) 00010000:00010000:1.0:1788813476.913449:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813476.913454:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb26e2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813476.913461:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb26e2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813476.913640:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562836608 00000100:00100000:3.0:1788813476.913651:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562836608 00000100:00100000:3.0:1788813476.913717:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 68 00000100:00100000:3.0:1788813476.913736:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+7:2359:x1875706562836608:12345-192.168.204.47@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788813476.914083:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788813476.914087:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788813476 00002000:00010000:3.0:1788813476.914090:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788813475 00002000:00010000:3.0:1788813476.914092:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788813477 -> 1788813476 00002000:00010000:3.0:1788813476.914094:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788813476.914156:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+8:2359:x1875706562836608:12345-192.168.204.47@tcp:2:lhsmtool_posix.0 Request processed in 429us (1082us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788813476.914165:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 68 00000100:00100000:2.0:1788813476.924849:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813476.924948:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562836864 00000100:00100000:1.0:1788813476.924959:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562836864 00000100:00100000:1.0:1788813476.925019:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 228 00000100:00100000:1.0:1788813476.925030:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bb5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+20:11609:x1875706562836864:12345-192.168.204.47@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788813476.925097:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb26e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813476.925115:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95a00/0x6d74dbab2ddb26a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484126 expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813476.925124:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb26e9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813476.925153:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95a00/0x6d74dbab2ddb26a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484126 expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813476.925167:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95a00/0x6d74dbab2ddb26a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484126 expref: 20 pid: 5850 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813476.925198:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908774396300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1875706583793024:192.168.204.47@tcp:104: 00000100:00100000:1.0:1788813476.925283:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff908781d18cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813476.927902:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908774396300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5851:1875706583793024:192.168.204.47@tcp:104: 00010000:00010000:2.0:1788813476.927934:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb26e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813476.931996:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813476.932098:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562836992 00000100:00100000:1.0:1788813476.932107:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562836992 00010000:00010000:1.0:1788813476.932145:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95a00/0x6d74dbab2ddb26a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484126 expref: 21 pid: 5850 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813476.932187:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 82 00000100:00100000:1.0:1788813476.932196:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bb5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+21:2359:x1875706562836992:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813476.932210:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813476.932216:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95a00/0x6d74dbab2ddb26a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484126 expref: 21 pid: 5850 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813476.932229:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95a00/0x6d74dbab2ddb26a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484126 expref: 21 pid: 5850 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813476.932249:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95a00/0x6d74dbab2ddb26a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484126 expref: 21 pid: 5850 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813476.932264:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff908745acac00) 00010000:00010000:1.0:1788813476.932269:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb26e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813476.932280:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb26e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813476.932305:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb26e9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813476.932339:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813476.932396:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bb5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+20:2359:x1875706562836992:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 200us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813476.932403:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 82 00010000:00010000:2.0:1788813476.932828:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb26e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.932837:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb26e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.932865:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb26e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.932882:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb26e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.932890:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb26e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.932896:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813476.932900:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb26e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.932907:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb26e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.932916:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff908745acac00) 00010000:00010000:2.0:1788813476.932918:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788813476.932922:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb26e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.932928:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73400/0x6d74dbab2ddb26e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813476.932968:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bb5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+19:11609:x1875706562836864:12345-192.168.204.47@tcp:55:lhsmtool_posix.0 Request processed in 7940us (8129us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788813476.932975:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 228 00000100:00100000:1.0:1788813476.941007:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813476.941107:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562837120 00000100:00100000:2.0:1788813476.941117:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562837120 00000100:00100000:2.0:1788813476.941176:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 69 00000100:00100000:2.0:1788813476.941186:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+8:2360:x1875706562837120:12345-192.168.204.47@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788813476.941230:0:8270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26f0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.941262:0:8270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b915df3d/0x6d74dbab2ddb26cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484142 expref: 8 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.941271:0:8270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788813476.941275:0:8270:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788813476.941280:0:8270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26f0 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.941316:0:8270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b915df3d/0x6d74dbab2ddb26cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484142 expref: 8 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.941331:0:8270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b915df3d/0x6d74dbab2ddb26cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484142 expref: 8 pid: 8270 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813476.941346:0:8270:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877bb5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8270:1875706583793152:192.168.204.47@tcp:104: 00000100:00100000:2.0:1788813476.941430:0:8270:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876e623180 going to sleep for 11 seconds 00000100:00100000:3.0:1788813476.945155:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813476.945857:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562837248 00000100:00100000:0.0:1788813476.945868:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562837248 00000100:00100000:2.0:1788813476.945885:0:8270:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877bb5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8270:1875706583793152:192.168.204.47@tcp:104: 00010000:00010000:2.0:1788813476.945913:0:8270:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26f0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.945972:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b915df3d/0x6d74dbab2ddb26cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484142 expref: 9 pid: 8270 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813476.946014:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 83 00000100:00100000:0.0:1788813476.946024:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e927480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+9:2360:x1875706562837248:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813476.946039:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813476.946062:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b915df3d/0x6d74dbab2ddb26cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484142 expref: 9 pid: 8270 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.946076:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b915df3d/0x6d74dbab2ddb26cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484142 expref: 9 pid: 8270 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.946117:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b915df3d/0x6d74dbab2ddb26cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484142 expref: 9 pid: 8270 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.946133:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813476.946137:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813476.946143:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26f0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.946152:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26f0 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813476.946183:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813476.946318:0:8270:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26f0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.946328:0:8270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26f0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.946361:0:8270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26f0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.946371:0:8270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26f0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.946379:0:8270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.946385:0:8270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368e00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:2.0:1788813476.946389:0:8270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.946398:0:8270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.946411:0:8270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26f0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.946419:0:8270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c12aee88/0x6d74dbab2ddb26f0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813476.946494:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e927480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e90f6370-8c16-4659-9369-1cd146993b4c+8:2360:x1875706562837248:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 469us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813476.946502:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 83 00000100:00100000:2.0:1788813476.952933:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774396680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+7:2360:x1875706562837120:12345-192.168.204.47@tcp:1:lhsmtool_posix.0 Request processed in 11734us (11921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813476.952948:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 69 00000100:00100000:0.0:1788813476.958744:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813476.958840:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562837504 00000100:00100000:2.0:1788813476.958853:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562837504 00000100:00100000:2.0:1788813476.958916:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 229 00000100:00100000:2.0:1788813476.958927:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fb02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+19:11609:x1875706562837504:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788813476.959014:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb26f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.959032:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb26f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.959044:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb26f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.959259:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb26fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.959270:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb26b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48412d expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.959278:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb26fe lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.959489:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb26b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48412d expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813476.959503:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb26b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48412d expref: 20 pid: 5850 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813476.959516:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877bb5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1875706583793280:192.168.204.47@tcp:104: 00000100:00100000:2.0:1788813476.959678:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876e623180 going to sleep for 11 seconds 00000100:00100000:1.0:1788813476.963245:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813476.963470:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562837632 00000100:00100000:3.0:1788813476.963481:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562837632 00010000:00010000:3.0:1788813476.963520:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb26b1 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48412d expref: 21 pid: 5850 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813476.963574:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 84 00000100:00100000:3.0:1788813476.963605:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774395880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+21:2360:x1875706562837632:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813476.963621:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813476.963628:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb26b1 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48412d expref: 21 pid: 5850 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.963640:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb26b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48412d expref: 21 pid: 5850 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.963662:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff908745acac00) 00010000:00010000:3.0:1788813476.963667:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb26fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.963678:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb26fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.963686:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb26fe lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.963704:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813476.963761:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774395880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+21:2360:x1875706562837632:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 158us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813476.963768:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 84 00010000:00010000:2.0:1788813476.966756:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb26b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48412d expref: 20 pid: 5850 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813476.966781:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877bb5e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1875706583793280:192.168.204.47@tcp:104: 00010000:00010000:2.0:1788813476.966821:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb26fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.966938:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb26fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.966947:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb26fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788813476.967211:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1788813476.967487:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1788813476.967534:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1788813476.967713:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e925500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5849:1875706583793408:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788813476.967776:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813476.967826:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dff540 going to sleep for 11 seconds 00000100:00100000:1.0:1788813476.968005:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583793408 00000100:00100000:1.0:1788813476.968011:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583793408 00000100:00100000:1.0:1788813476.968065:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788813476.968073:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1875706583793408:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788813476.968166:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1875706583793408:12345-0@lo:1000:mdt00_000.0 Request processed in 93us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813476.968173:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788813476.968470:0:5849:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:3.0:1788813476.968477:0:5849:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:3.0:1788813476.968497:0:5849:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff90877bb5e680 x1875706583792640/t4294967321(4294967321) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788813492 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813476.968509:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e925500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5849:1875706583793408:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788813476.969018:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1788813476.969082:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e925500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5849:1875706583793536:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788813476.969295:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813476.969318:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dff3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813476.969622:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583793536 00000100:00100000:1.0:1788813476.969628:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583793536 00000100:00100000:1.0:1788813476.969668:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788813476.969676:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1875706583793536:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788813476.969882:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5849:x1875706583793536:12345-0@lo:1000:mdt00_000.0 Request processed in 207us (586us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788813476.969890:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788813476.970022:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e925500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5849:1875706583793536:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788813476.970052:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb26fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.970063:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb26fe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.970070:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb26fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.970076:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813476.970081:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb26fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.970102:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb26fe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.970117:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff908745acac00) 00010000:00010000:3.0:1788813476.970120:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813476.970125:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb26fe lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.970131:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb26fe lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.970160:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2641 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.970167:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2641 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.970173:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2641 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.970178:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369e00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813476.970181:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2641 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.970187:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2641 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.970194:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:3.0:1788813476.970197:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788813476.970203:0:5849:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb2648 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484111 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.970225:0:5849:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb2648 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484111 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.970234:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb2648 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484111 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.970261:0:5849:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb2648 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484111 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813476.970274:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e925880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1875706583793664:192.168.204.47@tcp:105: 00000100:00100000:3.0:1788813476.970464:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dff3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813476.973560:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813476.973670:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562837760 00000100:00100000:2.0:1788813476.973680:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562837760 00000100:00100000:2.0:1788813476.973737:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 61 00000100:00100000:2.0:1788813476.973748:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+24:11608:x1875706562837760:12345-192.168.204.47@tcp:49:lfs.0 00000100:00100000:2.0:1788813476.973881:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+24:11608:x1875706562837760:12345-192.168.204.47@tcp:49:lfs.0 Request processed in 134us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813476.973889:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 61 00000100:00100000:3.0:1788813476.975457:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e925880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5849:1875706583793664:192.168.204.47@tcp:105: 00010000:00010000:3.0:1788813476.975497:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2641 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.975508:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb2641 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.975544:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2705 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.975560:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2705 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.975572:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2705 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.975612:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2705 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.975637:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2705 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.975644:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2705 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.975651:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c94000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813476.975656:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2705 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.975664:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2705 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.975676:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:3.0:1788813476.975680:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813476.975684:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2705 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.975691:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2705 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.975701:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb26f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.975707:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb26f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.975713:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb26f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.975719:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813476.975727:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb26f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.975733:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb26f7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.975742:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:3.0:1788813476.975745:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788813476.975747:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb26f7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.975754:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb26f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813476.976066:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fb02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+23:11609:x1875706562837504:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 Request processed in 17138us (17341us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1788813476.976077:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 229 00000020:00080000:3.0:1788813476.976082:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788813476.976375:0:11711:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788813476.976380:0:11711:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788813476.976895:0:11711:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788813476.976905:0:11711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788813476.980162:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813476.980200:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813476.980296:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562838272 00000100:00100000:0.0:1788813476.980305:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562838272 00000100:00100000:0.0:1788813476.980372:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 230 00000100:00100000:0.0:1788813476.980382:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+23:11608:x1875706562838272:12345-192.168.204.47@tcp:58:lfs.0 00000040:00080000:0.0:1788813476.980769:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788813476.980864:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+23:11608:x1875706562838272:12345-192.168.204.47@tcp:58:lfs.0 Request processed in 483us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813476.980872:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 230 00000100:00100000:3.0:1788813476.981041:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562838016 00000100:00100000:3.0:1788813476.981047:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562838016 00000100:00100000:3.0:1788813476.981081:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 62 00000100:00100000:3.0:1788813476.981088:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874adab450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+23:11609:x1875706562838016:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788813476.981575:0:5853:0:(mdd_object.c:4181:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788813476.981686:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1788813476.981727:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb270c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.981743:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb270c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.981761:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb270c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.981776:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb270c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.981783:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb270c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.981788:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb270c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.981819:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788813476.981887:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874adab450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+25:11609:x1875706562838016:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 Request processed in 797us (1733us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1788813476.981894:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 62 00000020:00080000:3.0:1788813476.981898:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788813476.981942:0:7658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813476.981948:0:7658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb270c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.981954:0:7658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c95000 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:3.0:1788813476.981958:0:7658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb270c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.981966:0:7658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb270c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.981978:0:7658:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff908745acac00) 00010000:00010000:3.0:1788813476.981981:0:7658:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788813476.981986:0:7658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb270c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.982001:0:7658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb270c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813476.982015:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813476.982017:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813476.982018:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813477.007823:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813477.007909:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562838400 00000100:00100000:3.0:1788813477.007920:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562838400 00000100:00100000:3.0:1788813477.007980:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 231 00000100:00100000:3.0:1788813477.007991:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+25:11611:x1875706562838400:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:3.0:1788813477.008013:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813477.008033:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb2713 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484149 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813477.008220:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb271a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813477.008236:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb271a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813477.008247:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb271a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813477.008260:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb2721 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813477.008267:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb2721 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813477.008274:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb2721 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813477.008565:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2728 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813477.008678:0:8269:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2633 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48410a expref: 26 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813477.008688:0:8269:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2728 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813477.008737:0:8269:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2633 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48410a expref: 26 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813477.008752:0:8269:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2633 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48410a expref: 26 pid: 8269 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813477.008765:0:8269:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e925880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8269:1875706583793792:192.168.204.47@tcp:104: 00000100:00100000:3.0:1788813477.008861:0:8269:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749dff240 going to sleep for 11 seconds 00000100:00100000:1.0:1788813477.012688:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813477.013111:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562838656 00000100:00100000:2.0:1788813477.013122:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562838656 00000100:00100000:2.0:1788813477.013166:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 63 00000100:00100000:2.0:1788813477.013176:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+27:5599:x1875706562838656:12345-192.168.204.47@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788813477.013418:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+28:5599:x1875706562838656:12345-192.168.204.47@tcp:35:ldlm_bl.0 Request processed in 243us (740us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788813477.013426:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 63 00000100:00100000:3.0:1788813477.015641:0:8269:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e925880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8269:1875706583793792:192.168.204.47@tcp:104: 00010000:00010000:3.0:1788813477.015673:0:8269:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2728 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813477.015781:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813477.015869:0:8477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562838784 00000100:00100000:3.0:1788813477.015876:0:8477:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562838784 00010000:00010000:3.0:1788813477.015909:0:8477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2633 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48410a expref: 28 pid: 8269 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813477.015984:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 85 00000100:00100000:3.0:1788813477.016008:0:8477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774397b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+28:2359:x1875706562838784:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813477.016026:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813477.016033:0:8477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2633 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48410a expref: 28 pid: 8269 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813477.016045:0:8477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2633 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48410a expref: 28 pid: 8269 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813477.016066:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2633 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48410a expref: 28 pid: 8269 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813477.016082:0:8477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:3.0:1788813477.016086:0:8477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2728 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813477.016724:0:8477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2728 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813477.016733:0:8477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2728 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813477.016762:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813477.016828:0:8477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774397b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e90f6370-8c16-4659-9369-1cd146993b4c+27:2359:x1875706562838784:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 818us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813477.016836:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 85 00010000:00010000:1.0:1788813477.017057:0:8269:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2728 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813477.017066:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2728 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813477.017121:0:8269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788813477.017126:0:8269:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813477.017145:0:8269:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2728 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813477.017159:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2728 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813477.017169:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb271a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813477.017176:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb271a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813477.017183:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb271a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813477.017189:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c94000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813477.017193:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb271a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813477.017201:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb271a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813477.017213:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:1.0:1788813477.017225:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813477.017230:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb271a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813477.017236:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb271a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813477.017248:0:8269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb2721 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813477.017254:0:8269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb2721 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813477.017260:0:8269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb2721 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813477.017264:0:8269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c95200 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813477.017267:0:8269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb2721 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813477.017273:0:8269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb2721 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813477.017279:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff908745acac00) 00010000:00010000:1.0:1788813477.017282:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813477.017285:0:8269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb2721 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813477.017302:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb2721 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813477.017345:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb2713 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484149 expref: 27 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813477.017373:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2728 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484149 expref: 26 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813477.017380:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:1.0:1788813477.017382:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813477.017384:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c94c00, rc 0) 00000100:00100000:1.0:1788813477.017427:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+26:11611:x1875706562838400:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 9439us (9613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813477.017435:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 231 00010000:00010000:1.0:1788813477.568982:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788813477.826950:0:12582:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788813477.826959:0:12582:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788813477.827004:0:12582:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788813477.827010:0:12582:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788813478.016547:0:11711:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788813478.016557:0:11711:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788813478.016613:0:11711:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788813478.016619:0:11711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788813478.016772:0:11711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e925880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11711:1875706583793920:192.168.204.47@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788813478.016877:0:11711:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087480f5480 going to sleep for 11 seconds 00000100:00100000:3.0:1788813478.024786:0:11711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e925880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11711:1875706583793920:192.168.204.47@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788813478.027302:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813478.027350:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562838912 00000100:00100000:2.0:1788813478.027366:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562838912 00000100:00100000:2.0:1788813478.027426:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 232 00000100:00100000:2.0:1788813478.027436:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bb5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+26:11623:x1875706562838912:12345-192.168.204.47@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788813478.027470:0:5850:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788813478.027569:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bb5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+26:11623:x1875706562838912:12345-192.168.204.47@tcp:53:lhsmtool_posix.0 Request processed in 134us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813478.027576:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 232 00000100:00080000:2.0:1788813478.027612:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813478.037723:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813478.042484:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562839168 00000100:00100000:2.0:1788813478.042498:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562839168 00000100:00100000:2.0:1788813478.042624:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 233 00000100:00100000:2.0:1788813478.042635:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+26:11623:x1875706562839168:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813478.042655:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813478.042674:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb272f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484150 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813478.042769:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb2736 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813478.042798:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb2736 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813478.042812:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb2736 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813478.042825:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788813478.042952:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369e00/0x6d74dbab2ddb272f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484150 expref: 29 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813478.042992:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb2736 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484150 expref: 28 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813478.043001:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:2.0:1788813478.043004:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813478.043008:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369400, rc 0) 00000100:00100000:2.0:1788813478.043078:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+28:11623:x1875706562839168:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 445us (5535us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788813478.043086:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 233 00000100:00100000:2.0:1788813478.055344:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813478.055400:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813478.055464:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562839424 00000100:00100000:0.0:1788813478.055474:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562839424 00000100:00100000:0.0:1788813478.055532:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 234 00000100:00100000:0.0:1788813478.055542:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bb5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+28:11623:x1875706562839424:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788813478.055662:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb2744 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813478.055681:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb2744 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813478.055692:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb2744 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813478.055893:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb2744 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813478.055901:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb2744 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813478.055908:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb2744 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813478.055915:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813478.055919:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb2744 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813478.055927:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb2744 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813478.055957:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:0.0:1788813478.055961:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788813478.055966:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb2744 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813478.055973:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740031400/0x6d74dbab2ddb2744 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813478.056126:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bb5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+29:11623:x1875706562839424:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 Request processed in 585us (792us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788813478.056134:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 234 00000100:00100000:3.0:1788813478.056375:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562839552 00000100:00100000:3.0:1788813478.056382:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562839552 00000100:00100000:3.0:1788813478.056483:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 17 00000100:00100000:3.0:1788813478.056491:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c0c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+29:2360:x1875706562839552:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813478.056502:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813478.056518:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb2736 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484150 expref: 29 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813478.056530:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:3.0:1788813478.056534:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813478.056568:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c0c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e90f6370-8c16-4659-9369-1cd146993b4c+28:2360:x1875706562839552:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 78us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813478.056575:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 17 00000040:00080000:1.0:1788813478.056868:0:11711:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788813478.056874:0:11711:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788813478.057359:0:11711:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788813478.057369:0:11711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788813478.062211:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813478.062261:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562839808 00000100:00100000:3.0:1788813478.062280:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562839808 00000100:00100000:3.0:1788813478.062356:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 64 00000100:00100000:3.0:1788813478.062368:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+28:11623:x1875706562839808:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788813478.062659:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+29:11623:x1875706562839808:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 Request processed in 292us (456us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788813478.062666:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 64 00010000:00010000:2.0:1788813478.590418:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788813479.152819:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1788813479.152839:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1788813479.152844:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1788813479.612980:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583794048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813479.613159:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813479.613287:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583794048 00000100:00100000:1.0:1788813479.613295:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583794048 00000100:00100000:1.0:1788813479.613364:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788813479.613374:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583794048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788813479.613408:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813479.613455:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583794048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813479.613462:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1788813479.613535:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813479.613716:0:3318:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788813479.613723:0:3318:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1788813479.613770:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff908774394700, transno 4294967310 00000100:00100000:0.0:1788813479.613793:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583794048:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788813479.622608:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788813479.772943:0:12634:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788813479.772954:0:12634:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788813479.772999:0:12634:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788813479.773005:0:12634:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788813480.023183:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813480.023436:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562840064 00000100:00100000:1.0:1788813480.023446:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562840064 00000100:00100000:1.0:1788813480.023515:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 235 00000100:00100000:1.0:1788813480.023526:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+29:11643:x1875706562840064:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:1.0:1788813480.023549:0:8269:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813480.023568:0:8269:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73000/0x6d74dbab2ddb274b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484157 expref: -99 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813480.023684:0:8269:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb2752 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813480.023700:0:8269:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb2752 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813480.023729:0:8269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb2752 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8269 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813480.023750:0:8269:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788813480.023873:0:8269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73000/0x6d74dbab2ddb274b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484157 expref: 32 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813480.023889:0:8269:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb2752 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484157 expref: 31 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813480.023898:0:8269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:1.0:1788813480.023908:0:8269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788813480.023912:0:8269:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908749d72200, rc 0) 00000100:00100000:1.0:1788813480.023966:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+31:11643:x1875706562840064:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 442us (793us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1788813480.023973:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 235 00000100:00080000:2.0:1788813480.024484:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813480.034267:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813480.034342:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562840192 00000100:00100000:3.0:1788813480.034355:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562840192 00000100:00100000:3.0:1788813480.034440:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 236 00000100:00100000:3.0:1788813480.034462:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+31:11643:x1875706562840192:12345-192.168.204.47@tcp:54:lfs.0 00010000:00010000:3.0:1788813480.034526:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb2760 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813480.034545:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb2760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813480.034558:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb2760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813480.034603:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb2760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813480.034611:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb2760 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813480.034618:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb2760 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813480.034624:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c95800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813480.034628:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb2760 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813480.034635:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb2760 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813480.034646:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:3.0:1788813480.034649:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788813480.034653:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb2760 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813480.034658:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb2760 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813480.034824:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e90f6370-8c16-4659-9369-1cd146993b4c+31:11643:x1875706562840192:12345-192.168.204.47@tcp:54:lfs.0 Request processed in 363us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813480.034831:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 236 00000100:00100000:1.0:1788813480.161723:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813480.161852:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562840320 00000100:00100000:3.0:1788813480.161862:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562840320 00000100:00100000:3.0:1788813480.161942:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 70 00000100:00100000:3.0:1788813480.161953:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+7:2362:x1875706562840320:12345-192.168.204.47@tcp:101:cat.0 00010000:00010000:3.0:1788813480.161972:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813480.161996:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d35997a6/0x6d74dbab2ddb2767 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e48415e expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788813480.162024:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9f20a4, atime: 0x6a9f20a3, ctime: 0x6a9f20a4, blocks: 0xb 00010000:00010000:3.0:1788813480.162046:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=422s v=(0 0) 00010000:00010000:3.0:1788813480.162050:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813480.162060:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d35997a6/0x6d74dbab2ddb2767 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48415e expref: 8 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813480.162081:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d35997a6/0x6d74dbab2ddb2767 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48415e expref: 8 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813480.162094:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c94e00, rc 0) 00000100:00100000:3.0:1788813480.162164:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+8:2362:x1875706562840320:12345-192.168.204.47@tcp:101:cat.0 Request processed in 213us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813480.162171:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 70 00000100:00080000:2.0:1788813480.162440:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813480.167541:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813480.167703:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562840448 00000100:00100000:2.0:1788813480.167715:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562840448 00002000:00100000:2.0:1788813480.167776:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff90876e925880 x1875706562840448/t0(0) o3->e90f6370-8c16-4659-9369-1cd146993b4c@192.168.204.47@tcp:296/0 lens 488/0 e 0 to 0 dl 1788813491 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788813480.167787:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90876e925880 with x1875706562840448 ext(0->4095) 00002000:00010000:2.0:1788813480.167793:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90876e925880 00000100:00100000:2.0:1788813480.167828:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 7 00000100:00100000:2.0:1788813480.167838:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e925880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e90f6370-8c16-4659-9369-1cd146993b4c+8:2361:x1875706562840448:12345-192.168.204.47@tcp:3:cat.0 00000100:00100000:2.0:1788813480.168072:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e925880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e90f6370-8c16-4659-9369-1cd146993b4c+8:2361:x1875706562840448:12345-192.168.204.47@tcp:3:cat.0 Request processed in 235us (555us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788813480.168080:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 7 00002000:00100000:2.0:1788813480.168087:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff90876e925880 x1875706562840448/t0(0) o3->e90f6370-8c16-4659-9369-1cd146993b4c@192.168.204.47@tcp:296/0 lens 488/4536 e 0 to 0 dl 1788813491 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788813480.168095:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90876e925880 with x1875706562840448 ext(0->4095) 00002000:00010000:2.0:1788813480.168098:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90876e925880 00010000:00010000:1.0:1788813480.637115:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813480.840476:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813480.840534:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813480.840554:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562840576 00000100:00100000:3.0:1788813480.840565:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562840576 00000100:00100000:2.0:1788813480.840613:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813480.840651:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 297 00000100:00100000:2.0:1788813480.840654:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562840704 00000100:00100000:2.0:1788813480.840660:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562840704 00000100:00100000:3.0:1788813480.840665:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2362:x1875706562840576:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813480.840705:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 97 00000100:00100000:2.0:1788813480.840714:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+5:2361:x1875706562840704:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:3.0:1788813480.840761:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2362:x1875706562840576:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 100us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813480.840764:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+5:2361:x1875706562840704:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 50us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813480.840775:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 297 00000100:00100000:2.0:1788813480.840777:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 97 00000100:00080000:2.0:1788813480.840801:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813480.841019:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562840832 00000100:00100000:0.0:1788813480.841024:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562840832 00000100:00100000:0.0:1788813480.841077:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 163 00000100:00100000:0.0:1788813480.841085:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aa21be5-2246-40d3-8e20-d34501daf545+5:2362:x1875706562840832:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813480.841122:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aa21be5-2246-40d3-8e20-d34501daf545+5:2362:x1875706562840832:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 39us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813480.841128:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 163 00000100:00080000:2.0:1788813480.841740:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788813481.148919:0:11711:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788813481.148929:0:11711:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788813481.148965:0:11711:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788813481.148974:0:11711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788813481.154653:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875706583794432:0@lo:400:kworker.0 00000100:00100000:1.0:1788813481.154740:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813481.154819:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788813481.154826:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583794304:0@lo:400:kworker.0 00000100:00100000:1.0:1788813481.154848:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813481.154865:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583794816:0@lo:400:kworker.0 00000100:00100000:1.0:1788813481.154889:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813481.155043:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908773c75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd1fd158-af17-4a1b-8f0b-82e57114d008:3319:1875706583794176:0@lo:400:kworker.0 00000100:00100000:0.0:1788813481.155087:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813481.155122:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642915880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875706583794688:0@lo:400:kworker.0 00000100:00100000:0.0:1788813481.155144:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813481.155164:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788813481.155169:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583794560:0@lo:400:kworker.0 00000100:00100000:0.0:1788813481.155191:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813481.155222:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583794432 00000100:00100000:0.0:1788813481.155231:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583794432 00000100:00100000:0.0:1788813481.155291:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583794304 00000100:00100000:0.0:1788813481.155295:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583794304 00000100:00100000:0.0:1788813481.155308:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583794688 00000100:00100000:0.0:1788813481.155311:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583794688 00000100:00100000:0.0:1788813481.155327:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788813481.155336:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875706583794432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813481.155387:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875706583794432:12345-0@lo:400:kworker.0 Request processed in 52us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813481.155394:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788813481.155412:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788813481.155418:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583794304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813481.155446:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583794304:12345-0@lo:400:kworker.0 Request processed in 28us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813481.155451:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788813481.155462:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788813481.155467:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875706583794688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813481.155495:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875706583794688:12345-0@lo:400:kworker.0 Request processed in 28us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813481.155511:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788813481.155531:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583794816 00000100:00100000:0.0:1788813481.155535:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583794816 00000100:00100000:0.0:1788813481.155559:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583794560 00000100:00100000:0.0:1788813481.155562:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583794560 00000100:00100000:0.0:1788813481.155611:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788813481.155618:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642915f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3321:x1875706583794816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813481.155649:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642915f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3321:x1875706583794816:12345-0@lo:400:kworker.0 Request processed in 32us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813481.155655:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788813481.155667:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788813481.155672:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583794560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813481.155700:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e452d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583794560:12345-0@lo:400:kworker.0 Request processed in 28us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813481.155705:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1788813481.155734:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788813481.155738:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788813481.155741:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813481.155777:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642916680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583794560:0@lo:400:kworker.0 00000100:00100000:0.0:1788813481.155788:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642915880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875706583794688:0@lo:400:kworker.0 00000100:00100000:0.0:1788813481.155819:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583794304:0@lo:400:kworker.0 00000100:00100000:0.0:1788813481.155829:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642917b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583794816:0@lo:400:kworker.0 00000100:00100000:0.0:1788813481.155838:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642916300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875706583794432:0@lo:400:kworker.0 00000100:00100000:1.0:1788813481.156286:0:11247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583794176 00000100:00100000:1.0:1788813481.156291:0:11247:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583794176 00000100:00100000:1.0:1788813481.156325:0:11247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788813481.156333:0:11247:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087600c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3319:x1875706583794176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813481.156375:0:11247:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087600c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3319:x1875706583794176:12345-0@lo:400:kworker.0 Request processed in 43us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813481.156381:0:11247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788813481.156521:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908773c75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd1fd158-af17-4a1b-8f0b-82e57114d008:3319:1875706583794176:0@lo:400:kworker.0 00000100:00100000:2.0:1788813481.661141:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:0.0:1788813481.661212:0:8118:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 423903630882ns, next at 424903628648ns, rc = 0 00010000:00010000:1.0:1788813481.662901:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813481.666452:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e450e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583794944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813481.666526:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813481.671856:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583794944 00000100:00100000:1.0:1788813481.671888:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583794944 00000100:00100000:1.0:1788813481.672027:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788813481.672039:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1875706583794944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788813481.672078:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813481.672316:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e4a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1875706583794944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 279us (5788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813481.672324:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788813481.672783:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e450e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583794944:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788813482.236259:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:1.0:1788813482.236283:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000004:00080000:1.0:1788813482.238443:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000001:00080000:1.0:1788813482.238483:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000020:00080000:1.0:1788813482.238494:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:1.0:1788813482.238517:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1788813482.238562:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff908749dff540 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788813482.238568:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90876e4a9c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff908749dff000 00000020:00080000:1.0:1788813482.238571:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90876e4a9700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90877bb3b400 00000020:00080000:2.0:1788813482.238660:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788813482.238877:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1788813482.239034:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813482.246529:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583795072:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788813482.246627:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813482.246836:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583795072 00000100:00100000:0.0:1788813482.246846:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583795072 00000100:00100000:0.0:1788813482.246907:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788813482.246917:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774059500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583795072:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788813482.247180:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788813482.247185:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788813476 -> 1788813476 00002000:00010000:0.0:1788813482.247342:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1788813475 -> 1788813475 00002000:00010000:0.0:1788813482.247345:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788813476 -> 1788813476 00002000:00010000:0.0:1788813482.247347:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788813482.247503:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774059500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3319:x1875706583795072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 587us (875us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788813482.247511:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788813482.249673:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:1.0:1788813482.249688:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90877bb5e680, transno 4294967321 00000004:00080000:1.0:1788813482.249764:0:3319:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:1.0:1788813482.249801:0:3319:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff90876e451f80 x1875706583795072/t4294967324(4294967324) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788813498 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788813482.249815:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90876e451f80/2, rc 0, transno 4294967324 00000100:00100000:1.0:1788813482.256792:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583795072:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788813482.685227:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813483.708851:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813484.733361:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813484.734373:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583795200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813484.734461:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813484.734559:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583795200 00000100:00100000:0.0:1788813484.734567:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583795200 00000100:00100000:0.0:1788813484.734634:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788813484.734654:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583795200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813484.734688:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788813484.744655:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813484.749115:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642914e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583795200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 14462us (14644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813484.749130:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788813484.751142:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583795200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813485.413034:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813485.413451:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562840960 00000100:00100000:0.0:1788813485.413463:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562840960 00000100:00100000:0.0:1788813485.413624:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 237 00000100:00100000:0.0:1788813485.413647:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774058e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+18:11288:x1875706562840960:12345-192.168.204.47@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788813485.413749:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774058e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e90f6370-8c16-4659-9369-1cd146993b4c+18:11288:x1875706562840960:12345-192.168.204.47@tcp:60:lhsmtool_posix.0 Request processed in 115us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813485.413772:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 237 00000100:00100000:0.0:1788813485.419389:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813485.419622:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562841216 00000100:00100000:3.0:1788813485.419645:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562841216 00000100:00100000:3.0:1788813485.419695:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 65 00000100:00100000:3.0:1788813485.419705:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+18:11288:x1875706562841216:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788813485.420101:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+19:11288:x1875706562841216:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 Request processed in 384us (709us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788813485.420110:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 65 00000100:00080000:1.0:1788813485.423323:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788813485.757368:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813485.958342:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813485.958392:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813485.958431:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813485.958464:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813485.958507:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813485.958536:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562841728 00000100:00100000:3.0:1788813485.958545:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562841728 00000100:00100000:1.0:1788813485.958603:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562841344 00000100:00100000:1.0:1788813485.958607:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562841344 00000100:00100000:3.0:1788813485.958615:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562841600 00000100:00100000:3.0:1788813485.958618:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562841600 00000100:00100000:3.0:1788813485.958649:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 100 00000100:00100000:1.0:1788813485.958649:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 299 00000100:00100000:3.0:1788813485.958659:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+7:2362:x1875706562841728:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813485.958659:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2362:x1875706562841344:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813485.958735:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2362:x1875706562841344:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 76us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813485.958742:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 299 00000100:00100000:2.0:1788813485.958745:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562841472 00000100:00100000:2.0:1788813485.958748:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562841472 00000100:00100000:2.0:1788813485.958770:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562841856 00000100:00080000:1.0:1788813485.958771:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813485.958773:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562841856 00000100:00080000:1.0:1788813485.958774:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788813485.958789:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813485.958800:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 167 00000100:00100000:2.0:1788813485.958806:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+19:2362:x1875706562841472:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813485.958811:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 101 00000100:00100000:1.0:1788813485.958816:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+5:2362:x1875706562841600:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:3.0:1788813485.958924:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e90f6370-8c16-4659-9369-1cd146993b4c+7:2362:x1875706562841728:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 265us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813485.958941:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 100 00000100:00100000:3.0:1788813485.958967:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 168 00000100:00100000:3.0:1788813485.958974:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa21be5-2246-40d3-8e20-d34501daf545+5:2362:x1875706562841856:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:3.0:1788813485.959001:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa21be5-2246-40d3-8e20-d34501daf545+5:2362:x1875706562841856:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 27us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813485.959007:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 168 00000100:00100000:1.0:1788813485.961150:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+5:2362:x1875706562841600:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 2324us (2675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813485.961163:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 101 00000100:00100000:2.0:1788813485.964501:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e90f6370-8c16-4659-9369-1cd146993b4c+19:2362:x1875706562841472:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 5682us (6157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813485.964517:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 167 00000100:00100000:0.0:1788813486.269625:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583795456:0@lo:400:kworker.0 00000100:00100000:0.0:1788813486.269703:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813486.269779:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583795968:0@lo:400:kworker.0 00000100:00100000:0.0:1788813486.269808:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813486.269813:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583795456 00000100:00100000:3.0:1788813486.269823:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583795456 00000100:00100000:0.0:1788813486.269846:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788813486.269855:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583795328:0@lo:400:kworker.0 00000100:00100000:3.0:1788813486.269885:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788813486.269891:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813486.269899:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877bb5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583795456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813486.269917:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875706583795840:0@lo:400:kworker.0 00000100:00100000:0.0:1788813486.269955:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813486.269963:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877bb5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583795456:12345-0@lo:400:kworker.0 Request processed in 67us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813486.269972:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788813486.269989:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583795840 00000100:00100000:3.0:1788813486.269992:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583795840 00000100:00100000:0.0:1788813486.269994:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583795456:0@lo:400:kworker.0 00000100:00100000:3.0:1788813486.270023:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788813486.270032:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875706583795840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813486.270067:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875706583795840:12345-0@lo:400:kworker.0 Request processed in 36us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813486.270073:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788813486.270087:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875706583795840:0@lo:400:kworker.0 00000100:00100000:1.0:1788813486.270481:0:11247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583795328 00000100:00100000:1.0:1788813486.270487:0:11247:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583795328 00000100:00100000:1.0:1788813486.270530:0:11247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788813486.270534:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583795584:0@lo:400:kworker.0 00000100:00100000:1.0:1788813486.270542:0:11247:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3321:x1875706583795328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813486.270609:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813486.270641:0:11247:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3321:x1875706583795328:12345-0@lo:400:kworker.0 Request processed in 102us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813486.270648:0:11247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788813486.270651:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813486.270659:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583795712:0@lo:400:kworker.0 00000100:00100000:2.0:1788813486.270692:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788813486.270701:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813486.270719:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583795968 00000100:00100000:1.0:1788813486.270722:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583795968 00000100:00100000:2.0:1788813486.270730:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583795584 00000100:00100000:2.0:1788813486.270736:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583795584 00000100:00100000:1.0:1788813486.270755:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583795712 00000100:00100000:2.0:1788813486.270772:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788813486.270779:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583795584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813486.270817:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583795584:12345-0@lo:400:kworker.0 Request processed in 37us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813486.270823:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788813486.270855:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583795584:0@lo:400:kworker.0 00000100:00100000:1.0:1788813486.271150:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583795712 00000100:00100000:1.0:1788813486.271192:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788813486.271200:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773c75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1875706583795968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813486.271238:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773c75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1875706583795968:12345-0@lo:400:kworker.0 Request processed in 39us (1431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813486.271244:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788813486.271256:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788813486.271261:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583795712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813486.271301:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583795712:12345-0@lo:400:kworker.0 Request processed in 39us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813486.271308:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1788813486.271331:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788813486.271335:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788813486.271337:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788813486.275982:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583795328:0@lo:400:kworker.0 00000100:00100000:0.0:1788813486.276006:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583795968:0@lo:400:kworker.0 00000100:00100000:3.0:1788813486.276213:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642916a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583795712:0@lo:400:kworker.0 00010000:00010000:3.0:1788813486.780781:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813486.780892:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788813486.780914:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583796096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813486.780985:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813486.781047:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583796096 00000100:00100000:0.0:1788813486.781055:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583796096 00000100:00100000:0.0:1788813486.781339:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788813486.781350:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875706583796096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788813486.781390:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813486.781444:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875706583796096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813486.781451:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788813486.781496:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583796096:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788813487.165259:0:12833:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 16:38:06 (1788813486) 00000001:00080000:0.0:1788813487.356034:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000020:00080000:0.0:1788813487.394386:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:0.0:1788813487.394408:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1788813487.394423:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788813487.394432:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788813487.816653:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813488.833554:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813489.508432:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813489.508889:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562841984 00000100:00100000:3.0:1788813489.508900:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562841984 00000100:00100000:3.0:1788813489.509041:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 238 00000100:00100000:3.0:1788813489.509087:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa21be5-2246-40d3-8e20-d34501daf545+5:12310:x1875706562841984:12345-192.168.204.47@tcp:101:lsof.0 00010000:00010000:3.0:1788813489.509230:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813489.509255:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb276e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484165 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813489.509331:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb2775 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813489.509347:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb2775 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813489.509360:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb2775 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813489.509399:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788813489.509404:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813489.509447:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb2775 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813489.509472:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95800/0x6d74dbab2ddb276e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484165 expref: 7 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813489.509489:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb2775 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484165 expref: 6 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813489.509497:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90874a4cbd00) 00010000:00010000:3.0:1788813489.509500:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788813489.509504:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c94800, rc 0) 00000100:00100000:3.0:1788813489.509620:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1aa21be5-2246-40d3-8e20-d34501daf545+6:12310:x1875706562841984:12345-192.168.204.47@tcp:101:lsof.0 Request processed in 544us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813489.509637:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 238 00000100:00080000:1.0:1788813489.511565:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788813489.852781:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813489.853013:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788813489.853036:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583796224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813489.853140:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813489.853345:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583796224 00000100:00100000:1.0:1788813489.853353:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583796224 00000100:00100000:1.0:1788813489.853412:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788813489.853421:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583796224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788813489.853456:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813489.853504:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583796224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813489.853527:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788813489.853613:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583796224:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788813489.853939:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788813490.877148:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813491.076711:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813491.076754:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813491.076788:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813491.076817:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813491.076838:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813491.076868:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562842368 00000100:00100000:2.0:1788813491.076880:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562842368 00000100:00100000:2.0:1788813491.076945:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562842496 00000100:00100000:2.0:1788813491.076949:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562842496 00000100:00100000:2.0:1788813491.076975:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 104 00000100:00100000:2.0:1788813491.076985:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908773ca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+5:2362:x1875706562842368:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813491.077069:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908773ca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+5:2362:x1875706562842368:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 73us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813491.077076:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 104 00000100:00100000:2.0:1788813491.077093:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 105 00000100:00100000:2.0:1788813491.077100:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874457a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+7:2362:x1875706562842496:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813491.077125:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874457a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+7:2362:x1875706562842496:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 26us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813491.077132:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 105 00000100:00080000:2.0:1788813491.077157:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813491.077160:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813491.077472:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562842112 00000100:00100000:1.0:1788813491.077478:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562842112 00000100:00100000:1.0:1788813491.077519:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 301 00000100:00100000:1.0:1788813491.077546:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2362:x1875706562842112:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813491.077615:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2362:x1875706562842112:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 70us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813491.077621:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 301 00000100:00100000:0.0:1788813491.077741:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562842624 00000100:00100000:0.0:1788813491.077746:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562842624 00000100:00100000:0.0:1788813491.077790:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562842240 00000100:00100000:0.0:1788813491.077794:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562842240 00000100:00100000:0.0:1788813491.077816:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 172 00000100:00100000:0.0:1788813491.077823:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908744579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa21be5-2246-40d3-8e20-d34501daf545+6:2362:x1875706562842624:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813491.077862:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908744579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1aa21be5-2246-40d3-8e20-d34501daf545+6:2362:x1875706562842624:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 39us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813491.077869:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 172 00000100:00100000:0.0:1788813491.077882:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 173 00000100:00100000:0.0:1788813491.077888:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908744578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+18:2362:x1875706562842240:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813491.077913:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908744578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+18:2362:x1875706562842240:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 25us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813491.077919:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 173 00000100:00080000:1.0:1788813491.078144:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813491.138308:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813491.138414:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562842880 00000100:00100000:3.0:1788813491.138424:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562842880 00000100:00100000:3.0:1788813491.138484:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 66 00000100:00100000:3.0:1788813491.138495:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908744579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+18:12311:x1875706562842880:12345-192.168.204.47@tcp:35:umount.0 00000100:00100000:3.0:1788813491.139032:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908744579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+19:12311:x1875706562842880:12345-192.168.204.47@tcp:35:umount.0 Request processed in 537us (733us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788813491.139040:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 66 00000100:00100000:0.0:1788813491.142734:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813491.142876:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562843136 00000100:00100000:2.0:1788813491.142886:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562843136 00000100:00100000:2.0:1788813491.142986:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 67 00000100:00100000:2.0:1788813491.142997:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+19:12311:x1875706562843136:12345-192.168.204.47@tcp:35:umount.0 00000100:00100000:2.0:1788813491.143389:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+20:12311:x1875706562843136:12345-192.168.204.47@tcp:35:umount.0 Request processed in 393us (664us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788813491.143396:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 67 00000100:00100000:1.0:1788813491.146681:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813491.146782:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562843392 00000100:00100000:3.0:1788813491.146793:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562843392 00000100:00100000:3.0:1788813491.146888:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 68 00000100:00100000:3.0:1788813491.146899:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90874ada9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+20:12311:x1875706562843392:12345-192.168.204.47@tcp:35:umount.0 00000100:00100000:3.0:1788813491.147366:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90874ada9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e90f6370-8c16-4659-9369-1cd146993b4c+21:12311:x1875706562843392:12345-192.168.204.47@tcp:35:umount.0 Request processed in 467us (692us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1788813491.147375:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 68 00000100:00100000:0.0:1788813491.153395:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813491.153477:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562843648 00000100:00100000:2.0:1788813491.153488:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562843648 00000100:00100000:2.0:1788813491.153649:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 69 00000100:00100000:2.0:1788813491.153661:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+21:12311:x1875706562843648:12345-192.168.204.47@tcp:35:umount.0 00000100:00100000:2.0:1788813491.154155:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e90f6370-8c16-4659-9369-1cd146993b4c+22:12311:x1875706562843648:12345-192.168.204.47@tcp:35:umount.0 Request processed in 494us (768us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788813491.154164:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 69 00000100:00100000:0.0:1788813491.159061:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813491.159119:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813491.159156:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813491.159638:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562843776 00000100:00100000:1.0:1788813491.159650:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562843776 00000100:00100000:1.0:1788813491.159711:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562843904 00000100:00100000:1.0:1788813491.159717:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562843904 00000100:00100000:0.0:1788813491.159727:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813491.159734:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562844032 00000100:00100000:1.0:1788813491.159738:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562844032 00000100:00100000:1.0:1788813491.159761:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 18 00000100:00100000:1.0:1788813491.159772:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90875873ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+15:2361:x1875706562843776:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813491.159787:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813491.159805:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908750ad1400/0x6d74dbab2ddb1799 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483cf7 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813491.159822:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813491.159877:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90875873ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+14:2361:x1875706562843776:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 106us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813491.159898:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 18 00000100:00100000:1.0:1788813491.159948:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 19 00000100:00100000:1.0:1788813491.159955:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+13:2359:x1875706562843904:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813491.159962:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813491.159971:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908774369c00/0x6d74dbab2ddb1761 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483cbf expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813491.159979:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813491.159994:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+12:2359:x1875706562843904:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 41us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813491.160001:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 19 00000100:00100000:0.0:1788813491.160003:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562844416 00000100:00100000:0.0:1788813491.160009:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562844416 00000100:00100000:1.0:1788813491.160029:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 20 00000100:00100000:1.0:1788813491.160038:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+11:2362:x1875706562844032:12345-192.168.204.47@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788813491.160047:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 72 00010000:00010000:1.0:1788813491.160051:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788813491.160059:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+7:2358:x1875706562844416:12345-192.168.204.47@tcp:9:umount.0 00010000:00010000:1.0:1788813491.160063:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90874148d200/0x6d74dbab2ddb1a0f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dc2 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813491.160073:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813491.160107:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:2362:x1875706562844032:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 55us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813491.160113:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 20 00000020:00000080:0.0:1788813491.160151:0:6704:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb1d3b 00000020:00010000:0.0:1788813491.160162:0:6704:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9087602ff000: total 0 00000100:00080000:0.0:1788813491.160167:0:6704:0:(import.c:65:import_set_state_nolock()) ffff9087602f9800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788813491.160207:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:1.0:1788813491.160232:0:7658:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9087602ff000: total 0 00010000:00010000:1.0:1788813491.160270:0:7658:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9087602ff000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788813491.160319:0:7658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e619de5/0x6d74dbab2ddb20d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f97 expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813491.160365:0:7658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d35997a6/0x6d74dbab2ddb2767 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48415e expref: 5 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813491.160378:0:7658:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9087602ff000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788813491.160391:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813491.160394:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813491.160396:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813491.160563:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e90f6370-8c16-4659-9369-1cd146993b4c+2:2358:x1875706562844416:12345-192.168.204.47@tcp:9:umount.0 Request processed in 507us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813491.160571:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 72 00000100:00100000:0.0:1788813491.171680:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813491.171762:0:8270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562844544 00000100:00100000:2.0:1788813491.171772:0:8270:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562844544 00000100:00100000:2.0:1788813491.171826:0:8270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 73 00000100:00100000:2.0:1788813491.171836:0:8270:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+5:2358:x1875706562844544:12345-192.168.204.47@tcp:9:umount.0 00000020:00000080:2.0:1788813491.171869:0:8270:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb1ad3 00000100:00080000:2.0:1788813491.171881:0:8270:0:(import.c:65:import_set_state_nolock()) ffff9087739c6000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788813491.171982:0:8270:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788813491.172301:0:8270:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e90f6370-8c16-4659-9369-1cd146993b4c+2:2358:x1875706562844544:12345-192.168.204.47@tcp:9:umount.0 Request processed in 466us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813491.172309:0:8270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 73 00010000:00010000:1.0:1788813491.176277:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813491.185772:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813491.185928:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562845568 00000100:00100000:0.0:1788813491.185939:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562845568 00000100:00100000:0.0:1788813491.186009:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 239 00000100:00100000:0.0:1788813491.186020:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+22:2358:x1875706562845568:12345-192.168.204.47@tcp:39:umount.0 00000020:00000080:0.0:1788813491.186066:0:5849:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb176f 00000020:00010000:0.0:1788813491.186082:0:5849:0:(genops.c:1920:obd_stale_export_put()) Put export ffff908749dad000: total 0 00000100:00080000:0.0:1788813491.186086:0:5849:0:(import.c:65:import_set_state_nolock()) ffff9087466dd000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788813491.186122:0:5849:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:1.0:1788813491.186407:0:5838:0:(genops.c:1906:obd_stale_export_get()) Get export ffff908749dad000: total 0 00010000:00010000:1.0:1788813491.186459:0:5838:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff908749dad000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788813491.186493:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90874a4cbd00) 00010000:00010000:1.0:1788813491.186497:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813491.186507:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9087413a1600/0x6d74dbab2ddb212b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fac expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813491.186552:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:1.0:1788813491.186554:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788813491.186559:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0000/0x6d74dbab2ddb1d96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483ebe expref: 20 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813491.186573:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff908746516400) 00010000:00010000:1.0:1788813491.186575:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813491.186631:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72c00/0x6d74dbab2ddb1a39 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dd0 expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813491.186673:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:1.0:1788813491.186676:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788813491.186680:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908740030000/0x6d74dbab2ddb1fb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f4a expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813491.186692:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:1.0:1788813491.186694:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813491.186697:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2728 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484149 expref: 17 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813491.186709:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff908745aca000) 00010000:00010000:1.0:1788813491.186712:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788813491.186715:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad0600/0x6d74dbab2ddb1aa9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dec expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813491.186728:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:1.0:1788813491.186730:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788813491.186733:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72200/0x6d74dbab2ddb2752 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484157 expref: 15 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813491.186743:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff908743ce0800) 00010000:00010000:1.0:1788813491.186745:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813491.186749:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb1a55 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dd7 expref: 14 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813491.186764:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:1.0:1788813491.186767:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788813491.186777:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d72600/0x6d74dbab2ddb2426 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484085 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813491.186789:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff908745aca300) 00010000:00010000:1.0:1788813491.186791:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788813491.186794:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908749d73e00/0x6d74dbab2ddb2648 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484111 expref: 12 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813491.186808:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff908745aca100) 00010000:00010000:1.0:1788813491.186809:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788813491.186812:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1c00/0x6d74dbab2ddb2147 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483fb3 expref: 11 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813491.186826:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:1.0:1788813491.186829:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813491.186832:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908750ad1000/0x6d74dbab2ddb2098 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f82 expref: 10 pid: 8269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813491.186843:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff90874a4cb300) 00010000:00010000:1.0:1788813491.186845:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788813491.186848:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb20c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483f90 expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813491.186862:0:5838:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff908749dad000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788813491.186878:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813491.186880:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813491.186882:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813491.187859:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e90f6370-8c16-4659-9369-1cd146993b4c+7:2358:x1875706562845568:12345-192.168.204.47@tcp:39:umount.0 Request processed in 1835us (2090us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788813491.187881:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 239 00000040:00080000:1.0:1788813491.388828:0:11711:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788813491.388837:0:11711:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788813491.389422:0:11711:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788813491.389430:0:11711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788813491.389848:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583796352:0@lo:400:kworker.0 00000100:00100000:2.0:1788813491.389932:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813491.390083:0:11247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583796352 00000100:00100000:1.0:1788813491.390092:0:11247:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583796352 00000100:00100000:1.0:1788813491.390144:0:11247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788813491.390155:0:11247:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90875243bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3320:x1875706583796352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813491.390432:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583796480:0@lo:400:kworker.0 00000100:00100000:0.0:1788813491.390469:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813491.390507:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583796480 00000100:00100000:0.0:1788813491.390512:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583796480 00000100:00100000:0.0:1788813491.390556:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788813491.390563:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583796480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813491.390623:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583796480:12345-0@lo:400:kworker.0 Request processed in 60us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813491.390630:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788813491.390668:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583796480:0@lo:400:kworker.0 00000100:00100000:1.0:1788813491.392674:0:11247:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90875243bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3320:x1875706583796352:12345-0@lo:400:kworker.0 Request processed in 2513us (2733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813491.392688:0:11247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788813491.393542:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583796736:0@lo:400:kworker.0 00000100:00100000:0.0:1788813491.393630:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813491.393663:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788813491.393670:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875706583796608:0@lo:400:kworker.0 00000100:00100000:0.0:1788813491.393695:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813491.393723:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908774395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583796992:0@lo:400:kworker.0 00000100:00100000:0.0:1788813491.393747:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813491.393764:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788813491.393769:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875706583796864:0@lo:400:kworker.0 00000100:00100000:0.0:1788813491.393789:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813491.393819:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583796608 00000100:00100000:0.0:1788813491.393827:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583796608 00000100:00100000:0.0:1788813491.393880:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583796864 00000100:00100000:0.0:1788813491.393882:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583796864 00000100:00100000:0.0:1788813491.393922:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788813491.393931:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875706583796608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813491.393984:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875706583796608:12345-0@lo:400:kworker.0 Request processed in 54us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813491.393991:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788813491.394004:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788813491.394009:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875706583796864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813491.394038:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875706583796864:12345-0@lo:400:kworker.0 Request processed in 29us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813491.394059:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788813491.394097:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875706583796608:0@lo:400:kworker.0 00000100:00100000:0.0:1788813491.394124:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875706583796864:0@lo:400:kworker.0 00000100:00100000:0.0:1788813491.394144:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583796736 00000100:00100000:0.0:1788813491.394147:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583796736 00000100:00100000:0.0:1788813491.394172:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583796992 00000100:00100000:0.0:1788813491.394174:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583796992 00000100:00100000:0.0:1788813491.394207:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788813491.394213:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908761eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583796736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813491.394246:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908761eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583796736:12345-0@lo:400:kworker.0 Request processed in 33us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813491.394252:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788813491.394263:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788813491.394269:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583796992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813491.394301:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583796992:12345-0@lo:400:kworker.0 Request processed in 32us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813491.394317:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788813491.394340:0:3321:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1788813491.394345:0:3321:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90876e451f80, transno 4294967324 00000100:00100000:0.0:1788813491.394355:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908774395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583796992:0@lo:400:kworker.0 00000100:00100000:0.0:1788813491.394716:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583796736:0@lo:400:kworker.0 00000100:00080000:1.0:1788813491.395603:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788813491.395611:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788813491.395614:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813491.395706:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583796352:0@lo:400:kworker.0 00010000:00010000:1.0:1788813491.900898:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813491.901472:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813491.905872:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583797120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813491.905956:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813491.906258:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583797120 00000100:00100000:1.0:1788813491.906267:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583797120 00000100:00100000:1.0:1788813491.906333:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788813491.906344:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908744579c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583797120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788813491.906396:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813491.906463:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908744579c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583797120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813491.906471:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788813491.906725:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e5ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583797120:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788813492.487638:0:7669:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e90f6370-8c16-4659-9369-1cd146993b4c 00000020:00000080:3.0:1788813492.487648:0:7669:0:(genops.c:885:class_export_put()) final put ffff9087602ff000/e90f6370-8c16-4659-9369-1cd146993b4c 00000020:00000080:1.0:1788813492.487774:0:484:0:(genops.c:844:class_export_destroy()) destroying export ffff9087602ff000/e90f6370-8c16-4659-9369-1cd146993b4c for lustre-OST0001 00000020:00000080:1.0:1788813492.487829:0:484:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9087602f9800 for lustre-OST0001 00000001:00100000:2.0:1788813492.491508:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e90f6370-8c16-4659-9369-1cd146993b4c 00000001:00080000:2.0:1788813492.491523:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1788813492.491547:0:5871:0:(genops.c:885:class_export_put()) final put ffff908749dad000/e90f6370-8c16-4659-9369-1cd146993b4c 00000020:00000080:3.0:1788813492.491627:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff908749dad000/e90f6370-8c16-4659-9369-1cd146993b4c for lustre-MDT0000 00000020:00000080:3.0:1788813492.491716:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9087466dd000 for lustre-MDT0000 00010000:00010000:1.0:1788813492.925996:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813493.157457:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813493.157512:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813493.157553:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813493.157803:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562845696 00000100:00100000:3.0:1788813493.157820:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562845696 00000100:00100000:3.0:1788813493.157878:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562845952 00000100:00100000:3.0:1788813493.157882:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562845952 00000100:00100000:3.0:1788813493.157905:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562845824 00000100:00100000:3.0:1788813493.157908:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562845824 00000100:00100000:3.0:1788813493.157945:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 21 00000100:00100000:3.0:1788813493.157958:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+12:2360:x1875706562845696:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813493.157974:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813493.157994:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908774369000/0x6d74dbab2ddb1841 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d0c expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813493.158022:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813493.158079:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+11:2360:x1875706562845696:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 124us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813493.158088:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 21 00000100:00100000:3.0:1788813493.158105:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 22 00000100:00100000:3.0:1788813493.158111:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+10:2360:x1875706562845952:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813493.158118:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813493.158128:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908740030c00/0x6d74dbab2ddb1a08 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483dbb expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813493.158137:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813493.158155:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+9:2360:x1875706562845952:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 44us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813493.158160:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 22 00000100:00100000:3.0:1788813493.158172:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 23 00000100:00100000:3.0:1788813493.158179:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e927480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+8:2360:x1875706562845824:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813493.158185:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813493.158194:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908774368600/0x6d74dbab2ddb1848 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483d36 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813493.158211:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813493.158229:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e927480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+7:2360:x1875706562845824:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 51us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813493.158235:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 23 00000100:00100000:1.0:1788813493.177540:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813493.178103:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562846208 00000100:00100000:0.0:1788813493.178115:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562846208 00000100:00100000:0.0:1788813493.178200:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 240 00000100:00100000:0.0:1788813493.178213:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aa21be5-2246-40d3-8e20-d34501daf545+6:2358:x1875706562846208:12345-192.168.204.47@tcp:39:umount.0 00000020:00000080:0.0:1788813493.178260:0:8269:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb1856 00000020:00010000:0.0:1788813493.178269:0:8269:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9087742f6000: total 0 00000100:00080000:0.0:1788813493.178274:0:8269:0:(import.c:65:import_set_state_nolock()) ffff9087742f3000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788813493.178307:0:8269:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1788813493.178934:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1aa21be5-2246-40d3-8e20-d34501daf545+5:2358:x1875706562846208:12345-192.168.204.47@tcp:39:umount.0 Request processed in 721us (1401us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788813493.178944:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 240 00000020:00010000:3.0:1788813493.179840:0:5838:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9087742f6000: total 0 00010000:00010000:3.0:1788813493.179846:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813493.179891:0:5838:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9087742f6000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788813493.179933:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90874a4cbd00) 00010000:00010000:3.0:1788813493.179937:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788813493.179949:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb2775 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484165 expref: 4 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813493.179973:0:5838:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9087742f6000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788813493.179983:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813493.179985:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813493.179986:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788813493.180359:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788813493.207965:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813493.208314:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562846464 00000100:00100000:3.0:1788813493.208324:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562846464 00000100:00100000:3.0:1788813493.208386:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 303 00000100:00100000:3.0:1788813493.208407:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+7:2358:x1875706562846464:12345-192.168.204.47@tcp:251:umount.0 00000020:00000080:3.0:1788813493.208460:0:5843:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb174c 00000020:00010000:3.0:1788813493.208469:0:5843:0:(genops.c:1920:obd_stale_export_put()) Put export ffff908749daf800: total 0 00000100:00080000:3.0:1788813493.208475:0:5843:0:(import.c:65:import_set_state_nolock()) ffff908749dad800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788813493.208572:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c26434d2-1302-4a28-bfe7-c3365fc6f8a0+3:2358:x1875706562846464:12345-192.168.204.47@tcp:251:umount.0 Request processed in 176us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813493.209358:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 303 00000020:00010000:1.0:1788813493.210056:0:7658:0:(genops.c:1906:obd_stale_export_get()) Get export ffff908749daf800: total 0 00010000:00010000:1.0:1788813493.210136:0:7658:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff908749daf800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788813493.210174:0:7658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908774368a00/0x6d74dbab2ddb17a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e483cfe expref: 2 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813493.210191:0:7658:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff908749daf800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788813493.210202:0:7658:0:(genops.c:885:class_export_put()) final put ffff908749daf800/c26434d2-1302-4a28-bfe7-c3365fc6f8a0 00010000:00010000:1.0:1788813493.210222:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813493.210225:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813493.210226:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788813493.210369:0:484:0:(genops.c:844:class_export_destroy()) destroying export ffff908749daf800/c26434d2-1302-4a28-bfe7-c3365fc6f8a0 for MGS 00000020:00000080:3.0:1788813493.210429:0:484:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff908749dad800 for MGS 00010000:00010000:1.0:1788813493.950967:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788813494.575529:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e90f6370-8c16-4659-9369-1cd146993b4c 00000020:00000080:1.0:1788813494.575541:0:6729:0:(genops.c:885:class_export_put()) final put ffff9087739c0000/e90f6370-8c16-4659-9369-1cd146993b4c 00000020:00000080:1.0:1788813494.575571:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9087739c0000/e90f6370-8c16-4659-9369-1cd146993b4c for lustre-OST0000 00000020:00000080:1.0:1788813494.575632:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9087739c6000 for lustre-OST0000 00010000:00010000:3.0:1788813494.972762:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813494.973365:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908774397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583797248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813494.973435:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813494.973675:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583797248 00000100:00100000:0.0:1788813494.973683:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583797248 00000100:00100000:0.0:1788813494.973751:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788813494.973762:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583797248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813494.973800:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813494.973853:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583797248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813494.973874:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1788813494.974126:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813494.974200:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908774397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583797248:0@lo:13:osp-pre-0-0.0 00000020:01000004:2.0:1788813495.138164:0:13034:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788813495.153833:0:13034:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788813495.153882:0:13034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148da00/0x6d74dbab2ddb17df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb17e6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813495.153896:0:13034:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148da00/0x6d74dbab2ddb17df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb17e6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813495.153904:0:13034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148da00/0x6d74dbab2ddb17df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d74dbab2ddb17e6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813495.153912:0:13034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.147@tcp lock: ffff90874148da00/0x6d74dbab2ddb17df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d74dbab2ddb17e6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813495.153936:0:13034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788813495.153952:0:13034:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788813495.153976:0:13034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788813495.153980:0:13034:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788813495.153987:0:13034:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788813495.154015:0:13034:0:(import.c:65:import_set_state_nolock()) ffff90876e39c800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788813495.154988:0:7658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813495.154997:0:7658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff90874148da00/0x6d74dbab2ddb17df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d74dbab2ddb17e6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813495.155007:0:7658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148da00 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:1.0:1788813495.155011:0:7658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff90874148da00/0x6d74dbab2ddb17df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d74dbab2ddb17e6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813495.155021:0:7658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff90874148da00/0x6d74dbab2ddb17df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d74dbab2ddb17e6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813495.155029:0:7658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff90874148da00/0x6d74dbab2ddb17df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d74dbab2ddb17e6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813495.155034:0:7658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788813495.155045:0:7658:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788813495.155048:0:7658:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788813495.155079:0:7658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff90874148da00/0x6d74dbab2ddb17df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d74dbab2ddb17e6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813495.155085:0:7658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788813495.155134:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583797504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813495.155196:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788813495.157206:0:7658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff90874148da00/0x6d74dbab2ddb17df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d74dbab2ddb17e6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813495.157222:0:7658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff90874148da00/0x6d74dbab2ddb17df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d74dbab2ddb17e6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813495.157236:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813495.157238:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813495.157240:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813495.157260:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875706583797376:0@lo:39:umount.0 00000100:00100000:1.0:1788813495.157316:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813495.157881:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583797376 00000100:00100000:1.0:1788813495.157891:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583797376 00000100:00100000:1.0:1788813495.157942:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788813495.157952:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875706583797376:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788813495.157981:0:5850:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb155b 00000100:00080000:1.0:1788813495.157990:0:5850:0:(import.c:65:import_set_state_nolock()) ffff9087466bd800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788813495.158063:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642916a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3317:x1875706583797376:12345-0@lo:39:umount.0 Request processed in 112us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813495.158070:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:1.0:1788813495.158081:0:5850:0:(genops.c:885:class_export_put()) final put ffff908773ad1000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1788813495.158105:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788813495.158130:0:3317:0:(import.c:65:import_set_state_nolock()) ffff90876e39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788813495.158144:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875706583797376:0@lo:39:umount.0 00000020:00000080:1.0:1788813495.158184:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff908773ad1000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788813495.158240:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9087466bd800 for lustre-MDT0000 00000100:00100000:0.0:1788813495.160461:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583797504 00000100:00100000:0.0:1788813495.160476:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583797504 00000100:00100000:0.0:1788813495.160568:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788813495.160960:0:8477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3320:x1875706583797504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813495.160979:0:8477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813495.161003:0:8477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908750ad0200/0x6d74dbab2ddb17e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d74dbab2ddb17df expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813495.161018:0:8477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813495.161392:0:8477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:3320:x1875706583797504:12345-0@lo:103:ldlm_bl.0 Request processed in 811us (6190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813495.161404:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788813495.161474:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583797504:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788813495.161510:0:13034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788813495.161515:0:13034:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788813495.161520:0:13034:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788813495.162735:0:13034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148d000/0x6d74dbab2ddb17ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb17f4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813495.162751:0:13034:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148d000/0x6d74dbab2ddb17ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb17f4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813495.162759:0:13034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148d000/0x6d74dbab2ddb17ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d74dbab2ddb17f4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813495.162767:0:13034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.147@tcp lock: ffff90874148d000/0x6d74dbab2ddb17ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d74dbab2ddb17f4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813495.162788:0:13034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813495.162796:0:13034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031600/0x6d74dbab2ddb1706 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb170d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813495.162802:0:13034:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031600/0x6d74dbab2ddb1706 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb170d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813495.162823:0:13034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031600/0x6d74dbab2ddb1706 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d74dbab2ddb170d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813495.162829:0:13034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.147@tcp lock: ffff908740031600/0x6d74dbab2ddb1706 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d74dbab2ddb170d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813495.162844:0:13034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788813495.162851:0:13034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb19fa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb1a01 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813495.162857:0:13034:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb19fa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb1a01 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813495.162863:0:13034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb19fa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d74dbab2ddb1a01 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813495.162868:0:13034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb19fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d74dbab2ddb1a01 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813495.162880:0:13034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788813495.162884:0:13034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff9087413a1800/0x6d74dbab2ddb14ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb14c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813495.162891:0:13034:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff9087413a1800/0x6d74dbab2ddb14ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb14c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813495.162897:0:13034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff9087413a1800/0x6d74dbab2ddb14ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d74dbab2ddb14c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813495.162914:0:13034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.147@tcp lock: ffff9087413a1800/0x6d74dbab2ddb14ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d74dbab2ddb14c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813495.162921:0:13034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1788813495.162924:0:13034:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788813495.162948:0:13034:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788813495.162952:0:13034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788813495.162957:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813495.162962:0:13034:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:2.0:1788813495.162968:0:13034:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff908749b82800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788813495.162973:0:13034:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff908641110800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788813495.162980:0:13034:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9087742f6000 1aa21be5-2246-40d3-8e20-d34501daf545 192.168.204.47@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788813495.162985:0:13034:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff908749b599c0) has exports, disconnecting them 00000020:00080000:2.0:1788813495.162989:0:13034:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff908749b82800), last request at 1788813491 00000020:00000080:2.0:1788813495.162997:0:13034:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb16ce 00000100:00080000:2.0:1788813495.163018:0:13034:0:(import.c:65:import_set_state_nolock()) ffff908749b85000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788813495.163074:0:13034:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff908749b82800): rc 0 00000020:00000080:2.0:1788813495.163077:0:13034:0:(genops.c:885:class_export_put()) final put ffff908749b82800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788813495.163090:0:13034:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff908641110800), last request at 1788813491 00000020:00000080:2.0:1788813495.163094:0:13034:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb1603 00000100:00080000:2.0:1788813495.163098:0:13034:0:(import.c:65:import_set_state_nolock()) ffff908641113800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788813495.163104:0:13034:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff908641110800): rc 0 00000020:00000080:2.0:1788813495.163106:0:13034:0:(genops.c:885:class_export_put()) final put ffff908641110800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1788813495.163113:0:13034:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbb79417afae0 00000100:00080000:2.0:1788813495.163131:0:13034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788813495.163135:0:13034:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1788813495.163150:0:13034:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788813495.163207:0:13034:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788813495.163232:0:13034:0:(import.c:65:import_set_state_nolock()) ffff908749b83000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788813495.163246:0:13034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788813495.163248:0:13034:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1788813495.163260:0:13034:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788813495.163310:0:13034:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788813495.163319:0:13034:0:(import.c:65:import_set_state_nolock()) ffff9087466de000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788813495.163345:0:13034:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff908749b599c0) has no exports 00010000:00010000:3.0:1788813495.163885:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788813495.163895:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff90874148d000/0x6d74dbab2ddb17ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d74dbab2ddb17f4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813495.163904:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148d000 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:3.0:1788813495.163908:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff90874148d000/0x6d74dbab2ddb17ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d74dbab2ddb17f4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813495.163917:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff90874148d000/0x6d74dbab2ddb17ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d74dbab2ddb17f4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813495.163924:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff90874148d000/0x6d74dbab2ddb17ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d74dbab2ddb17f4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813495.163929:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788813495.163931:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1788813495.163934:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1788813495.163964:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff90874148d000/0x6d74dbab2ddb17ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d74dbab2ddb17f4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813495.163969:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813495.163997:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff90874148d000/0x6d74dbab2ddb17ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d74dbab2ddb17f4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813495.164004:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff90874148d000/0x6d74dbab2ddb17ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d74dbab2ddb17f4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813495.164017:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788813495.164020:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908740031600/0x6d74dbab2ddb1706 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d74dbab2ddb170d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813495.164034:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031600 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:3.0:1788813495.164036:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908740031600/0x6d74dbab2ddb1706 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d74dbab2ddb170d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813495.164043:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908740031600/0x6d74dbab2ddb1706 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d74dbab2ddb170d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813495.164048:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908740031600/0x6d74dbab2ddb1706 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d74dbab2ddb170d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813495.164053:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788813495.164054:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788813495.164056:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788813495.164070:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff908740031600/0x6d74dbab2ddb1706 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d74dbab2ddb170d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813495.164075:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813495.164090:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908740031600/0x6d74dbab2ddb1706 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d74dbab2ddb170d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813495.164097:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908740031600/0x6d74dbab2ddb1706 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d74dbab2ddb170d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813495.164109:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788813495.164113:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb19fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d74dbab2ddb1a01 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813495.164118:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148c000 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:3.0:1788813495.164120:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb19fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d74dbab2ddb1a01 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813495.164133:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb19fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d74dbab2ddb1a01 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813495.164139:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb19fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d74dbab2ddb1a01 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813495.164144:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788813495.164147:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788813495.164149:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788813495.164164:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb19fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d74dbab2ddb1a01 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813495.164170:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813495.164176:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb19fa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d74dbab2ddb1a01 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813495.164181:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb19fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d74dbab2ddb1a01 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813495.164191:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813495.164194:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff9087413a1800/0x6d74dbab2ddb14ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d74dbab2ddb14c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813495.164199:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a1800 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:3.0:1788813495.164202:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff9087413a1800/0x6d74dbab2ddb14ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d74dbab2ddb14c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813495.164207:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff9087413a1800/0x6d74dbab2ddb14ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d74dbab2ddb14c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788813495.164224:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff9087413a1800/0x6d74dbab2ddb14ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d74dbab2ddb14c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813495.164229:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788813495.164231:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788813495.164232:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788813495.164245:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff9087413a1800/0x6d74dbab2ddb14ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d74dbab2ddb14c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813495.164250:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788813495.164255:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff9087413a1800/0x6d74dbab2ddb14ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d74dbab2ddb14c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813495.164260:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff9087413a1800/0x6d74dbab2ddb14ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d74dbab2ddb14c1 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813495.164272:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813495.164274:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813495.164275:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813495.164297:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908774395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd1fd158-af17-4a1b-8f0b-82e57114d008:3319:1875706583798144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788813495.164361:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813495.164409:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813495.164415:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908774397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd1fd158-af17-4a1b-8f0b-82e57114d008:3319:1875706583798016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788813495.164437:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813495.164478:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583798144 00000100:00100000:3.0:1788813495.164485:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583798144 00000100:00100000:3.0:1788813495.164525:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583798016 00000100:00100000:3.0:1788813495.164528:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583798016 00000100:00100000:3.0:1788813495.164550:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788813495.164565:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90875873b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3319:x1875706583798144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813495.164785:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813495.164791:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813495.164807:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788813495.164817:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e451f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+19:3319:x1875706583798016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813495.164827:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813495.164842:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908750ad0a00/0x6d74dbab2ddb170d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d74dbab2ddb1706 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813495.164857:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813495.164896:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e451f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+18:3319:x1875706583798016:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813495.164903:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000020:00000080:1.0:1788813495.164933:0:484:0:(genops.c:844:class_export_destroy()) destroying export ffff908749b82800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788813495.164974:0:484:0:(genops.c:844:class_export_destroy()) destroying export ffff908641110800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788813495.164998:0:484:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff908749b85000 for lustre-MDT0000 00000020:00000080:1.0:1788813495.165003:0:484:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff908641113800 for lustre-MDT0000 00000100:00100000:1.0:1788813495.165017:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9087739c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1875706583797632:0@lo:9:umount.0 00000100:00100000:1.0:1788813495.165048:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813495.165068:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9087739c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1875706583797760:0@lo:9:umount.0 00000100:00100000:1.0:1788813495.165087:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813495.165131:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908774397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd1fd158-af17-4a1b-8f0b-82e57114d008:3319:1875706583798016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813495.165247:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583797632 00000100:00100000:1.0:1788813495.165251:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583797632 00000100:00100000:1.0:1788813495.165279:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583797760 00000100:00100000:1.0:1788813495.165289:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583797760 00000100:00100000:1.0:1788813495.165318:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788813495.165324:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875706583797632:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788813495.165346:0:6704:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb165e 00000100:00080000:1.0:1788813495.165355:0:6704:0:(import.c:65:import_set_state_nolock()) ffff908641113000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788813495.165383:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788813495.165764:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908774397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583797888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813495.165800:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813495.165832:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788813495.165839:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583798272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813495.165858:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788813495.166031:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813495.166049:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908750ad1e00/0x6d74dbab2ddb1a01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d74dbab2ddb19fa expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813495.166061:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813495.166276:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642915500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3317:x1875706583797632:12345-0@lo:9:umount.0 Request processed in 950us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813495.166284:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788813495.166303:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788813495.166312:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1875706583797760:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788813495.166331:0:6704:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb1737 00000100:00080000:1.0:1788813495.166337:0:6704:0:(import.c:65:import_set_state_nolock()) ffff908641114800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788813495.166361:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788813495.166571:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642916d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3317:x1875706583797760:12345-0@lo:9:umount.0 Request processed in 261us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813495.166598:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788813495.166623:0:5845:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788813495.166637:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813495.166751:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90875873b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:3319:x1875706583798144:12345-0@lo:103:ldlm_bl.0 Request processed in 2185us (2387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813495.166759:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788813495.166802:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583797888 00000100:00100000:3.0:1788813495.166808:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583797888 00000100:00100000:3.0:1788813495.167091:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583798272 00000100:00100000:3.0:1788813495.167096:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583798272 00000100:00100000:2.0:1788813495.167185:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908774395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd1fd158-af17-4a1b-8f0b-82e57114d008:3319:1875706583798144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813495.167343:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788813495.167351:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+17:3321:x1875706583797888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813495.167362:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813495.167376:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908774369200/0x6d74dbab2ddb17f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d74dbab2ddb17ed expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813495.167387:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813495.167428:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+16:3321:x1875706583797888:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813495.167457:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788813495.167472:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788813495.167477:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+15:3321:x1875706583798272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813495.167485:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813495.167495:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90874148cc00/0x6d74dbab2ddb14c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d74dbab2ddb14ba expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813495.167507:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813495.167530:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:3321:x1875706583798272:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813495.167535:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788813495.167567:0:3317:0:(import.c:65:import_set_state_nolock()) ffff908749b83000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788813495.167616:0:3317:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788813495.167618:0:3317:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788813495.167622:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9087739c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1875706583797632:0@lo:9:umount.0 00000100:00080000:1.0:1788813495.167636:0:3317:0:(import.c:65:import_set_state_nolock()) ffff9087466de000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788813495.167656:0:3317:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788813495.167658:0:3317:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788813495.167661:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9087739c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1875706583797760:0@lo:9:umount.0 00010000:00010000:1.0:1788813495.167691:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813495.167859:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583798272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813495.167867:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908774397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583797888:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788813495.172900:0:13034:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff908749b599c0) has no exports 00000020:00000080:3.0:1788813495.209879:0:13034:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb1515 00000020:00000080:3.0:1788813495.209893:0:13034:0:(genops.c:885:class_export_put()) final put ffff9087466bf800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788813495.209958:0:13034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788813495.210071:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813495.210082:0:13034:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788813495.210086:0:13034:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff90876f9c99c0) has no exports 00000020:00000080:2.0:1788813495.210366:0:13034:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb150e 00000020:00000080:2.0:1788813495.210372:0:13034:0:(genops.c:885:class_export_put()) final put ffff90876f9d7000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788813495.210401:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9087466bf800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788813495.213996:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813495.214013:0:13034:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788813495.214019:0:13034:0:(genops.c:885:class_export_put()) final put ffff90876f9d6800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788813495.214024:0:13034:0:(genops.c:844:class_export_destroy()) destroying export ffff90876f9d6800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788813495.214038:0:13034:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788813495.214260:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90876f9d7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1788813495.996785:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813496.509786:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583798528:0@lo:400:kworker.0 00000100:00100000:1.0:1788813496.509859:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813496.509923:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813496.509923:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583798528 00000100:00100000:1.0:1788813496.509929:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875706583798656:0@lo:400:kworker.0 00000100:00100000:0.0:1788813496.509932:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583798528 00000100:00100000:1.0:1788813496.509970:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813496.509972:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788813496.509980:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3318:x1875706583798528:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788813496.509988:0:8269:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788813496.510000:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583798656 00000100:00100000:1.0:1788813496.510003:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583798656 00000100:00100000:1.0:1788813496.510023:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788813496.510027:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3318:x1875706583798656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813496.510030:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3318:x1875706583798528:12345-0@lo:400:kworker.0 Request processed in 50us (171us total) trans 0 rc -107/-107 00000020:00080000:1.0:1788813496.510033:0:5850:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788813496.510036:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788813496.510055:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3318:x1875706583798656:12345-0@lo:400:kworker.0 Request processed in 26us (84us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788813496.510060:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788813496.510069:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788813496.510077:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583798400:0@lo:400:kworker.0 00000100:00080000:1.0:1788813496.510093:0:3318:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788813496.510098:0:3318:0:(import.c:65:import_set_state_nolock()) ffff90876e4d2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788813496.510102:0:3318:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1788813496.510115:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813496.510145:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583798400 00000100:00100000:0.0:1788813496.510148:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583798400 00000100:00100000:0.0:1788813496.510174:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788813496.510181:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908781cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:3320:x1875706583798400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813496.510227:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908781cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd1fd158-af17-4a1b-8f0b-82e57114d008+14:3320:x1875706583798400:12345-0@lo:400:kworker.0 Request processed in 47us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813496.510234:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788813496.510267:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642915c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583798400:0@lo:400:kworker.0 00000100:00080000:1.0:1788813496.529064:0:3318:0:(import.c:65:import_set_state_nolock()) ffff90876e4d2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813496.529077:0:3318:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 244 00000100:00080000:1.0:1788813496.529092:0:3318:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90876e4d2800 using connection 192.168.204.147@tcp/0@lo 00000100:00100000:1.0:1788813496.529136:0:3318:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff908642917100 x1875706583798784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813496.529238:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3317:1875706583798784:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788813496.529300:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813496.529392:0:8269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583798784 00000100:00100000:0.0:1788813496.529400:0:8269:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583798784 00000100:00100000:0.0:1788813496.529453:0:8269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788813496.529460:0:8269:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3317:x1875706583798784:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1788813496.529476:0:8269:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788813496.530014:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875706583798656:0@lo:400:kworker.0 00000100:00080000:1.0:1788813496.530043:0:3318:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788813496.530047:0:3318:0:(import.c:65:import_set_state_nolock()) ffff9086413fc800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788813496.530051:0:3318:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788813496.530054:0:3318:0:(import.c:65:import_set_state_nolock()) ffff9086413fc800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813496.530058:0:3318:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 224 00000100:00080000:1.0:1788813496.530065:0:3318:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9086413fc800 using connection 192.168.204.147@tcp/0@lo 00000100:00100000:1.0:1788813496.530098:0:3318:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff908642915880 x1875706583798912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813496.539143:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642915880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3317:1875706583798912:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788813496.539222:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813496.539448:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583798912 00000100:00100000:3.0:1788813496.539458:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583798912 00000100:00100000:3.0:1788813496.539506:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788813496.539515:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3317:x1875706583798912:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1788813496.539534:0:5849:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788813496.539607:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3317:x1875706583798912:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 92us (384us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788813496.539614:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1788813496.539652:0:3317:0:(import.c:65:import_set_state_nolock()) ffff9086413fc800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813496.539657:0:3317:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788813496.539661:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642915880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3317:1875706583798912:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788813496.543297:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583798528:0@lo:400:kworker.0 00000100:00100000:0.0:1788813496.543921:0:8269:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3317:x1875706583798784:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 14456us (14616us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788813496.543945:0:8269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1788813496.544083:0:3317:0:(import.c:65:import_set_state_nolock()) ffff90876e4d2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788813496.544089:0:3317:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788813496.544093:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642917100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3317:1875706583798784:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:2.0:1788813497.020968:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788813497.590516:0:7669:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788813497.590535:0:7669:0:(genops.c:885:class_export_put()) final put ffff908641112800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788813497.590606:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff908641112800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788813497.590656:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff908641114800 for lustre-OST0001 00000001:00100000:2.0:1788813497.598515:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1aa21be5-2246-40d3-8e20-d34501daf545 00000001:00080000:2.0:1788813497.598535:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1788813497.598542:0:5871:0:(genops.c:885:class_export_put()) final put ffff9087742f6000/1aa21be5-2246-40d3-8e20-d34501daf545 00000020:00000080:1.0:1788813497.598659:0:484:0:(genops.c:844:class_export_destroy()) destroying export ffff9087742f6000/1aa21be5-2246-40d3-8e20-d34501daf545 for lustre-MDT0000 00000020:00000080:1.0:1788813497.598720:0:484:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9087742f3000 for lustre-MDT0000 00010000:00010000:1.0:1788813498.044837:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813499.069129:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788813499.651714:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788813499.651722:0:6729:0:(genops.c:885:class_export_put()) final put ffff908641115800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788813499.651845:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff908641115800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788813499.652155:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff908641113000 for lustre-OST0000 00010000:00010000:2.0:1788813500.093090:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813501.120126:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788813501.308788:0:13034:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90876e9aec60 - data ffff90877ffc3798/ffff90877beef000 00000020:01000000:2.0:1788813501.308932:0:13034:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff908761fb1ae0 - data ffff908767781798/ffff9087748ae000 00000001:00000004:2.0:1788813501.317785:0:13034:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1788813501.388399:0:13034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788813501.388408:0:13034:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788813501.388431:0:13034:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788813501.388433:0:13034:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788813501.388990:0:7087:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788813501.388996:0:7087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1788813501.389005:0:7087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788813501.389995:0:13034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788813501.390001:0:13034:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788813501.390017:0:13034:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788813501.390019:0:13034:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788813501.390454:0:8117:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788813501.390458:0:8117:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1788813501.390467:0:8117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788813501.506433:0:13034:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb14dd 00000020:00000080:2.0:1788813501.506449:0:13034:0:(genops.c:885:class_export_put()) final put ffff90876e39e000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788813501.506967:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90876e39e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788813501.509490:0:13034:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb14f2 00000020:00000080:2.0:1788813501.509503:0:13034:0:(genops.c:885:class_export_put()) final put ffff908774406000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788813501.509573:0:13034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788813501.509619:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813501.509628:0:13034:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788813501.509632:0:13034:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff908749b58000) has no exports 00000004:01000000:2.0:1788813501.509800:0:13034:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788813501.509809:0:13034:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb1730 00000020:00000080:2.0:1788813501.509814:0:13034:0:(genops.c:885:class_export_put()) final put ffff908641111000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788813501.510453:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff908774406000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788813501.510537:0:13034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788813501.510545:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813501.510554:0:13034:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788813501.510557:0:13034:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff90877fba3380) has no exports 00000020:00000080:2.0:1788813501.510565:0:13034:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb1729 00000020:00000080:2.0:1788813501.510570:0:13034:0:(genops.c:885:class_export_put()) final put ffff9087466d8000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788813501.510634:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff908641111000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:2.0:1788813501.516314:0:13034:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788813501.516332:0:13034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788813501.516336:0:13034:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1788813501.516345:0:13034:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788813501.516347:0:13034:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788813501.517462:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9087466d8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788813501.519074:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813501.519093:0:13034:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788813501.519103:0:13034:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb1649 00000020:00000080:2.0:1788813501.519113:0:13034:0:(genops.c:885:class_export_put()) final put ffff908641180000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788813501.525689:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9087466de000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788813501.525707:0:37:0:(genops.c:885:class_export_put()) final put ffff9087466d9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788813501.525711:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9087466d9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788813501.525719:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788813501.526553:0:13034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788813501.526564:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813501.527005:0:13034:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788813501.527012:0:13034:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff90876fac4d40) has no exports 00000020:00000080:2.0:1788813501.527023:0:13034:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb1642 00000020:00000080:2.0:1788813501.527032:0:13034:0:(genops.c:885:class_export_put()) final put ffff908749b83800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788813501.527507:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff908641180000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:2.0:1788813501.528539:0:13034:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788813501.528546:0:13034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788813501.528550:0:13034:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1788813501.528556:0:13034:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788813501.528559:0:13034:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788813501.528727:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff908749b83800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788813501.528827:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813501.528855:0:13034:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788813501.528891:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813501.528895:0:13034:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788813501.528900:0:13034:0:(genops.c:885:class_export_put()) final put ffff90876e398800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788813501.528903:0:13034:0:(genops.c:844:class_export_destroy()) destroying export ffff90876e398800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788813501.528909:0:13034:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788813501.529071:0:13034:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb14f9 00000020:00000080:2.0:1788813501.529078:0:13034:0:(genops.c:885:class_export_put()) final put ffff908774400000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788813501.531908:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff908749b83000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788813501.531934:0:37:0:(genops.c:885:class_export_put()) final put ffff9086413fc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788813501.531938:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9086413fc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788813501.531945:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788813501.532563:0:13034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788813501.532634:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813501.532645:0:13034:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788813501.532650:0:13034:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff90877c3fcd40) has no exports 00000020:00000080:2.0:1788813501.532677:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813501.532683:0:13034:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788813501.532688:0:13034:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb1500 00000020:00000080:2.0:1788813501.532695:0:13034:0:(genops.c:885:class_export_put()) final put ffff908774404000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788813501.532704:0:13034:0:(tgt_mount.c:187:server_put_mount()) put mount ffff908781c96000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788813501.532707:0:13034:0:(obd_mount.c:710:lustre_put_lsi()) put ffff908781c96000 3 00000020:01000004:2.0:1788813501.532710:0:13034:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff908781c96000 from lustre-MDT0000 00000020:00000080:2.0:1788813501.532728:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813501.532732:0:13034:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788813501.532734:0:13034:0:(genops.c:885:class_export_put()) final put ffff90876e398000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788813501.532736:0:13034:0:(genops.c:844:class_export_destroy()) destroying export ffff90876e398000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788813501.532749:0:13034:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788813501.532784:0:13034:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1788813501.532787:0:13034:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788813501.532790:0:13034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788813501.532792:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813501.532795:0:13034:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788813501.532801:0:13034:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff908749def000 cd1fd158-af17-4a1b-8f0b-82e57114d008 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788813501.532806:0:13034:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9087601ab380) has exports, disconnecting them 00000020:00080000:2.0:1788813501.532819:0:13034:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff908749def000), last request at 1788813261 00000020:00000080:2.0:1788813501.532849:0:13034:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb149e 00000020:00010000:2.0:1788813501.532854:0:13034:0:(genops.c:1920:obd_stale_export_put()) Put export ffff908749def000: total 2 00000100:00080000:2.0:1788813501.532858:0:13034:0:(import.c:65:import_set_state_nolock()) ffff908749dec000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788813501.532871:0:13034:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff908749def000): rc 0 00000020:00080000:2.0:1788813501.532875:0:13034:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9087601ab380) has no exports 00000100:00100000:2.0:1788813501.532932:0:5841:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9087587cac00:5841] 0 exiting: rc = 1 00000100:00100000:2.0:1788813501.533370:0:5844:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9087586eb000:5844] 2 exiting: rc = 0 00000100:00100000:2.0:1788813501.533429:0:11247:0:(service.c:3188:ptlrpc_main()) ll_mgs_0003: service thread [ffff90876e818200:11247] 3 exiting: rc = 0 00000100:00100000:3.0:1788813501.541052:0:5843:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9087587ca400:5843] 1 exiting: rc = 0 00000020:00010000:1.0:1788813501.541059:0:5837:0:(genops.c:1906:obd_stale_export_get()) Get export ffff908749def000: total 2 00010000:00010000:1.0:1788813501.541108:0:5837:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff908749def000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788813501.541140:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908750ad0e00/0x6d74dbab2ddb17bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d74dbab2ddb17b5 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813501.541156:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908774369800/0x6d74dbab2ddb17ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d74dbab2ddb17c3 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813501.541166:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90874148c600/0x6d74dbab2ddb19f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d74dbab2ddb19ec expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813501.541286:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541295:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541301:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541306:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541311:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541330:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541338:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541348:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541360:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541365:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541371:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541377:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541382:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541387:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541393:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541398:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541403:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541411:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541418:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541423:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541429:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541434:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541438:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541443:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541461:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541466:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541471:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541477:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541482:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541486:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541492:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541497:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541501:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541506:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541511:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541516:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541520:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541525:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541530:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541535:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541539:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541544:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541549:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541553:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541558:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541563:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541568:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541573:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541602:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541608:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541614:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541619:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541624:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541629:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541633:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541639:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541644:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541650:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541656:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541670:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541675:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541681:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541686:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.541692:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1788813501.542342:0:13034:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788813501.542347:0:13034:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:0.0:1788813501.543658:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff908774400000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788813501.543671:0:37:0:(genops.c:885:class_export_put()) final put ffff908746775000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788813501.543674:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff908746775000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788813501.543684:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788813501.544110:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff908774404000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1788813501.544346:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908774368200/0x6d74dbab2ddb17d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d74dbab2ddb17d1 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813501.544366:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90874148ca00/0x6d74dbab2ddb19e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d74dbab2ddb19de expref: 5 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813501.544382:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90874148ce00/0x6d74dbab2ddb1802 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d74dbab2ddb17fb expref: 4 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813501.544394:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90874148de00/0x6d74dbab2ddb15b6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d74dbab2ddb15af expref: 3 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813501.544406:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908750ad0800/0x6d74dbab2ddb17ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d74dbab2ddb17a7 expref: 2 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813501.544417:0:5837:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff908749def000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1788813501.544443:0:5837:0:(genops.c:885:class_export_put()) final put ffff908749def000/cd1fd158-af17-4a1b-8f0b-82e57114d008 00010000:00010000:1.0:1788813501.544511:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813501.544514:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813501.544516:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788813501.545399:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff908749def000/cd1fd158-af17-4a1b-8f0b-82e57114d008 for MGS 00000020:00000080:0.0:1788813501.545552:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff908749dec000 for MGS 00000020:01000000:1.0:1788813501.545691:0:13034:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90875e94a900 - data ffff90874ab99288/ffff90877fc09400 00000020:01000000:1.0:1788813501.546136:0:13034:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff908781e9e1e0 - data ffff908756c3aa20/ffff9087586bcc00 00000020:00000080:1.0:1788813501.547098:0:13034:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb1482 00000020:00000080:1.0:1788813501.547108:0:13034:0:(genops.c:885:class_export_put()) final put ffff908781c91000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788813501.547133:0:13034:0:(tgt_mount.c:187:server_put_mount()) put mount ffff908781c96000 from MGS, refs=2 00000020:01000004:1.0:1788813501.547136:0:13034:0:(obd_mount.c:710:lustre_put_lsi()) put ffff908781c96000 2 00000020:01000004:1.0:1788813501.547139:0:13034:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff908781c96000 from MGS 00000020:00000080:1.0:1788813501.547162:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813501.547170:0:13034:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788813501.547500:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff908781c91000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788813501.547537:0:13034:0:(genops.c:885:class_export_put()) final put ffff908781c93800/MGS 00000020:00000080:1.0:1788813501.547540:0:13034:0:(genops.c:844:class_export_destroy()) destroying export ffff908781c93800/MGS for MGS 00000020:01000000:1.0:1788813501.547547:0:13034:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788813501.547638:0:13034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788813501.547642:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788813501.547648:0:13034:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788813501.547655:0:13034:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff90876e39b800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788813501.547661:0:13034:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff90877c3fb380) has exports, disconnecting them 00000020:00080000:1.0:1788813501.547665:0:13034:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff90876e39b800), last request at 1788813262 00000020:00000080:1.0:1788813501.547670:0:13034:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb154d 00000020:00080000:1.0:1788813501.547681:0:13034:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90876e39b800): rc 0 00000020:00000080:1.0:1788813501.547686:0:13034:0:(genops.c:885:class_export_put()) final put ffff90876e39b800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788813501.548289:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90876e39b800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788813501.570802:0:13034:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788813501.570812:0:13034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788813501.570817:0:13034:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788813501.570825:0:13034:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788813501.571062:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813501.571070:0:13034:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788813501.571077:0:13034:0:(obd_mount.c:710:lustre_put_lsi()) put ffff908781c96000 1 00000020:00000080:2.0:1788813501.571084:0:13034:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb1474 00000020:00000080:2.0:1788813501.571092:0:13034:0:(genops.c:885:class_export_put()) final put ffff908781c93000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788813501.571098:0:13034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788813501.571106:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813501.571110:0:13034:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788813501.571114:0:13034:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9087601acd40) has no exports 00000020:00000080:0.0:1788813501.572507:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90876e39c800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788813501.572522:0:37:0:(genops.c:885:class_export_put()) final put ffff908774407000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788813501.572525:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff908774407000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788813501.572542:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788813501.572625:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff908781c93000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00080000:0.0:1788813501.639131:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788813501.639139:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788813501.639143:0:37:0:(import.c:65:import_set_state_nolock()) ffff9086413fc800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788813501.639152:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 438 00000100:00080000:0.0:1788813501.639158:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788813501.639169:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9086413fc800 using connection 192.168.204.147@tcp/0@lo 00000100:00100000:0.0:1788813501.639208:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90876e927b80 x1875706583799168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788813501.639224:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788813501.639227:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788813501.639229:0:37:0:(import.c:65:import_set_state_nolock()) ffff90876e4d2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788813501.639233:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 438 00000100:00080000:0.0:1788813501.639235:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788813501.639240:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90876e4d2800 using connection 192.168.204.147@tcp/0@lo 00000100:00100000:0.0:1788813501.639252:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90876e926d80 x1875706583799296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788813501.639279:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583799040:0@lo:400:kworker.0 00000400:00000100:0.0:1788813501.639342:0:3320:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875706583799040 offset 0 length 224: 4 00000100:00100000:2.0:1788813501.639561:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3317:1875706583799168:0@lo:38:kworker.0 00000100:00100000:2.0:1788813501.639639:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813501.639665:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3317:1875706583799296:0@lo:38:kworker.0 00000100:00100000:2.0:1788813501.639684:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813501.640284:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583799168 00000100:00100000:0.0:1788813501.640294:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583799168 00000100:00100000:0.0:1788813501.640335:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583799296 00000100:00100000:0.0:1788813501.640338:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583799296 00000100:00100000:0.0:1788813501.640356:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788813501.640377:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087739c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3317:x1875706583799168:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788813501.640395:0:5850:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788813501.640452:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087739c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3317:x1875706583799168:12345-0@lo:38:kworker.0 Request processed in 76us (812us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788813501.640460:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788813501.640474:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788813501.640477:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3317:x1875706583799296:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788813501.640484:0:5850:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788813501.640504:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3317:x1875706583799296:12345-0@lo:38:kworker.0 Request processed in 25us (819us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788813501.640509:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:2.0:1788813501.641076:0:3317:0:(import.c:65:import_set_state_nolock()) ffff9086413fc800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788813501.641082:0:3317:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788813501.641087:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e927b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3317:1875706583799168:0@lo:38:kworker.0 00000100:00080000:2.0:1788813501.641097:0:3317:0:(import.c:65:import_set_state_nolock()) ffff90876e4d2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788813501.641110:0:3317:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788813501.641114:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3317:1875706583799296:0@lo:38:kworker.0 00000020:00000080:2.0:1788813501.692757:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813501.692771:0:13034:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788813501.692777:0:13034:0:(genops.c:885:class_export_put()) final put ffff908781c90800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788813501.692781:0:13034:0:(genops.c:844:class_export_destroy()) destroying export ffff908781c90800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788813501.692791:0:13034:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788813501.692921:0:13034:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff908781c94000 00000020:01000000:2.0:1788813501.692942:0:13034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788813501.692946:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813501.692951:0:13034:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788813501.692955:0:13034:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff908749b5b380) has no exports 00000100:00100000:2.0:1788813501.693036:0:5851:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff908749cb8000:5851] 2 exiting: rc = 0 00000100:00100000:3.0:1788813501.695510:0:5849:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9087587c8200:5849] 0 exiting: rc = 1 00000100:00100000:0.0:1788813501.704784:0:8269:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff90877436f400:8269] 3 exiting: rc = 0 00000100:00100000:0.0:1788813501.704998:0:5850:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff908749cdd000:5850] 1 exiting: rc = 0 00000100:00100000:2.0:1788813501.705170:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705178:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705185:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705190:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705196:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705201:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705207:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705213:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705218:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705223:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705229:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705236:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705241:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705246:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705251:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705257:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705264:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705269:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705275:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705294:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705300:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705306:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705311:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705326:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705332:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705337:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705343:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705349:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705354:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705359:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705365:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705371:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705377:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705383:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705388:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705393:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705398:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705403:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705409:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705414:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705419:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705424:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705428:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705433:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705437:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705442:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705448:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705474:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705480:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705486:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705492:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705498:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705504:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705510:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705521:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705526:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705532:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705537:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705543:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705548:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705554:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705559:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705565:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.705571:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.715503:0:5852:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff908749cb9a00:5852] 0 exiting: rc = 1 00000100:00100000:2.0:1788813501.715864:0:5853:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff908749cb8e00:5853] 1 exiting: rc = 0 00000100:00100000:2.0:1788813501.715935:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.715942:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.715948:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.715954:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.715960:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.715965:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.715971:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.715976:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.715982:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.715988:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.715993:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.715999:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716005:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716009:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716028:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716033:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716039:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716044:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716053:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716058:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716063:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716067:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716072:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716077:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716094:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716099:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716105:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716110:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716116:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716121:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716127:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716132:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716137:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716143:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716148:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716153:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716158:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716163:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716169:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716173:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716178:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716184:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716189:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716194:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716200:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716204:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716210:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716215:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716220:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716225:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716231:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716236:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716241:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716245:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716250:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716255:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716259:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716264:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716269:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716280:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716285:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716290:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716295:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813501.716307:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.719925:0:5855:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff908761ee8200:5855] 1 exiting: rc = 0 00000100:00100000:1.0:1788813501.742796:0:5854:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff908761ee8400:5854] 0 exiting: rc = 1 00000100:00100000:0.0:1788813501.742955:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.742963:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.742970:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.742976:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.742981:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.742987:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.742993:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.742999:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743004:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743010:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743027:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743034:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743040:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743045:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743064:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743070:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743075:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743082:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743087:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743094:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743099:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743105:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743123:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743129:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743134:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743140:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743146:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743152:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743157:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743163:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743170:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743175:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743181:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743187:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743209:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743216:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743221:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743227:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743233:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743240:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743244:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743252:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743262:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743267:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743274:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743279:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743299:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743305:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743310:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743335:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743341:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743346:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743351:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743356:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743361:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743366:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743371:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743377:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743395:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743402:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743407:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743413:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743419:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.743435:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.767368:0:5857:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff908761ee8600:5857] 1 exiting: rc = 0 00000100:00100000:1.0:1788813501.767508:0:5856:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff908761ee8e00:5856] 0 exiting: rc = 1 00000100:00100000:0.0:1788813501.767777:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.767784:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.767790:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.767795:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.767800:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.767806:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.767811:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.767817:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.767821:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.767826:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.767830:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.767835:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.767921:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.767927:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.767932:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.767937:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.767942:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.767946:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.767951:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.767972:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.767977:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.767981:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.767986:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.767991:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.767996:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.768000:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.768005:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.768009:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.768831:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.768923:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.768929:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.768934:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.768939:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.768943:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.768949:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.768955:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.768960:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.768966:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.768971:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.768976:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.768981:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.768987:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.768991:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.768997:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.769002:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.769007:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.769405:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.769416:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.769420:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.769424:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.769429:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.769434:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.769438:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.769442:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.769463:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.769468:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.769473:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.769478:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.769483:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.769487:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.769492:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.769496:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.769501:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788813501.769506:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.770817:0:5859:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff908761ee8a00:5859] 1 exiting: rc = 0 00000100:00100000:0.0:1788813501.777658:0:5858:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff908761ee9000:5858] 0 exiting: rc = 1 00000100:00100000:1.0:1788813501.777844:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777853:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777858:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777863:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777880:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777885:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777889:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777894:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777898:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777904:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777909:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777913:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777917:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777922:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777927:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777932:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777936:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777941:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777946:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777951:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777956:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777961:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777966:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777971:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777976:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777980:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777985:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777989:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777994:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.777999:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778003:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778008:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778028:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778035:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778042:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778047:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778052:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778057:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778062:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778075:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778080:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778085:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778089:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778094:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778099:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778103:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778108:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778113:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778118:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778122:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778127:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778131:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778136:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778140:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778145:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778149:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778154:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778158:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778163:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778167:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778170:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778175:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778180:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778185:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778538:0:5860:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff908749a88600:5860] 0 exiting: rc = 1 00000100:00100000:1.0:1788813501.778634:0:5861:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9087729c1c00:5861] 1 exiting: rc = 0 00000100:00100000:1.0:1788813501.778680:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778686:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778690:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778696:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778701:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778705:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778710:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778715:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778731:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778736:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778741:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778746:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778750:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778755:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778761:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778766:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778770:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778775:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778780:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778785:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778789:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778794:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778799:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778804:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778809:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778814:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778818:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778823:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778828:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778834:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778840:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778844:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778850:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778855:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778860:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778865:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778870:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778874:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778880:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778885:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778890:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778894:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778899:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778912:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778916:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778921:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778926:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778931:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778935:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778941:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778946:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778951:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778956:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778961:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778966:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778970:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778975:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778980:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778986:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778991:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.778996:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.779000:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.779005:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.779010:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.779443:0:5863:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff908749a9a800:5863] 1 exiting: rc = 0 00000100:00100000:1.0:1788813501.779600:0:5864:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff908749a9b200:5864] 2 exiting: rc = 0 00000100:00100000:0.0:1788813501.780130:0:5862:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff908749a9b800:5862] 0 exiting: rc = 1 00000100:00100000:1.0:1788813501.781952:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.781961:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.781967:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.781995:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782001:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782006:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782012:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782121:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782126:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782132:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782137:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782143:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782164:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782170:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782175:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782181:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782186:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782192:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782197:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782202:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782208:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782215:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782221:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782226:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782231:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782236:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782242:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782264:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782272:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782277:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782283:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782289:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782295:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782300:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782306:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782323:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782330:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782335:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782341:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782347:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782354:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782361:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782366:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782371:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782377:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782382:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782389:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782402:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782408:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782413:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782419:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782437:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782444:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782450:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782456:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782462:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782468:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782473:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782478:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782484:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782490:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782496:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782502:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813501.782507:0:13034:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788813501.799126:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788813501.799139:0:13034:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788813501.799145:0:13034:0:(genops.c:885:class_export_put()) final put ffff908746772800/MDS_uuid 00000020:00000080:0.0:1788813501.799149:0:13034:0:(genops.c:844:class_export_destroy()) destroying export ffff908746772800/MDS_uuid for MDS 00000020:01000000:0.0:1788813501.799155:0:13034:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788813501.799300:0:13034:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788813502.206701:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813503.228734:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813504.256080:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788813505.268958:0:13189:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00010000:00010000:1.0:1788813505.276801:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788813505.299749:0:13189:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788813505.299801:0:13189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031200/0x6d74dbab2ddb17c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb17ca expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813505.299818:0:13189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031200/0x6d74dbab2ddb17c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb17ca expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813505.299826:0:13189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031200/0x6d74dbab2ddb17c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d74dbab2ddb17ca expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813505.299833:0:13189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.147@tcp lock: ffff908740031200/0x6d74dbab2ddb17c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d74dbab2ddb17ca expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813505.299855:0:13189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788813505.299873:0:13189:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788813505.299896:0:13189:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788813505.299901:0:13189:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788813505.299907:0:13189:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788813505.299913:0:13189:0:(import.c:65:import_set_state_nolock()) ffff9086413fc800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788813505.299917:0:13189:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788813505.299919:0:13189:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788813505.299921:0:13189:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788813505.300968:0:13189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740030e00/0x6d74dbab2ddb17d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb17d8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813505.300984:0:13189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740030e00/0x6d74dbab2ddb17d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb17d8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813505.300991:0:13189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740030e00/0x6d74dbab2ddb17d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d74dbab2ddb17d8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813505.300998:0:13189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.147@tcp lock: ffff908740030e00/0x6d74dbab2ddb17d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d74dbab2ddb17d8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813505.301017:0:13189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788813505.301023:0:13189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031e00/0x6d74dbab2ddb19ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb19f3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813505.301029:0:13189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031e00/0x6d74dbab2ddb19ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb19f3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813505.301035:0:13189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031e00/0x6d74dbab2ddb19ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d74dbab2ddb19f3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813505.301068:0:13189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.147@tcp lock: ffff908740031e00/0x6d74dbab2ddb19ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d74dbab2ddb19f3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813505.301087:0:13189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1788813505.301092:0:13189:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788813505.301116:0:13189:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788813505.301120:0:13189:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788813505.301125:0:13189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788813505.301130:0:13189:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788813505.301135:0:13189:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff90876f9ccd40) has no exports 00000020:00080000:1.0:1788813505.301168:0:13189:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff90876f9ccd40) has no exports 00010000:00010000:0.0:1788813505.301612:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788813505.301620:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908740031200/0x6d74dbab2ddb17c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d74dbab2ddb17ca expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813505.301628:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031200 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:0.0:1788813505.301632:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908740031200/0x6d74dbab2ddb17c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d74dbab2ddb17ca expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813505.301640:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908740031200/0x6d74dbab2ddb17c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d74dbab2ddb17ca expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813505.301648:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908740031200/0x6d74dbab2ddb17c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d74dbab2ddb17ca expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813505.301665:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788813505.301667:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788813505.301669:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788813505.301705:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff908740031200/0x6d74dbab2ddb17c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d74dbab2ddb17ca expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813505.301711:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813505.301736:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908740031200/0x6d74dbab2ddb17c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d74dbab2ddb17ca expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813505.301743:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908740031200/0x6d74dbab2ddb17c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d74dbab2ddb17ca expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813505.301757:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788813505.301760:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908740030e00/0x6d74dbab2ddb17d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d74dbab2ddb17d8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813505.301765:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740030e00 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:0.0:1788813505.301768:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908740030e00/0x6d74dbab2ddb17d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d74dbab2ddb17d8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813505.301775:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908740030e00/0x6d74dbab2ddb17d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d74dbab2ddb17d8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813505.301782:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908740030e00/0x6d74dbab2ddb17d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d74dbab2ddb17d8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813505.301787:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788813505.301789:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788813505.301790:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788813505.301808:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff908740030e00/0x6d74dbab2ddb17d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d74dbab2ddb17d8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813505.301814:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813505.301829:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908740030e00/0x6d74dbab2ddb17d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d74dbab2ddb17d8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813505.301835:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908740030e00/0x6d74dbab2ddb17d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d74dbab2ddb17d8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813505.301844:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813505.301847:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908740031e00/0x6d74dbab2ddb19ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d74dbab2ddb19f3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813505.301853:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031e00 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:0.0:1788813505.301856:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908740031e00/0x6d74dbab2ddb19ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d74dbab2ddb19f3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813505.301862:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908740031e00/0x6d74dbab2ddb19ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d74dbab2ddb19f3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813505.301869:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908740031e00/0x6d74dbab2ddb19ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d74dbab2ddb19f3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813505.301874:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788813505.301876:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788813505.301877:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788813505.301887:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff908740031e00/0x6d74dbab2ddb19ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d74dbab2ddb19f3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813505.301892:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813505.301896:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908740031e00/0x6d74dbab2ddb19ec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d74dbab2ddb19f3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813505.301907:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908740031e00/0x6d74dbab2ddb19ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d74dbab2ddb19f3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813505.301915:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813505.301916:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813505.301918:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813505.301944:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583799424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813505.302006:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813505.302074:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583799552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813505.302095:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813505.302111:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813505.302116:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e924700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583799680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813505.302131:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813505.302155:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583799424 00000100:00100000:0.0:1788813505.302162:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583799424 00000100:00100000:0.0:1788813505.302189:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583799552 00000100:00100000:0.0:1788813505.302191:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583799552 00000100:00100000:0.0:1788813505.302197:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583799680 00000100:00100000:0.0:1788813505.302198:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583799680 00000100:00100000:0.0:1788813505.302208:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788813505.302214:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e926300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3321:x1875706583799424:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788813505.302221:0:5836:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788813505 with bad export cookie 7887170375687804062 00010000:00010000:3.0:1788813505.305616:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813505.305828:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813505.306749:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788813505.306762:0:8477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e924a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3318:x1875706583799552:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788813505.306771:0:8477:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788813505 with bad export cookie 7887170375687804062 00000100:00100000:2.0:1788813505.306939:0:8477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e924a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3318:x1875706583799552:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (4840us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788813505.306946:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788813505.306971:0:8477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788813505.306976:0:8477:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e924000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3318:x1875706583799680:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788813505.306980:0:8477:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788813505 with bad export cookie 7887170375687804062 00000100:00100000:2.0:1788813505.307009:0:8477:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e924000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3318:x1875706583799680:12345-0@lo:103:ldlm_bl.0 Request processed in 32us (4877us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788813505.307015:0:8477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000020:01000000:1.0:1788813505.308237:0:13189:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90875e94a5a0 - data ffff90877fe960d8/ffff90876ea28c00 00000020:01000000:1.0:1788813505.308393:0:13189:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9087445d4180 - data ffff908767780360/ffff90877fc3bc00 00000100:00080000:3.0:1788813505.313951:0:3318:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.147@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788813505.313960:0:3318:0:(import.c:65:import_set_state_nolock()) ffff908746771000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788813505.313964:0:3318:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:0.0:1788813505.315479:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e926300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3321:x1875706583799424:12345-0@lo:103:ldlm_bl.0 Request processed in 13240us (13448us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788813505.315495:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788813505.315545:0:3321:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.147@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788813505.353887:0:3318:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.147@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788813505.353894:0:3318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788813505.353905:0:3318:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90876e925500 x1875706583799040/t0(0) o400->MGC192.168.204.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788813517 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813505.353937:0:3318:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90876e925180 x1875706583799424/t0(0) o103->MGC192.168.204.147@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788813521 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813505.353946:0:3318:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90876e927800 x1875706583799552/t0(0) o103->MGC192.168.204.147@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788813521 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813505.353954:0:3318:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90876e924700 x1875706583799680/t0(0) o103->MGC192.168.204.147@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788813521 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813505.354016:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd1fd158-af17-4a1b-8f0b-82e57114d008:3320:1875706583799040:0@lo:400:kworker.0 00000100:00080000:0.0:1788813505.356338:0:3321:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff908746771000 already not connected (conn 1, was 1): DISCONN 10000000:01000000:3.0:1788813505.357344:0:3318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788813505.357351:0:3318:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788813505.357352:0:3318:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788813505.357357:0:3318:0:(import.c:65:import_set_state_nolock()) ffff908746771000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788813505.357365:0:3318:0:(import.c:545:import_select_connection()) MGC192.168.204.147@tcp: connect to NID 0@lo last attempt 203 00000100:00080000:3.0:1788813505.357379:0:3318:0:(import.c:666:import_select_connection()) MGC192.168.204.147@tcp: import ffff908746771000 using connection 192.168.204.147@tcp/0@lo 00000100:00100000:2.0:1788813505.357492:0:3318:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90876eb71880 x1875706583799808/t0(0) o250->MGC192.168.204.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813505.357541:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e924700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583799680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813505.357547:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd1fd158-af17-4a1b-8f0b-82e57114d008:3318:1875706583799552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813505.357684:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd1fd158-af17-4a1b-8f0b-82e57114d008:3321:1875706583799424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788813505.357760:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cd1fd158-af17-4a1b-8f0b-82e57114d008:3317:1875706583799808:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1788813505.357819:0:3317:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875706583799808 offset 0 length 520: 4 00100000:10000000:1.0:1788813505.365941:0:13189:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788813505.397651:0:13189:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb15d2 00000020:00000080:2.0:1788813505.397661:0:13189:0:(genops.c:885:class_export_put()) final put ffff908641182800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788813505.397678:0:13189:0:(tgt_mount.c:187:server_put_mount()) put mount ffff908774402000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788813505.397697:0:13189:0:(obd_mount.c:710:lustre_put_lsi()) put ffff908774402000 2 00000020:01000004:2.0:1788813505.397700:0:13189:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff908774402000 from lustre-OST0000 00000020:00000080:2.0:1788813505.397724:0:13189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788813505.397735:0:13189:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788813505.397738:0:13189:0:(genops.c:885:class_export_put()) final put ffff908641184800/lustre-OST0000_UUID 00000020:00000080:2.0:1788813505.397741:0:13189:0:(genops.c:844:class_export_destroy()) destroying export ffff908641184800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788813505.397750:0:13189:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:0.0:1788813505.397855:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff908641182800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:2.0:1788813505.397909:0:13189:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788813505.397913:0:13189:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788813505.397917:0:13189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788813505.397922:0:13189:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788813505.397928:0:13189:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9086413ff800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788813505.397934:0:13189:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff90876fac19c0) has exports, disconnecting them 00000020:00080000:2.0:1788813505.397938:0:13189:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9086413ff800), last request at 1788813282 00000020:00000080:2.0:1788813505.397942:0:13189:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb15fc 00000020:00080000:2.0:1788813505.397952:0:13189:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9086413ff800): rc 0 00000020:00000080:2.0:1788813505.397956:0:13189:0:(genops.c:885:class_export_put()) final put ffff9086413ff800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788813505.398884:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9086413ff800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788813505.403667:0:13189:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788813505.403675:0:13189:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788813505.403680:0:13189:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788813505.403687:0:13189:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788813505.403914:0:13189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788813505.403925:0:13189:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788813505.403933:0:13189:0:(obd_mount.c:710:lustre_put_lsi()) put ffff908774402000 1 00000020:00000080:0.0:1788813505.403940:0:13189:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb158c 00000020:00000080:0.0:1788813505.403949:0:13189:0:(genops.c:885:class_export_put()) final put ffff90874ad07800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788813505.403955:0:13189:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788813505.403962:0:13189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788813505.403966:0:13189:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788813505.403970:0:13189:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff90876fac0000) has no exports 00000020:00000080:1.0:1788813505.404347:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9086413fc800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788813505.404357:0:37:0:(genops.c:885:class_export_put()) final put ffff9086413fb800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788813505.404359:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9086413fb800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788813505.404374:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788813505.404430:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90874ad07800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788813505.483723:0:13189:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813505.483740:0:13189:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788813505.483747:0:13189:0:(genops.c:885:class_export_put()) final put ffff908774403800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788813505.483753:0:13189:0:(genops.c:844:class_export_destroy()) destroying export ffff908774403800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788813505.483770:0:13189:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788813505.483916:0:13189:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff908774403000 00000020:02000400:1.0:1788813505.483961:0:13189:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788813506.303148:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788813506.748762:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) cd1fd158-af17-4a1b-8f0b-82e57114d008->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788813506.748773:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) cd1fd158-af17-4a1b-8f0b-82e57114d008->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788813506.748776:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788813506.748779:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788813506.748784:0:37:0:(import.c:65:import_set_state_nolock()) ffff90876e4d2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788813506.748791:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 443 00000100:00080000:2.0:1788813506.748796:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788813506.748809:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90876e4d2800 using connection 192.168.204.147@tcp/0@lo 00000100:00100000:2.0:1788813506.748844:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90876eb70380 x1875706583799936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813506.748896:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3317:1875706583799936:0@lo:38:kworker.0 00000400:00000100:2.0:1788813506.748942:0:3317:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875706583799936 offset 0 length 520: 4 00010000:00010000:0.0:1788813507.352308:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813508.412707:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788813508.428442:0:13338:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788813508.451442:0:13338:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788813508.451525:0:13338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb17a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb17ae expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813508.451540:0:13338:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb17a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb17ae expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813508.451547:0:13338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb17a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d74dbab2ddb17ae expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813508.451554:0:13338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb17a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d74dbab2ddb17ae expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813508.451614:0:13338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788813508.451620:0:13338:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788813508.451644:0:13338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788813508.451654:0:13338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90876eb70380 x1875706583799936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788813526 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813508.451668:0:13338:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788813508.451674:0:13338:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788813508.451691:0:13338:0:(import.c:65:import_set_state_nolock()) ffff90876e4d2800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788813508.451697:0:13338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788813508.451701:0:13338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90876eb70380 x1875706583799936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788813526 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813508.451715:0:13338:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788813508.451718:0:13338:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00010000:00010000:2.0:1788813508.451900:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813508.451908:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb17a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d74dbab2ddb17ae expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813508.451915:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740030200 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:2.0:1788813508.451919:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb17a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d74dbab2ddb17ae expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813508.451927:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb17a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d74dbab2ddb17ae expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788813508.451934:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb17a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d74dbab2ddb17ae expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813508.451940:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788813508.451943:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788813508.451945:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788813508.451958:0:5838:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff908746771000 00010000:00010000:2.0:1788813508.451962:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb17a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d74dbab2ddb17ae expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813508.451968:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908740030200/0x6d74dbab2ddb17a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d74dbab2ddb17ae expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813508.451990:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813508.451999:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813508.452001:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813508.452027:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3317:1875706583799936:0@lo:38:kworker.0 00010000:00010000:0.0:1788813508.454554:0:13338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb17b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb17bc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813508.454793:0:13338:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb17b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb17bc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813508.454803:0:13338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb17b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d74dbab2ddb17bc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813508.454810:0:13338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb17b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d74dbab2ddb17bc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813508.454868:0:13338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813508.454874:0:13338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb19de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb19e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813508.454894:0:13338:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb19de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb19e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813508.454901:0:13338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb19de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d74dbab2ddb19e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813508.454907:0:13338:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb19de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d74dbab2ddb19e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813508.456342:0:7658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813508.456354:0:7658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb17b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d74dbab2ddb17bc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813508.456364:0:7658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740030600 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:1.0:1788813508.456369:0:7658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb17b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d74dbab2ddb17bc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813508.456378:0:7658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb17b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d74dbab2ddb17bc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813508.456386:0:7658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb17b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d74dbab2ddb17bc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813508.456392:0:7658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788813508.456394:0:7658:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1788813508.456405:0:7658:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff908746771000 00010000:00010000:1.0:1788813508.456409:0:7658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb17b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d74dbab2ddb17bc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813508.456416:0:7658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908740030600/0x6d74dbab2ddb17b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d74dbab2ddb17bc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813508.456429:0:7658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813508.456432:0:7658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb19de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d74dbab2ddb19e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813508.456437:0:7658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031800 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:1.0:1788813508.456440:0:7658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb19de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d74dbab2ddb19e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813508.456464:0:7658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb19de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d74dbab2ddb19e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813508.456470:0:7658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb19de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d74dbab2ddb19e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813508.456475:0:7658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788813508.456477:0:7658:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788813508.456480:0:7658:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff908746771000 00010000:00010000:1.0:1788813508.456482:0:7658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb19de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d74dbab2ddb19e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813508.456488:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813508.456490:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813508.456491:0:7658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813508.456562:0:13338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788813508.456576:0:13338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb19de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d74dbab2ddb19e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813508.456602:0:13338:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1788813508.456609:0:13338:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1788813508.456611:0:13338:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788813508.456641:0:13338:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788813508.456645:0:13338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788813508.456651:0:13338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788813508.456658:0:13338:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788813508.456662:0:13338:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff90876fac3380) has no exports 00000020:00080000:0.0:1788813508.456697:0:13338:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff90876fac3380) has no exports 00010000:00010000:2.0:1788813508.460099:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788813508.460526:0:13338:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90874919ed80 - data ffff908756fcea20/ffff90876e5c6800 00000020:01000000:2.0:1788813508.461240:0:13338:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff908744c10f60 - data ffff908756e90360/ffff90876e5c6c00 00100000:10000000:3.0:1788813508.488276:0:13338:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788813508.524385:0:13338:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb169d 00000020:00000080:0.0:1788813508.524396:0:13338:0:(genops.c:885:class_export_put()) final put ffff908749b86800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788813508.524415:0:13338:0:(tgt_mount.c:187:server_put_mount()) put mount ffff908641187800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788813508.524418:0:13338:0:(obd_mount.c:710:lustre_put_lsi()) put ffff908641187800 2 00000020:01000004:0.0:1788813508.524421:0:13338:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff908641187800 from lustre-OST0001 00000020:00000080:0.0:1788813508.524445:0:13338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788813508.524455:0:13338:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788813508.524472:0:13338:0:(genops.c:885:class_export_put()) final put ffff908773ad0800/lustre-OST0001_UUID 00000020:00000080:0.0:1788813508.524474:0:13338:0:(genops.c:844:class_export_destroy()) destroying export ffff908773ad0800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788813508.524483:0:13338:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788813508.524616:0:13338:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import cd1fd158-af17-4a1b-8f0b-82e57114d008->MGS 00010000:00010000:0.0:1788813508.524632:0:13338:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908740031a00/0x6d74dbab2ddb15af lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d74dbab2ddb15b6 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813508.524644:0:13338:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908740031a00/0x6d74dbab2ddb15af lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d74dbab2ddb15b6 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813508.524651:0:13338:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788813508.524653:0:13338:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788813508.524656:0:13338:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788813508.524667:0:13338:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff908746771000 00010000:00010000:0.0:1788813508.524670:0:13338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908740031a00/0x6d74dbab2ddb15af lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d74dbab2ddb15b6 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788813508.524821:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff908749b86800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00010000:00010000:0.0:1788813508.524953:0:13338:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908750ad1600/0x6d74dbab2ddb17fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d74dbab2ddb1802 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813508.524961:0:13338:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908750ad1600/0x6d74dbab2ddb17fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d74dbab2ddb1802 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813508.524966:0:13338:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788813508.524968:0:13338:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788813508.524970:0:13338:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788813508.524989:0:13338:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff908746771000 00010000:00010000:0.0:1788813508.524992:0:13338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908750ad1600/0x6d74dbab2ddb17fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d74dbab2ddb1802 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788813508.525007:0:13338:0:(import.c:65:import_set_state_nolock()) ffff908746771000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788813508.525017:0:13338:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788813508.525019:0:13338:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788813508.525020:0:13338:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788813508.525025:0:13338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788813508.525035:0:13338:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90876eb71880 x1875706583799808/t0(0) o250->MGC192.168.204.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788813515 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788813508.525085:0:13338:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788813508.525087:0:13338:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:2.0:1788813508.525417:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cd1fd158-af17-4a1b-8f0b-82e57114d008:3317:1875706583799808:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:0.0:1788813508.525477:0:13338:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788813508.525485:0:13338:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb1490 00000020:00000080:0.0:1788813508.525491:0:13338:0:(genops.c:885:class_export_put()) final put ffff908746776800/cd1fd158-af17-4a1b-8f0b-82e57114d008 00000020:01000000:0.0:1788813508.525507:0:13338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.147@tcp (flags='') 00000020:00000080:0.0:1788813508.525513:0:13338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788813508.525519:0:13338:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.147@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788813508.525523:0:13338:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff908749b5cd40) has no exports 10000000:01000000:1.0:1788813508.525596:0:5846:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788813508.525700:0:13338:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.147@tcp: client import never connected 00000100:00080000:0.0:1788813508.525703:0:13338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788813508.525713:0:13338:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788813508.525716:0:13338:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788813508.525718:0:13338:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788813508.525749:0:13338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788813508.525754:0:13338:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.147@tcp (uuid cd1fd158-af17-4a1b-8f0b-82e57114d008) 00000020:01000000:0.0:1788813508.525759:0:13338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788813508.525762:0:13338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788813508.525766:0:13338:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788813508.525771:0:13338:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff90876e4d1000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788813508.525776:0:13338:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff9087601a8000) has exports, disconnecting them 00000020:00080000:0.0:1788813508.525781:0:13338:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff90876e4d1000), last request at 1788813302 00000020:00000080:0.0:1788813508.525785:0:13338:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb16c7 00000020:00080000:0.0:1788813508.525806:0:13338:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90876e4d1000): rc 0 00000020:00000080:0.0:1788813508.525810:0:13338:0:(genops.c:885:class_export_put()) final put ffff90876e4d1000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788813508.527608:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff908746776800/cd1fd158-af17-4a1b-8f0b-82e57114d008 for MGC192.168.204.147@tcp 00000020:00000080:2.0:1788813508.527626:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff908746771000 for MGC192.168.204.147@tcp 00000020:00000080:2.0:1788813508.527632:0:37:0:(genops.c:885:class_export_put()) final put ffff908749c1a000/cd1fd158-af17-4a1b-8f0b-82e57114d008 00000020:00000080:2.0:1788813508.527635:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff908749c1a000/cd1fd158-af17-4a1b-8f0b-82e57114d008 for MGC192.168.204.147@tcp 00000020:01000000:2.0:1788813508.527640:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.147@tcp (cd1fd158-af17-4a1b-8f0b-82e57114d008) 00000020:00000080:2.0:1788813508.528258:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90876e4d1000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788813508.528735:0:13338:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788813508.528741:0:13338:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788813508.528745:0:13338:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788813508.528750:0:13338:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788813508.528835:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:2.0:1788813508.528926:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90876e4d2800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1788813508.529124:0:7658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788813508.529337:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788813508.529475:0:5832:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9087587c9c00:5832] 0 exiting: rc = 1 00000100:00100000:2.0:1788813508.529554:0:5833:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9087587c9000:5833] 1 exiting: rc = 0 00000100:00100000:1.0:1788813508.529671:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.529913:0:5836:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9087587cba00:5836] 2 exiting: rc = 0 00000100:00100000:2.0:1788813508.530015:0:8477:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff908641982e00:8477] 3 exiting: rc = 0 00000100:00100000:2.0:1788813508.530095:0:5834:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9087587c9600:5834] 0 exiting: rc = 1 00000100:00100000:2.0:1788813508.530160:0:5835:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff90874a46bc00:5835] 1 exiting: rc = 0 00000100:00100000:1.0:1788813508.530516:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530524:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530531:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530537:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530543:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530550:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530556:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530619:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530626:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530632:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530639:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530644:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530651:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530657:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530662:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530668:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530674:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530680:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530685:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530691:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530697:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530712:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530719:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530724:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530729:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530734:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530740:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530745:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530749:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530755:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530761:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530767:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530774:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530779:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530784:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530789:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530794:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530800:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530806:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530812:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530817:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530821:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530834:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530840:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530845:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530850:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530855:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530861:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530866:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530871:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530877:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530881:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530886:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530891:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530897:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530902:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530908:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530912:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530917:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530923:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530930:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530936:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530941:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.530946:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788813508.533136:0:13338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813508.533151:0:13338:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788813508.533156:0:13338:0:(genops.c:885:class_export_put()) final put ffff908641183000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788813508.533161:0:13338:0:(genops.c:844:class_export_destroy()) destroying export ffff908641183000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788813508.533166:0:13338:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788813508.533230:0:13338:0:(obd_mount.c:710:lustre_put_lsi()) put ffff908641187800 1 00000020:00000080:1.0:1788813508.533237:0:13338:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d74dbab2ddb166c 00000020:00000080:1.0:1788813508.533243:0:13338:0:(genops.c:885:class_export_put()) final put ffff90877c193000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788813508.533262:0:13338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788813508.533267:0:13338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788813508.533272:0:13338:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788813508.533276:0:13338:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff90876f9cb380) has no exports 00000020:00000080:2.0:1788813508.533421:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90877c193000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788813508.554256:0:13338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813508.554272:0:13338:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788813508.554278:0:13338:0:(genops.c:885:class_export_put()) final put ffff908748c30000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788813508.554283:0:13338:0:(genops.c:844:class_export_destroy()) destroying export ffff908748c30000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788813508.554297:0:13338:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788813508.554494:0:13338:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9087466ba800 00000020:01000000:1.0:1788813508.554516:0:13338:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788813508.554520:0:13338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788813508.554524:0:13338:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788813508.554528:0:13338:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff90877c3f8000) has no exports 00000020:00000080:1.0:1788813508.556535:0:13338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788813508.556553:0:13338:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788813508.556558:0:13338:0:(genops.c:885:class_export_put()) final put ffff90874ad04800/OSS_uuid 00000020:00000080:1.0:1788813508.556562:0:13338:0:(genops.c:844:class_export_destroy()) destroying export ffff90874ad04800/OSS_uuid for OSS 00000020:01000000:1.0:1788813508.556596:0:13338:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1788813508.556684:0:5845:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788813508.557167:0:6706:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9087466c5e00:6706] 2 exiting: rc = 0 00000100:00100000:1.0:1788813508.557230:0:6705:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9087466c5200:6705] 1 exiting: rc = 0 00000100:00100000:0.0:1788813508.558737:0:8270:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff90877436f600:8270] 3 exiting: rc = 0 00000100:00100000:2.0:1788813508.562197:0:6704:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9087466c4800:6704] 0 exiting: rc = 1 00000100:00100000:1.0:1788813508.562737:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562746:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562754:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562761:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562766:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562771:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562776:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562781:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562786:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562805:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562813:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562818:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562823:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562828:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562834:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562839:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562857:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562863:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562869:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562874:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562879:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562885:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562892:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562898:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562903:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562909:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562915:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562920:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562926:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562931:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562936:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562942:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562948:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562953:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562959:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562964:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.562970:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.563265:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.563274:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.563279:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.563284:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.563290:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.563295:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.563300:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.563305:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.563311:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.563316:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.563321:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.563326:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.563332:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.563337:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.563350:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.563355:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.563360:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.563365:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.563370:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.563375:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.563381:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.563386:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.563390:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.563395:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.563401:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.563406:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.563419:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.565227:0:6707:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9087466c4400:6707] 0 exiting: rc = 1 00000100:00100000:0.0:1788813508.565441:0:6709:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff90877bb6ac00:6709] 1 exiting: rc = 0 00000100:00100000:1.0:1788813508.565605:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565614:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565620:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565624:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565629:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565633:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565637:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565642:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565647:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565652:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565658:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565663:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565668:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565673:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565687:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565692:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565697:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565702:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565712:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565718:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565723:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565728:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565746:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565750:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565755:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565760:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565765:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565771:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565776:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565781:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565786:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565791:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565806:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565811:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565815:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565820:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565824:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565829:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565834:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565839:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565844:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565849:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565854:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565860:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565866:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565870:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565875:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565880:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565884:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565889:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565894:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565899:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565904:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565908:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565913:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565918:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565923:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565935:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565940:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565946:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565951:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565956:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565961:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.565966:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.567607:0:6710:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff90877c358600:6710] 0 exiting: rc = 1 00000100:00100000:0.0:1788813508.568437:0:6711:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff90877c359c00:6711] 1 exiting: rc = 0 00000100:00100000:0.0:1788813508.568624:0:6712:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff90877c359000:6712] 2 exiting: rc = 0 00000100:00100000:1.0:1788813508.569248:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569257:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569263:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569269:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569275:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569282:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569288:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569293:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569299:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569304:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569310:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569316:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569322:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569328:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569333:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569338:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569345:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569351:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569356:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569363:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569369:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569392:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569399:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569405:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569411:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569416:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569422:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569428:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569454:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569459:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569466:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569472:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569477:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569482:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569487:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569493:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569498:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569503:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569509:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569514:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569519:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569527:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569533:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569539:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569550:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569571:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569595:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569602:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569608:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569613:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569620:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569625:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569633:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569639:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569645:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569651:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569656:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569661:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569666:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569672:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569691:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569697:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.569703:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.570229:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.578518:0:6713:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9087466c5a00:6713] 0 exiting: rc = 1 00000100:00100000:0.0:1788813508.579254:0:6714:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9087466c4e00:6714] 1 exiting: rc = 0 00000100:00100000:1.0:1788813508.579421:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579430:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579436:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579442:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579446:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579451:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579457:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579462:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579467:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579472:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579478:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579483:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579489:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579493:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579499:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579504:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579509:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579514:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579519:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579524:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579529:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579533:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579539:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579544:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579548:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579552:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579557:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579562:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579606:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579613:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579618:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579623:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579629:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579633:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579652:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579658:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579662:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579667:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579672:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579689:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579694:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579699:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579710:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579716:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579721:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579726:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579731:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579753:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579762:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579767:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579772:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579776:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579782:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579786:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579791:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579985:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579991:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.579996:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.580001:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.580006:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.580011:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.580016:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.580021:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788813508.580025:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.581099:0:6715:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9087466c5600:6715] 0 exiting: rc = 1 00000100:00100000:3.0:1788813508.581916:0:6716:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9087466ece00:6716] 1 exiting: rc = 0 00000100:00100000:2.0:1788813508.582248:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582256:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582263:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582270:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582276:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582283:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582303:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582310:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582317:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582324:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582331:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582336:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582342:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582350:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582359:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582365:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582370:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582376:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582401:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582409:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582415:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582420:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582426:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582432:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582438:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582443:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582450:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582456:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582462:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582468:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582487:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582495:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582501:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582507:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582513:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582527:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582533:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582539:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582545:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582551:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582557:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582564:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582631:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582640:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582646:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582653:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582659:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582664:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582669:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582687:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582694:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.582700:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.583138:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.583148:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.583174:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.583193:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.583200:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.583207:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.583215:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.583220:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.583226:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.583231:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.583237:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788813508.583251:0:13338:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788813508.604730:0:13338:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788813531.418420:0:13955:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg447-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788813540.544911:0:14416:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788813540.544918:0:14416:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788813540.545036:0:14416:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90874923c800 00000020:01000004:1.0:1788813540.545068:0:14416:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788813540.545076:0:14416:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788813540.546037:0:14416:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff90877fba3380) 00000020:00000080:1.0:1788813540.546160:0:14416:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788813540.572761:0:14416:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788813540.575443:0:14416:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788813540.576229:0:14416:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788813540.576298:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 409: rc = 0 00100000:10000000:2.0:1788813540.576381:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 409: rc = 0 00100000:10000000:2.0:1788813540.576473:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 409: rc = 0 00100000:10000000:2.0:1788813540.576661:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 409: rc = 0 00100000:10000000:2.0:1788813540.576744:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 409: rc = 0 00100000:10000000:2.0:1788813540.576965:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 409: rc = 0 00100000:10000000:2.0:1788813540.577335:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 411: rc = 0 00100000:10000000:2.0:1788813540.578725:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 677: rc = 0 00100000:10000000:2.0:1788813540.578891:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 677: rc = 0 00100000:10000000:2.0:1788813540.580231:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 775: rc = 0 00100000:10000000:2.0:1788813540.580461:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 775: rc = 0 00100000:10000000:2.0:1788813540.580914:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 775: rc = 0 00100000:10000000:2.0:1788813540.581277:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 775: rc = 0 00100000:10000000:2.0:1788813540.581503:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 775: rc = 0 00100000:10000000:2.0:1788813540.581759:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 775: rc = 0 00100000:10000000:2.0:1788813540.582202:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 775: rc = 0 00100000:10000000:2.0:1788813540.582412:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 775: rc = 0 00100000:10000000:2.0:1788813540.582759:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 775: rc = 0 00100000:10000000:2.0:1788813540.583196:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 775: rc = 0 00100000:10000000:2.0:1788813540.583422:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 775: rc = 0 00100000:10000000:2.0:1788813540.583697:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 775: rc = 0 00100000:10000000:2.0:1788813540.584344:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 784: rc = 0 00100000:10000000:2.0:1788813540.584631:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 784: rc = 0 00100000:10000000:2.0:1788813540.584883:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 784: rc = 0 00100000:10000000:2.0:1788813540.585386:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 784: rc = 0 00100000:10000000:2.0:1788813540.585673:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 784: rc = 0 00100000:10000000:2.0:1788813540.585976:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 784: rc = 0 00100000:10000000:2.0:1788813540.586369:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 784: rc = 0 00100000:10000000:2.0:1788813540.586962:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 784: rc = 0 00100000:10000000:2.0:1788813540.587348:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 784: rc = 0 00100000:10000000:2.0:1788813540.588251:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 784: rc = 0 00100000:10000000:2.0:1788813540.588828:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 784: rc = 0 00100000:10000000:2.0:1788813540.589255:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 784: rc = 0 00100000:10000000:2.0:1788813540.589472:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 784: rc = 0 00100000:10000000:2.0:1788813540.589904:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 784: rc = 0 00100000:10000000:2.0:1788813540.590214:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 784: rc = 0 00100000:10000000:2.0:1788813540.590472:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 784: rc = 0 00100000:10000000:2.0:1788813540.590779:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 784: rc = 0 00100000:10000000:2.0:1788813540.591031:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 784: rc = 0 00100000:10000000:2.0:1788813540.591308:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 784: rc = 0 00100000:10000000:2.0:1788813540.591611:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 784: rc = 0 00100000:10000000:2.0:1788813540.591862:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 784: rc = 0 00100000:10000000:2.0:1788813540.592190:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 784: rc = 0 00100000:10000000:2.0:1788813540.593263:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 784: rc = 0 00100000:10000000:2.0:1788813540.594051:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 784: rc = 0 00100000:10000000:2.0:1788813540.594328:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 784: rc = 0 00100000:10000000:2.0:1788813540.594671:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 784: rc = 0 00100000:10000000:2.0:1788813540.594926:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 784: rc = 0 00100000:10000000:2.0:1788813540.598676:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 784: rc = 0 00100000:10000000:2.0:1788813540.598953:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 784: rc = 0 00100000:10000000:2.0:1788813540.599189:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 784: rc = 0 00100000:10000000:2.0:1788813540.599442:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 784: rc = 0 00100000:10000000:2.0:1788813540.599755:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 784: rc = 0 00100000:10000000:2.0:1788813540.600100:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 567: rc = 0 00100000:10000000:2.0:1788813540.600672:0:14416:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788813540.606866:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 772: rc = 0 00100000:10000000:3.0:1788813540.607102:0:14416:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788813540.609686:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 772: rc = 0 00100000:10000000:3.0:1788813540.609929:0:14416:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788813540.609993:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 772: rc = 0 00100000:10000000:3.0:1788813540.610351:0:14416:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788813540.610419:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 678: rc = 0 00100000:10000000:3.0:1788813540.610648:0:14416:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788813540.610712:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 678: rc = 0 00100000:10000000:3.0:1788813540.610889:0:14416:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788813540.610956:0:14416:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 678: rc = 0 00000020:00000080:3.0:1788813540.611257:0:14416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788813540.611265:0:14416:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788813540.611276:0:14416:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d74dbab2ddb2783 00000020:01000004:3.0:1788813540.611286:0:14416:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788813540.611291:0:14416:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788813540.611297:0:14416:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90874923c800 from MGS 00000020:01000004:3.0:1788813540.611301:0:14416:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788813540.611311:0:14416:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff90877c3f99c0) 00000020:00000080:3.0:1788813540.611322:0:14416:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788813540.611378:0:14416:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90874923c800 from MGS, refs=2 00080000:01000000:3.0:1788813540.611384:0:14416:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788813540.611389:0:14416:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d74dbab2ddb2791 00000100:00100000:3.0:1788813540.611479:0:14416:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788813540.611650:0:14416:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788813540.611656:0:14416:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788813540.613856:0:14416:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788813540.613867:0:14416:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788813540.614772:0:14416:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813540.614943:0:14416:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788813540.614954:0:14416:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788813540.615859:0:14416:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788813540.615868:0:14416:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788813540.616264:0:14416:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788813540.616272:0:14416:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788813540.617203:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813540.617207:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813540.617209:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813540.617518:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813540.617520:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813540.617522:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813540.618432:0:14416:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788813540.626328:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788813540.634790:0:14416:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788813540.634810:0:14416:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788813540.634813:0:14416:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788813540.636095:0:14425:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788813540.636236:0:14416:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788813540.636331:0:14416:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788813540.636824:0:14416:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788813540.637095:0:14416:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788813540.637249:0:14416:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788813540.637255:0:14416:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788813540.638142:0:14416:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788813540.638151:0:14416:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788813540.638388:0:14416:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788813540.638394:0:14416:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788813540.645014:0:14416:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788813540.645037:0:14416:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.147@tcp' 00000020:01000004:0.0:1788813540.645038:0:14416:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788813540.645065:0:14416:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.147@tcp (typ=mgc) 00000020:00000080:0.0:1788813540.645079:0:14416:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.147@tcp (ffff90876f9c8000) 00000020:00000080:0.0:1788813540.645094:0:14416:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788813540.645172:0:14416:0:(ldlm_lib.c:102:import_set_conn()) imp ffff908781da0800@MGC192.168.204.147@tcp: add connection 192.168.204.147@tcp at head 00010000:00010000:0.0:1788813540.645329:0:14416:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.147@tcp-0 is initialized 00000040:01000000:0.0:1788813540.645335:0:14416:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.147@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788813540.648506:0:14431:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788813540.648552:0:14416:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.147@tcp (uuid 7dbbe9e7-bc92-4769-ab24-5734c43403ec) 00000020:00000080:3.0:1788813540.648611:0:14416:0:(genops.c:1384:class_connect()) connect: client 7dbbe9e7-bc92-4769-ab24-5734c43403ec, cookie 0x6d74dbab2ddb279f 00000100:00080000:3.0:1788813540.648625:0:14416:0:(import.c:545:import_select_connection()) MGC192.168.204.147@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788813540.648637:0:14416:0:(import.c:666:import_select_connection()) MGC192.168.204.147@tcp: import ffff908781da0800 using connection 192.168.204.147@tcp/0@lo 00000100:00100000:3.0:1788813540.648676:0:14416:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90876e450e00 x1875706583800064/t0(0) o250->MGC192.168.204.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788813540.648699:0:14416:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 7dbbe9e7-bc92-4769-ab24-5734c43403ec->MGS 00000020:01000004:3.0:1788813540.648719:0:14416:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788813540.648724:0:14416:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788813540.648737:0:14416:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff90877c3f8000) 00000020:00000080:3.0:1788813540.648748:0:14416:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:2.0:1788813540.651962:0:14429:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1788813540.654345:0:14416:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813540.654574:0:14416:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788813540.654605:0:14416:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788813540.654676:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e450e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3317:1875706583800064:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788813540.654753:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813540.654848:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583800064 00000100:00100000:3.0:1788813540.654857:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583800064 00000100:00100000:3.0:1788813540.654887:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788813540.654895:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3317:x1875706583800064:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788813540.654930:0:14426:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 7dbbe9e7-bc92-4769-ab24-5734c43403ec@0@lo t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:3.0:1788813540.654965:0:14426:0:(genops.c:1384:class_connect()) connect: client 7dbbe9e7-bc92-4769-ab24-5734c43403ec, cookie 0x6d74dbab2ddb27ad 00000100:00080000:3.0:1788813540.655125:0:14426:0:(import.c:65:import_set_state_nolock()) ffff90877bb4e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788813540.655184:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+5:3317:x1875706583800064:12345-0@lo:250:mount.lustre.0 Request processed in 287us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813540.655192:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788813540.655237:0:3317:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.147@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788813540.655245:0:3317:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.147@tcp: connect to target with instance 0 00000100:00080000:3.0:1788813540.655252:0:3317:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.147@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788813540.655257:0:3317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788813540.655260:0:3317:0:(import.c:65:import_set_state_nolock()) ffff908781da0800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788813540.655262:0:3317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788813540.655266:0:3317:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788813540.655270:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e450e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3317:1875706583800064:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788813540.662814:0:14416:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788813540.662825:0:14416:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788813540.668596:0:14416:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788813540.668610:0:14416:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788813540.675249:0:14416:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788813540.675459:0:14416:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788813540.675466:0:14416:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788813540.679549:0:14416:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788813540.679573:0:14416:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788813540.723197:0:14416:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788813540.723439:0:14416:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788813540.723446:0:14416:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788813540.724980:0:14416:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788813540.724994:0:14416:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788813540.725535:0:14416:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788813540.725907:0:14416:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788813540.725912:0:14416:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788813540.726426:0:14416:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788813540.726435:0:14416:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788813540.728436:0:14416:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788813540.728991:0:14416:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788813540.728998:0:14416:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788813540.729496:0:14416:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788813540.729503:0:14416:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788813540.730340:0:14416:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788813540.730510:0:14416:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788813540.730516:0:14416:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788813540.731222:0:14416:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788813540.731232:0:14416:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788813540.747994:0:14416:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788813540.748375:0:14416:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788813540.748382:0:14416:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788813540.750130:0:14416:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788813540.750142:0:14416:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788813540.750985:0:14416:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788813540.750995:0:14416:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788813540.751941:0:14416:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788813540.751965:0:14416:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788813540.751973:0:14416:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.147@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788813540.752139:0:14416:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.147@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788813540.752189:0:14416:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.147@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788813540.752194:0:14416:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788813540.752196:0:14416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788813540.752198:0:14416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788813540.752199:0:14416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788813540.752201:0:14416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788813540.752202:0:14416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788813540.752204:0:14416:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788813540.752206:0:14416:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788813540.752207:0:14416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788813540.752209:0:14416:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788813540.752211:0:14416:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788813540.752213:0:14416:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788813540.752215:0:14416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788813540.752216:0:14416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788813540.752217:0:14416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788813540.752218:0:14416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788813540.752220:0:14416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788813540.752221:0:14416:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788813540.752222:0:14416:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788813540.752223:0:14416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788813540.752224:0:14416:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788813540.752257:0:14416:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788813540.752287:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e925180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583800192:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788813540.752369:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813540.752426:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff908760337e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788813540.752570:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583800192 00000100:00100000:2.0:1788813540.752577:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583800192 00000100:00100000:2.0:1788813540.752661:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813540.752672:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+5:14416:x1875706583800192:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788813540.752723:0:14428:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788813540.752727:0:14428:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788813540.752731:0:14428:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788813540.753317:0:14450:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788813540.753724:0:14428:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1788813540.756015:0:14451:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788813540.756024:0:14451:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788813540.756027:0:14451:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788813540.756206:0:14451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1788813540.756771:0:14428:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788813540.756783:0:14428:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788813540.764369:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+5:14416:x1875706583800192:12345-0@lo:253:mount.lustre.0 Request processed in 11690us (11991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813540.764383:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788813540.764471:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e925180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583800192:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788813540.764488:0:14416:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788813540.764491:0:14416:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788813540.764493:0:14416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788813540.764494:0:14416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788813540.764496:0:14416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788813540.764497:0:14416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788813540.764498:0:14416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788813540.764500:0:14416:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788813540.764501:0:14416:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788813540.764503:0:14416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788813540.764504:0:14416:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788813540.764523:0:14416:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90874923c800 from lustre-MDT0000 10000000:01000000:0.0:1788813540.764683:0:14416:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788813540.764686:0:14416:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788813540.764691:0:14416:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff90876f9c8000 10000000:01000000:0.0:1788813540.764696:0:14416:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788813540.764704:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90876f9c8000 from 1 10000000:01000000:0.0:1788813540.764707:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788813540.764749:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb27b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813540.764760:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb27b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813540.764785:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb27b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813540.764804:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e925180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583800320:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788813540.764841:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813540.764914:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749f35c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813540.764949:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583800320 00000100:00100000:2.0:1788813540.764956:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583800320 00000100:00100000:2.0:1788813540.765023:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788813540.765032:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+5:14416:x1875706583800320:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813540.765044:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813540.765067:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908774368600/0x6d74dbab2ddb27bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb27b4 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813540.765211:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908774368600/0x6d74dbab2ddb27bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb27b4 expref: 6 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813540.765224:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908774368600/0x6d74dbab2ddb27bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb27b4 expref: 6 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813540.765233:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368600, rc 0) 00000100:00100000:2.0:1788813540.765280:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+6:14416:x1875706583800320:12345-0@lo:101:mount.lustre.0 Request processed in 250us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813540.765286:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813540.765364:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e925180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583800320:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813540.765377:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb27b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb27bb expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813540.765396:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb27b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb27bb expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813540.765445:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583800448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813540.765471:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813540.765688:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749cde240 going to sleep for 11 seconds 00000100:00100000:0.0:1788813540.765805:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583800448 00000100:00100000:0.0:1788813540.765810:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583800448 00000100:00100000:0.0:1788813540.765834:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788813540.765841:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+6:14416:x1875706583800448:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813540.766073:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+6:14416:x1875706583800448:12345-0@lo:501:mount.lustre.0 Request processed in 232us (600us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788813540.766091:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788813540.766229:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583800448:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788813540.766252:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788813540.766275:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb27b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb27bb expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813540.766285:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb27b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb27bb expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813540.766293:0:14416:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90874923c800 10000000:01000000:1.0:1788813540.766298:0:14416:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788813540.766302:0:14416:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90874923c800 10000000:01000000:1.0:1788813540.766305:0:14416:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788813540.766307:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90874923c800 from 1 10000000:01000000:1.0:1788813540.766310:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788813540.766331:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908749d72e00/0x6d74dbab2ddb27c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813540.766338:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908749d72e00/0x6d74dbab2ddb27c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813540.766346:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908749d72e00/0x6d74dbab2ddb27c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813540.766366:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583800576:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788813540.766394:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813540.766414:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749cde240 going to sleep for 11 seconds 00000100:00100000:0.0:1788813540.766540:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583800576 00000100:00100000:0.0:1788813540.766545:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583800576 00000100:00100000:0.0:1788813540.766672:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788813540.766678:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+6:14416:x1875706583800576:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813540.766687:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813540.766700:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908740031a00/0x6d74dbab2ddb27c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb27c2 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813540.766716:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908740031a00/0x6d74dbab2ddb27c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb27c2 expref: 7 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813540.766725:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908740031a00/0x6d74dbab2ddb27c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb27c2 expref: 7 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813540.766744:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740031a00, rc 0) 00000100:00100000:0.0:1788813540.766772:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+7:14416:x1875706583800576:12345-0@lo:101:mount.lustre.0 Request processed in 93us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813540.766778:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813540.766852:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583800576:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813540.766864:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908749d72e00/0x6d74dbab2ddb27c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb27c9 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813540.766873:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908749d72e00/0x6d74dbab2ddb27c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb27c9 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813540.766884:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788813540.766900:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908749d72e00/0x6d74dbab2ddb27c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb27c9 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813540.766908:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908749d72e00/0x6d74dbab2ddb27c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb27c9 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813540.766914:0:14416:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788813540.766918:0:14416:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788813540.766922:0:14416:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90874923c800 10000000:01000000:1.0:1788813540.766925:0:14416:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788813540.766929:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788813540.766931:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788813540.766946:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908749d73200/0x6d74dbab2ddb27d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813540.766953:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908749d73200/0x6d74dbab2ddb27d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813540.766969:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908749d73200/0x6d74dbab2ddb27d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813540.766983:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583800704:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788813540.767009:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813540.767027:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749cde240 going to sleep for 11 seconds 00000100:00100000:0.0:1788813540.767213:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583800704 00000100:00100000:0.0:1788813540.767218:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583800704 00000100:00100000:0.0:1788813540.767239:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788813540.767245:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+7:14416:x1875706583800704:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813540.767253:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813540.767263:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908740030600/0x6d74dbab2ddb27d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb27d0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813540.767277:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908740030600/0x6d74dbab2ddb27d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb27d0 expref: 8 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813540.767287:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908740030600/0x6d74dbab2ddb27d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb27d0 expref: 8 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813540.767293:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740030600, rc 0) 00000100:00100000:0.0:1788813540.767334:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+8:14416:x1875706583800704:12345-0@lo:101:mount.lustre.0 Request processed in 88us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813540.767340:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813540.767412:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583800704:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813540.767423:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908749d73200/0x6d74dbab2ddb27d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb27d7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813540.767431:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908749d73200/0x6d74dbab2ddb27d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb27d7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813540.767472:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583800832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813540.767497:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813540.767518:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749cde240 going to sleep for 11 seconds 00000100:00100000:0.0:1788813540.767664:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583800832 00000100:00100000:0.0:1788813540.767669:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583800832 00000100:00100000:0.0:1788813540.767687:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788813540.767692:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+8:14416:x1875706583800832:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813540.768237:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583800832:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813540.768285:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583800960:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788813540.768324:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813540.768342:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749cde240 going to sleep for 11 seconds 00000100:00100000:0.0:1788813540.768388:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+9:14416:x1875706583800832:12345-0@lo:501:mount.lustre.0 Request processed in 356us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813540.768402:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788813540.768424:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583800960 00000100:00100000:0.0:1788813540.768428:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583800960 00000100:00100000:0.0:1788813540.768443:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788813540.768448:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+9:14416:x1875706583800960:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788813540.769921:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+9:14416:x1875706583800960:12345-0@lo:503:mount.lustre.0 Request processed in 1466us (1590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813540.769931:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788813540.770043:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583800960:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788813540.771319:0:14452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14452:1875706583801088:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813540.771395:0:14452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813540.771490:0:14452:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fab1480 going to sleep for 11 seconds 00000100:00100000:0.0:1788813540.771533:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583801088 00000100:00100000:0.0:1788813540.771540:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583801088 00000100:00100000:0.0:1788813540.771766:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788813540.771776:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+9:14452:x1875706583801088:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788813540.772247:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+9:14452:x1875706583801088:12345-0@lo:502:llog_process_th.0 Request processed in 471us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813540.772255:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788813540.772408:0:14452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb71880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14452:1875706583801088:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788813540.772438:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813540.772450:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813540.772453:0:14452:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788813540.772460:0:14452:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788813540.772470:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788813540.772486:0:14452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff90877fba0000) 00000020:00000080:1.0:1788813540.772510:0:14452:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788813540.772517:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788813540.772741:0:14452:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788813540.772749:0:14452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d74dbab2ddb27e5 00000020:00000080:1.0:1788813540.772947:0:14452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788813540.772952:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813540.772956:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813540.772957:0:14452:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788813540.772960:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788813540.772964:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813540.772965:0:14452:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788813540.772968:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788813540.772975:0:14452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff90877fba19c0) 00000020:00000080:1.0:1788813540.772985:0:14452:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788813540.772989:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788813540.772991:0:14452:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788813540.772994:0:14452:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788813540.772999:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788813540.773033:0:14452:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90874923c800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788813540.773045:0:14452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff90877fba4d40) 00000020:00000080:1.0:1788813540.773175:0:14452:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788813540.773228:0:14452:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788813540.773233:0:14452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d74dbab2ddb27fa 00000020:00000080:1.0:1788813540.773327:0:14452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788813540.773334:0:14452:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788813540.773339:0:14452:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x6d74dbab2ddb2801 00080000:01000000:1.0:1788813540.773343:0:14452:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788813540.773347:0:14452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d74dbab2ddb2808 00010000:00010000:3.0:1788813540.830521:0:14452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788813540.831185:0:14452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1788813540.831393:0:14452:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788813540.832253:0:14452:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff90877c3fb380) 00000020:00000080:3.0:1788813540.832276:0:14452:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788813540.832346:0:14452:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788813540.832353:0:14452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d74dbab2ddb2816 00000020:00000080:2.0:1788813540.840349:0:14452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788813540.846168:0:14452:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x6d74dbab2ddb281d 00000020:00000080:3.0:1788813540.846648:0:14452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788813540.846661:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813540.846668:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813540.846670:0:14452:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788813540.846684:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788813540.846687:0:14452:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788813540.846688:0:14452:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788813540.846689:0:14452:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788813540.846691:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788813540.846693:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813540.846694:0:14452:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788813540.846697:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813540.846702:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813540.846703:0:14452:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788813540.846708:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788813540.846746:0:14452:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788813540.846758:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813540.846760:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813540.846761:0:14452:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788813540.846764:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788813540.846766:0:14452:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788813540.846769:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813540.846770:0:14452:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788813540.846773:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788813540.846777:0:14452:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.147@tcp to nid 0x20000c0a8cc93 (192.168.204.147@tcp) 00000020:01000000:3.0:1788813540.846804:0:14452:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788813540.846807:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788813540.846821:0:14452:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90877c3fcd40) 00000020:00000080:3.0:1788813540.846834:0:14452:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788813540.846839:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788813540.846893:0:14452:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788813540.846898:0:14452:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788813540.846903:0:14452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d74dbab2ddb282b 00010000:00080000:3.0:1788813540.846933:0:14452:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90876f9d2000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.147@tcp at head 00010000:00010000:3.0:1788813540.847322:0:14452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1788813540.847722:0:14452:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788813540.847778:0:14452:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788813540.850329:0:14452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788813540.850406:0:14452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788813540.850486:0:14452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788813540.851344:0:14456:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788813540.851350:0:14456:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788813540.852260:0:14452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788813540.852274:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788813540.852306:0:14452:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788813540.852325:0:14452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d74dbab2ddb2832 00000100:00080000:3.0:1788813540.852335:0:14452:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788813540.852348:0:14452:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90876f9d2000 using connection 192.168.204.147@tcp/0@lo 00000100:00100000:3.0:1788813540.852385:0:14452:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90876e450e00 x1875706583801216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788813540.852456:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e450e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1875706583801216:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788813540.852509:0:3317:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706583801216 offset 0 length 520: 4 00000100:00080000:3.0:1788813540.853016:0:14452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788813540.853186:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813540.853192:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813540.853195:0:14452:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788813540.853198:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788813540.853202:0:14452:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788813540.853203:0:14452:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788813540.853205:0:14452:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788813540.853206:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788813540.853209:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813540.853211:0:14452:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788813540.853214:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788813540.853219:0:14452:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788813540.853222:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813540.853224:0:14452:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788813540.853227:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788813540.853231:0:14452:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.147@tcp to nid 0x20000c0a8cc93 (192.168.204.147@tcp) 00000020:01000000:3.0:1788813540.853254:0:14452:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788813540.853258:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788813540.853285:0:14452:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9087757a4d40) 00000020:00000080:3.0:1788813540.853302:0:14452:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788813540.853308:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788813540.853373:0:14452:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788813540.853380:0:14452:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788813540.853386:0:14452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d74dbab2ddb2840 00010000:00080000:3.0:1788813540.853415:0:14452:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90876f9d7800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.147@tcp at head 00010000:00010000:3.0:1788813540.853872:0:14452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788813540.854062:0:14452:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788813540.854285:0:14452:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788813540.854875:0:14452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788813540.854943:0:14452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788813540.855023:0:14452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788813540.856019:0:14458:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788813540.856025:0:14458:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788813540.857264:0:14452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788813540.857276:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788813540.857310:0:14452:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788813540.857329:0:14452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d74dbab2ddb2847 00000100:00080000:3.0:1788813540.857340:0:14452:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788813540.857351:0:14452:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90876f9d7800 using connection 192.168.204.147@tcp/0@lo 00000100:00100000:3.0:1788813540.857388:0:14452:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90876e453800 x1875706583801344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788813540.857418:0:14452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788813540.857469:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813540.857473:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813540.857475:0:14452:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788813540.857478:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813540.857482:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813540.857484:0:14452:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788813540.857487:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788813540.857488:0:14452:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788813540.857491:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788813540.857500:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813540.857502:0:14452:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788813540.857505:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788813540.857508:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813540.857509:0:14452:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788813540.857513:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788813540.857543:0:14452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e452d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14452:1875706583801472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813540.857656:0:14452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813540.857693:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583801472 00000100:00100000:3.0:1788813540.857699:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583801472 00000100:00100000:3.0:1788813540.857731:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788813540.857738:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+9:14452:x1875706583801472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813540.857938:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+9:14452:x1875706583801472:12345-0@lo:502:llog_process_th.0 Request processed in 200us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813540.857945:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788813540.857998:0:14452:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087587349c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813540.858018:0:14452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e452d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14452:1875706583801472:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788813540.858041:0:14452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:0.0:1788813540.858231:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1875706583801344:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788813540.858267:0:3317:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706583801344 offset 0 length 520: 4 00000020:00000080:3.0:1788813540.858450:0:14452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813540.858454:0:14452:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788813540.858460:0:14452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788813540.858976:0:14416:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788813540.858998:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788813540.859058:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908749d73200/0x6d74dbab2ddb27d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb27d7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813540.859072:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908749d73200/0x6d74dbab2ddb27d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb27d7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813540.859223:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90874923c800 from 1 10000000:01000000:2.0:1788813540.859226:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788813540.859265:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908774369e00/0x6d74dbab2ddb284e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813540.859273:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908774369e00/0x6d74dbab2ddb284e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813540.859286:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908774369e00/0x6d74dbab2ddb284e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813540.859309:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583801600:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788813540.859359:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813540.859413:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fab1540 going to sleep for 11 seconds 00000100:00100000:1.0:1788813540.859492:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583801600 00000100:00100000:1.0:1788813540.859500:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583801600 00000100:00100000:1.0:1788813540.859559:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788813540.859569:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+9:14416:x1875706583801600:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813540.859608:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813540.859623:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908749d73600/0x6d74dbab2ddb2855 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb284e expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813540.859647:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908749d73600/0x6d74dbab2ddb2855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb284e expref: 10 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813540.859656:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908749d73600/0x6d74dbab2ddb2855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb284e expref: 10 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813540.859666:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908749d73600, rc 0) 00000100:00100000:1.0:1788813540.859711:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+10:14416:x1875706583801600:12345-0@lo:101:mount.lustre.0 Request processed in 145us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813540.859718:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788813540.859933:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583801600:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813540.859947:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908774369e00/0x6d74dbab2ddb284e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2855 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813540.859956:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908774369e00/0x6d74dbab2ddb284e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb2855 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813540.860764:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583801728:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788813540.860822:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813540.860971:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fab1540 going to sleep for 11 seconds 00000100:00100000:3.0:1788813540.861300:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583801728 00000100:00100000:3.0:1788813540.861308:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583801728 00000100:00100000:3.0:1788813540.861391:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788813540.861401:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+10:14416:x1875706583801728:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788813540.861419:0:14426:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788813540.861425:0:14426:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788813540.861666:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+10:14416:x1875706583801728:12345-0@lo:256:mount.lustre.0 Request processed in 265us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813540.861685:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788813540.861913:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583801728:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788813540.862786:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788813540.862856:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908774369e00/0x6d74dbab2ddb284e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2855 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813540.862869:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908774369e00/0x6d74dbab2ddb284e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2855 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788813540.862877:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90874923c800 from 1 10000000:01000000:2.0:1788813540.862880:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788813540.862916:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908774368000/0x6d74dbab2ddb285c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813540.862925:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908774368000/0x6d74dbab2ddb285c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813540.862937:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908774368000/0x6d74dbab2ddb285c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813540.863012:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583801856:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788813540.863073:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813540.863120:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fab1540 going to sleep for 11 seconds 00000100:00100000:1.0:1788813540.863196:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583801856 00000100:00100000:1.0:1788813540.863204:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583801856 00000100:00100000:1.0:1788813540.863251:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788813540.863260:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+10:14416:x1875706583801856:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813540.863269:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813540.863285:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908749d73000/0x6d74dbab2ddb2863 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb285c expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813540.863310:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908749d73000/0x6d74dbab2ddb2863 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb285c expref: 11 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813540.863323:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908749d73000/0x6d74dbab2ddb2863 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb285c expref: 11 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813540.863331:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908749d73000, rc 0) 00000100:00100000:1.0:1788813540.863375:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+11:14416:x1875706583801856:12345-0@lo:101:mount.lustre.0 Request processed in 116us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813540.863381:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788813540.863791:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583801856:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813540.863807:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908774368000/0x6d74dbab2ddb285c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2863 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813540.863817:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908774368000/0x6d74dbab2ddb285c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb2863 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813540.863871:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583801984:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813540.863902:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813540.863922:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fab1540 going to sleep for 11 seconds 00000100:00100000:1.0:1788813540.863973:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583801984 00000100:00100000:1.0:1788813540.863978:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583801984 00000100:00100000:1.0:1788813540.864011:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788813540.864018:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087820dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+11:14416:x1875706583801984:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813540.864408:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087820dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+11:14416:x1875706583801984:12345-0@lo:501:mount.lustre.0 Request processed in 389us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813540.864416:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788813540.864571:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583801984:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813540.864630:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583802112:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788813540.864671:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813540.864697:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fab1540 going to sleep for 11 seconds 00000100:00100000:3.0:1788813540.864938:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583802112 00000100:00100000:3.0:1788813540.864944:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583802112 00000100:00100000:3.0:1788813540.864983:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788813540.864991:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087820d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+11:14416:x1875706583802112:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788813540.865154:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087820d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+11:14416:x1875706583802112:12345-0@lo:503:mount.lustre.0 Request processed in 163us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813540.865161:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788813540.865385:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583802112:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788813540.865873:0:14460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb70380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14460:1875706583802240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813540.865918:0:14460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813540.865952:0:14460:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fab10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813540.865992:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583802240 00000100:00100000:3.0:1788813540.865998:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583802240 00000100:00100000:3.0:1788813540.866022:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788813540.866028:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087820dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+11:14460:x1875706583802240:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813540.866262:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087820dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+11:14460:x1875706583802240:12345-0@lo:502:llog_process_th.0 Request processed in 233us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813540.866270:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788813540.866404:0:14460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb70380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14460:1875706583802240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788813540.866427:0:14460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813540.866442:0:14460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813540.866445:0:14460:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788813540.866452:0:14460:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90874923c800 00000020:00000080:2.0:1788813540.866455:0:14460:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788813540.866463:0:14460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813540.866465:0:14460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813540.866467:0:14460:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788813540.866470:0:14460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813540.866472:0:14460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813540.866473:0:14460:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788813540.866477:0:14460:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90874923c800 00000020:00000080:2.0:1788813540.866479:0:14460:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788813540.866536:0:14460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813540.866540:0:14460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813540.866541:0:14460:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788813540.866543:0:14460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813540.866565:0:14460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813540.866566:0:14460:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788813540.866570:0:14460:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90874923c800 00000020:00000080:2.0:1788813540.866572:0:14460:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788813540.866634:0:14460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb70380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14460:1875706583802368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813540.866673:0:14460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813540.866694:0:14460:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fab10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813540.867181:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583802368 00000100:00100000:3.0:1788813540.867187:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583802368 00000100:00100000:3.0:1788813540.867229:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788813540.867237:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087820d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+11:14460:x1875706583802368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813540.867405:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087820d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+11:14460:x1875706583802368:12345-0@lo:502:llog_process_th.0 Request processed in 168us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813540.867413:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788813540.867574:0:14460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb70380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14460:1875706583802368:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788813540.867628:0:14460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813540.867634:0:14460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813540.867636:0:14460:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788813540.867640:0:14460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788813540.871059:0:14416:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788813540.871104:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788813540.877315:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908774368000/0x6d74dbab2ddb285c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2863 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813540.877351:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908774368000/0x6d74dbab2ddb285c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2863 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813540.877453:0:14416:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788813540.877456:0:14416:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90874923c800 10000000:01000000:3.0:1788813540.877460:0:14416:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90874923c800 10000000:01000000:3.0:1788813540.877464:0:14416:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788813540.877470:0:14416:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90874923c800 from 1 10000000:01000000:3.0:1788813540.877474:0:14416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788813540.877513:0:14416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908773c95800/0x6d74dbab2ddb286a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813540.877521:0:14416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908773c95800/0x6d74dbab2ddb286a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813540.877533:0:14416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908773c95800/0x6d74dbab2ddb286a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813540.878302:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e452d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583802496:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788813540.878381:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813540.878434:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff908758734d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788813540.879210:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583802496 00000100:00100000:2.0:1788813540.879220:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583802496 00000100:00100000:2.0:1788813540.879275:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788813540.879285:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087820db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+11:14416:x1875706583802496:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813540.879309:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813540.879327:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908774368e00/0x6d74dbab2ddb2871 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb286a expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813540.879356:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908774368e00/0x6d74dbab2ddb2871 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb286a expref: 12 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813540.879370:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908774368e00/0x6d74dbab2ddb2871 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb286a expref: 12 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813540.879379:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368e00, rc 0) 00000100:00100000:2.0:1788813540.879439:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087820db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+12:14416:x1875706583802496:12345-0@lo:101:mount.lustre.0 Request processed in 156us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813540.879447:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788813540.879687:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e452d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583802496:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813540.879703:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908773c95800/0x6d74dbab2ddb286a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2871 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813540.879714:0:14416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908773c95800/0x6d74dbab2ddb286a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb2871 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813540.879784:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583802624:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813540.879817:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813540.879842:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fab16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813540.879859:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583802624 00000100:00100000:2.0:1788813540.879864:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583802624 00000100:00100000:2.0:1788813540.879886:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788813540.879893:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+12:14416:x1875706583802624:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813540.881356:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+12:14416:x1875706583802624:12345-0@lo:501:mount.lustre.0 Request processed in 1457us (1533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813540.881368:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788813540.881426:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583802624:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813540.881476:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583802752:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788813540.881519:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813540.881680:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583802752 00000100:00100000:1.0:1788813540.881687:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583802752 00000100:00100000:1.0:1788813540.881716:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788813540.881724:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+12:14416:x1875706583802752:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788813540.881871:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+12:14416:x1875706583802752:12345-0@lo:503:mount.lustre.0 Request processed in 147us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813540.881878:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788813540.883181:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fab16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813540.883212:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583802752:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788813540.883729:0:14464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642915f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14464:1875706583802880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788813540.883787:0:14464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813540.883819:0:14464:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749cf3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813540.883965:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583802880 00000100:00100000:2.0:1788813540.883971:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583802880 00000100:00100000:2.0:1788813540.884004:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788813540.884013:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+12:14464:x1875706583802880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788813540.884334:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+12:14464:x1875706583802880:12345-0@lo:502:llog_process_th.0 Request processed in 320us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813540.884343:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788813540.884448:0:14464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642915f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14464:1875706583802880:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788813540.884506:0:14464:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788813540.884522:0:14464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff90876fac3380) 00000020:00000080:1.0:1788813540.884540:0:14464:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1788813540.884716:0:14464:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90874923c800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788813540.884721:0:14464:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90874923c800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788813540.884729:0:14464:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90874923c800 4 00010000:00080000:1.0:1788813540.884769:0:14464:0:(ldlm_lib.c:102:import_set_conn()) imp ffff908743fa9800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.147@tcp at head 00010000:00010000:1.0:1788813540.893540:0:14464:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788813540.896573:0:14464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788813540.896635:0:14464:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788813540.896651:0:14464:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x6d74dbab2ddb287f 00000100:00080000:0.0:1788813540.896664:0:14464:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788813540.896685:0:14464:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff908743fa9800 using connection 192.168.204.147@tcp/0@lo 00000100:00100000:0.0:1788813540.896722:0:14464:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90876e925c00 x1875706583803008/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788813540.896762:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875706583803008:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788813540.896828:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788813540.896885:0:14464:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788813540.897928:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583803008 00000100:00100000:1.0:1788813540.897940:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583803008 00000100:00100000:1.0:1788813540.897987:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813540.897997:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3317:x1875706583803008:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788813540.900502:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3317:x1875706583803008:12345-0@lo:38:llog_process_th.0 Request processed in 2495us (3663us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788813540.900516:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788813540.903471:0:14464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e451f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14464:1875706583803136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813540.903571:0:14464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813540.903779:0:14464:0:(client.c:2716:ptlrpc_set_wait()) set ffff908758734900 going to sleep for 11 seconds 00000100:00100000:3.0:1788813540.903801:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583803136 00000100:00100000:3.0:1788813540.903807:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583803136 00000100:00100000:3.0:1788813540.903847:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788813540.903856:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+12:14464:x1875706583803136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788813540.904132:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+12:14464:x1875706583803136:12345-0@lo:502:llog_process_th.0 Request processed in 277us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813540.904140:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788813540.904205:0:14464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e451f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14464:1875706583803136:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788813540.904233:0:14464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:2.0:1788813540.907773:0:3317:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788813540.907789:0:3317:0:(import.c:65:import_set_state_nolock()) ffff908743fa9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788813540.907796:0:3317:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788813540.907800:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875706583803008:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788813540.907847:0:14416:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788813540.907874:0:14416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788813540.907942:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908773c95800/0x6d74dbab2ddb286a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2871 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813540.907954:0:14416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908773c95800/0x6d74dbab2ddb286a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2871 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788813540.908024:0:14416:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788813540.908026:0:14416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788813540.908027:0:14416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813540.908029:0:14416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813540.908030:0:14416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813540.908031:0:14416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813540.908032:0:14416:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788813540.908033:0:14416:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788813540.908035:0:14416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813540.908036:0:14416:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788813540.908039:0:14416:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788813540.908042:0:14416:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788813540.908043:0:14416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788813540.908044:0:14416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813540.908056:0:14416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813540.908057:0:14416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813540.908058:0:14416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813540.908059:0:14416:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788813540.908060:0:14416:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788813540.908061:0:14416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813540.908062:0:14416:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788813540.910242:0:14416:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788813540.910274:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583803264:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788813540.910358:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813540.910408:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fab1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813540.910835:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583803264 00000100:00100000:1.0:1788813540.910844:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583803264 00000100:00100000:1.0:1788813540.910937:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788813540.910949:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d99bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+12:14416:x1875706583803264:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788813540.910979:0:14428:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788813540.910995:0:14428:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788813540.970855:0:14428:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788813540.970903:0:14428:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788813540.974433:0:14450:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788813540.974440:0:14450:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788813540.974574:0:14450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff908749d73400/0x6d74dbab2ddb2886 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813540.974633:0:14450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff908749d73600/0x6d74dbab2ddb2855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb284e expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813540.974643:0:14450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff908749d73400/0x6d74dbab2ddb2886 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813540.974688:0:14450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff908749d73600/0x6d74dbab2ddb2855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb284e expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813540.974702:0:14450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff908749d73600/0x6d74dbab2ddb2855 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb284e expref: 12 pid: 14427 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813540.974732:0:14450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642915f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14450:1875706583803392:0@lo:104: 00000100:00100000:1.0:1788813540.974798:0:14450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813540.974848:0:14450:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087586ed0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813540.975245:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583803392 00000100:00100000:0.0:1788813540.975255:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583803392 00000100:00100000:0.0:1788813540.975316:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788813540.975327:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642915500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+3:14450:x1875706583803392:12345-0@lo:104: 00010000:00010000:0.0:1788813540.975342:0:14417:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff908774369e00/0x6d74dbab2ddb284e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb2855 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813540.975415:0:14417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788813540.975422:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642915500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+3:14450:x1875706583803392:12345-0@lo:104: Request processed in 97us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813540.975428:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788813540.975453:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813540.975460:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908774369e00/0x6d74dbab2ddb284e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb2855 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813540.975469:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369e00 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:0.0:1788813540.975472:0:14423:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908774369e00/0x6d74dbab2ddb284e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb2855 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813540.975481:0:14423:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908774369e00/0x6d74dbab2ddb284e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb2855 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813540.975497:0:14423:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908774369e00/0x6d74dbab2ddb284e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb2855 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813540.975503:0:14423:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788813540.975535:0:14423:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff908774369e00/0x6d74dbab2ddb284e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb2855 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813540.975654:0:14450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642915f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14450:1875706583803392:0@lo:104: 00010000:00010000:3.0:1788813540.975680:0:14450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff908749d73400/0x6d74dbab2ddb2886 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813540.975742:0:14423:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813540.975763:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908774369e00/0x6d74dbab2ddb284e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb2855 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813540.975770:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908774369e00/0x6d74dbab2ddb284e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb2855 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813540.975787:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813540.975789:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813540.975791:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813540.975820:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3320:1875706583803520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813540.975853:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813540.975927:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583803520 00000100:00100000:0.0:1788813540.975932:0:14419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583803520 00010000:00010000:0.0:1788813540.975951:0:14419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff908749d73600/0x6d74dbab2ddb2855 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb284e expref: 13 pid: 14427 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813540.975973:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788813540.975980:0:14419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e925f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+13:3320:x1875706583803520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813540.975990:0:14419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813540.975996:0:14419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff908749d73600/0x6d74dbab2ddb2855 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb284e expref: 13 pid: 14427 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813540.976012:0:14419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff908749d73600/0x6d74dbab2ddb2855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb284e expref: 13 pid: 14427 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813540.976025:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908749d73600/0x6d74dbab2ddb2855 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb284e expref: 13 pid: 14427 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813540.976039:0:14419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff908749d73400/0x6d74dbab2ddb2886 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813540.976215:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908749d73400/0x6d74dbab2ddb2886 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788813540.976230:0:14419:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001790799s 00010000:00010000:0.0:1788813540.976234:0:14419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff908749d73400/0x6d74dbab2ddb2886 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813540.976241:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff908749d73400/0x6d74dbab2ddb2886 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813540.976248:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff908749d73400/0x6d74dbab2ddb2886 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813540.976254:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff908749d73400/0x6d74dbab2ddb2886 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813540.976260:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73400 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813540.976264:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff908749d73400/0x6d74dbab2ddb2886 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813540.976271:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff908749d73400/0x6d74dbab2ddb2886 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813540.976516:0:14450:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff908749d73400/0x6d74dbab2ddb2886 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813540.976523:0:14450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff908749d73400/0x6d74dbab2ddb2886 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813540.976730:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff908749d73400/0x6d74dbab2ddb2886 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813540.976738:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908749d73400/0x6d74dbab2ddb2886 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813540.976750:0:14419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813540.976831:0:14419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e925f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+12:3320:x1875706583803520:12345-0@lo:103:ldlm_bl.0 Request processed in 851us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813540.976839:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813540.980010:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3320:1875706583803520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813540.980848:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d99bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+11:14416:x1875706583803264:12345-0@lo:253:mount.lustre.0 Request processed in 69897us (70484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813540.980861:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788813540.980939:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14416:1875706583803264:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788813540.980955:0:14416:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788813540.980958:0:14416:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788813540.980960:0:14416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788813540.980962:0:14416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813540.980963:0:14416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813540.980965:0:14416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813540.980966:0:14416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813540.980968:0:14416:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788813540.980969:0:14416:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788813540.980987:0:14416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813540.980990:0:14416:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788813540.981004:0:14416:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788813540.987872:0:14416:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788813540.988035:0:14416:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788813540.988353:0:14416:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788813540.988512:0:14416:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788813540.988825:0:14416:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788813540.988975:0:14416:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788813540.990258:0:14416:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788813540.990433:0:14416:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788813540.990985:0:14416:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788813540.991247:0:14416:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788813540.991500:0:14416:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788813540.991702:0:14416:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788813541.023654:0:14416:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788813541.024291:0:14416:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788813541.024562:0:14473:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788813541.024566:0:14473:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788813541.025526:0:14474:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788813541.025671:0:14474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788813541.031483:0:14474:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788813541.031567:0:14474:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788813541.031571:0:14474:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1788813541.033187:0:14416:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788813541.033322:0:14416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788813541.034283:0:14416:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788813541.034298:0:14416:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788813541.034989:0:14416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788813541.036993:0:14416:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788813541.038196:0:14416:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788813541.038242:0:14416:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1788813541.040891:0:14416:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1788813541.051242:0:14416:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788813541.100917:0:14416:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788813541.100958:0:14416:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbb7941df3988 00100000:10000000:2.0:1788813541.100968:0:14416:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788813541.102289:0:14416:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788813541.102313:0:14416:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.147@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788813541.102424:0:14416:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788813541.102459:0:14416:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788813541.631777:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788813541.763996:0:14431:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788813541.764005:0:14431:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90874923c800 from 6 10000000:01000000:3.0:1788813541.764011:0:14431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788813541.764071:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908773c94800/0x6d74dbab2ddb288d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813541.764085:0:14431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908773c94800/0x6d74dbab2ddb288d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813541.764097:0:14431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908773c94800/0x6d74dbab2ddb288d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813541.764127:0:14431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e451f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583803648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788813541.764211:0:14431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813541.764274:0:14431:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749af1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788813541.764704:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583803648 00000100:00100000:2.0:1788813541.764714:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583803648 00000100:00100000:2.0:1788813541.764770:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788813541.764778:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d99b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+11:14431:x1875706583803648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813541.764792:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813541.764805:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908774368200/0x6d74dbab2ddb2894 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb288d expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813541.764828:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908774368200/0x6d74dbab2ddb2894 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb288d expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813541.764839:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908774368200/0x6d74dbab2ddb2894 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb288d expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813541.764849:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368200, rc 0) 00000100:00100000:2.0:1788813541.764901:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d99b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+12:14431:x1875706583803648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813541.764921:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788813541.767947:0:14431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e451f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583803648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813541.767988:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908773c94800/0x6d74dbab2ddb288d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2894 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813541.768000:0:14431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908773c94800/0x6d74dbab2ddb288d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb2894 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813541.768086:0:14431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e926d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583803776:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788813541.768151:0:14431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813541.768189:0:14431:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749c513c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813541.768664:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583803776 00000100:00100000:2.0:1788813541.768672:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583803776 00000100:00100000:2.0:1788813541.768731:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788813541.768741:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d99a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+12:14431:x1875706583803776:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788813541.768761:0:14428:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788813541.768778:0:14428:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788813541.768781:0:14428:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788813541.768876:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d99a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+12:14431:x1875706583803776:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 136us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813541.768885:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788813541.770285:0:14431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e926d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583803776:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788813541.770364:0:14431:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788813541.770374:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908773c94800/0x6d74dbab2ddb288d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2894 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813541.770385:0:14431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908773c94800/0x6d74dbab2ddb288d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2894 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788813541.958706:0:14468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788813542.652884:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788813542.973792:0:14468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788813543.676750:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813544.705778:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813545.725252:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788813546.175932:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813546.175938:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788813546.175941:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813546.175944:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788813546.175946:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788813546.175950:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788813546.175953:0:8:0:(import.c:65:import_set_state_nolock()) ffff908743fa9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788813546.175968:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff908743fa9800 using connection 192.168.204.147@tcp/0@lo 00000100:00100000:2.0:1788813546.176000:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90876eb70e00 x1875706583804032/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788813546.176031:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3321:1875706583803904:0@lo:400:kworker.0 00000100:00100000:2.0:1788813546.176153:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813546.176216:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583803904 00000100:00100000:2.0:1788813546.176233:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583803904 00000100:00100000:2.0:1788813546.176277:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788813546.176285:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d99b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+12:3321:x1875706583803904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813546.176469:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875706583804032:0@lo:38:kworker.0 00000100:00100000:0.0:1788813546.176503:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813546.176546:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583804032 00000100:00100000:0.0:1788813546.176551:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583804032 00000100:00100000:0.0:1788813546.176572:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788813546.176592:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3317:x1875706583804032:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788813546.177095:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d99b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+12:3321:x1875706583803904:12345-0@lo:400:kworker.0 Request processed in 808us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813546.177674:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788813546.177846:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3321:1875706583803904:0@lo:400:kworker.0 00010000:00080000:2.0:1788813546.178326:0:14436:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:2.0:1788813546.178364:0:14436:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x6d74dbab2ddb289b 00000004:00100000:2.0:1788813546.178382:0:14436:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788813546.178545:0:14436:0:(import.c:65:import_set_state_nolock()) ffff90874a41e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788813546.178648:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875706583804032:12345-0@lo:38:kworker.0 Request processed in 2067us (2143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813546.178661:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788813546.181641:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90876eb70e00 x1875706583804032/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788813546.181665:0:3317:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788813546.181673:0:3317:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788813546.181679:0:3317:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788813546.181681:0:3317:0:(import.c:65:import_set_state_nolock()) ffff908743fa9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788813546.181689:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875706583804032:0@lo:38:kworker.0 00000001:02000400:3.0:1788813546.571916:0:14718:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg447-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788813546.751876:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813547.775525:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813548.797361:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813549.822543:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788813549.984416:0:14868:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffea5f11c0 20000000:00000080:2.0:1788813549.984435:0:14868:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff908775764400 uarg=0000000000000000 20000000:01000000:2.0:1788813549.986233:0:14868:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788813549.986246:0:14868:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788813549.986251:0:14868:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788813549.989870:0:14869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1788813549.990031:0:14868:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788813550.004152:0:14868:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788813550.012775:0:14868:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff908749d72000/0x6d74dbab2ddb28a2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813550.012818:0:14868:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff908749d73000/0x6d74dbab2ddb2863 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb285c expref: 11 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813550.012826:0:14868:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff908749d72000/0x6d74dbab2ddb28a2 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813550.012999:0:14868:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff908749d73000/0x6d74dbab2ddb2863 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb285c expref: 11 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813550.013015:0:14868:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff908749d73000/0x6d74dbab2ddb2863 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb285c expref: 11 pid: 14428 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813550.013029:0:14868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642916d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14868:1875706583804160:0@lo:104: 00000100:00100000:1.0:1788813550.013094:0:14868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813550.013216:0:14868:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749cf33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813550.013466:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583804160 00000100:00100000:0.0:1788813550.013475:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583804160 00000100:00100000:2.0:1788813550.013702:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813550.013715:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642917480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+3:14868:x1875706583804160:12345-0@lo:104: 00010000:00010000:2.0:1788813550.013730:0:14417:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff908774368000/0x6d74dbab2ddb285c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb2863 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813550.013876:0:14417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788813550.013908:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642917480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+3:14868:x1875706583804160:12345-0@lo:104: Request processed in 182us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813550.013916:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788813550.014646:0:14868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642916d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14868:1875706583804160:0@lo:104: 00010000:00010000:3.0:1788813550.014675:0:14868:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff908749d72000/0x6d74dbab2ddb28a2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813550.019521:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813550.019537:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908774368000/0x6d74dbab2ddb285c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb2863 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813550.019549:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368000 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:0.0:1788813550.019554:0:14423:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908774368000/0x6d74dbab2ddb285c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb2863 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813550.020007:0:14423:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908774368000/0x6d74dbab2ddb285c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb2863 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813550.020033:0:14423:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908774368000/0x6d74dbab2ddb285c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb2863 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813550.020039:0:14423:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788813550.020219:0:14423:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff908774368000/0x6d74dbab2ddb285c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb2863 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813550.020227:0:14423:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813550.020262:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908774368000/0x6d74dbab2ddb285c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb2863 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813550.020269:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908774368000/0x6d74dbab2ddb285c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb2863 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813550.020292:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813550.020293:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813550.020295:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813550.020833:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3318:1875706583804288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788813550.020924:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813550.021189:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583804288 00000100:00100000:1.0:1788813550.021198:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583804288 00010000:00010000:1.0:1788813550.021238:0:14420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff908749d73000/0x6d74dbab2ddb2863 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb285c expref: 12 pid: 14428 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813550.021281:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813550.021289:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+12:3318:x1875706583804288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813550.021302:0:14420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813550.021307:0:14420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff908749d73000/0x6d74dbab2ddb2863 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb285c expref: 12 pid: 14428 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813550.021318:0:14420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff908749d73000/0x6d74dbab2ddb2863 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb285c expref: 12 pid: 14428 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813550.021333:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908749d73000/0x6d74dbab2ddb2863 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb285c expref: 12 pid: 14428 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813550.021353:0:14420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff908749d72000/0x6d74dbab2ddb28a2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813550.021361:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908749d72000/0x6d74dbab2ddb28a2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813550.021388:0:14420:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff908749d72000/0x6d74dbab2ddb28a2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813550.021396:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff908749d72000/0x6d74dbab2ddb28a2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813550.021403:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff908749d72000/0x6d74dbab2ddb28a2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813550.021410:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff908749d72000/0x6d74dbab2ddb28a2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813550.021426:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d72000 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813550.021430:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff908749d72000/0x6d74dbab2ddb28a2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813550.021438:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff908749d72000/0x6d74dbab2ddb28a2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813550.021465:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff908749d72000/0x6d74dbab2ddb28a2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813550.021476:0:14420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813550.021520:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+11:3318:x1875706583804288:12345-0@lo:103:ldlm_bl.0 Request processed in 231us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813550.021528:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813550.021602:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3318:1875706583804288:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788813550.023611:0:14868:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff908749d72000/0x6d74dbab2ddb28a2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813550.023628:0:14868:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff908749d72000/0x6d74dbab2ddb28a2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813550.023634:0:14868:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908749d72000/0x6d74dbab2ddb28a2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14868 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813550.272005:0:3317:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813540/real 1788813540] req@ffff90876e453800 x1875706583801344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813550 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813550.272042:0:3317:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90876e453800 x1875706583801344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813550 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813550.272068:0:3317:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813540/real 1788813540] req@ffff90876e450e00 x1875706583801216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813550 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813550.272081:0:3317:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90876e450e00 x1875706583801216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813550 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788813550.272227:0:3317:0:(import.c:65:import_set_state_nolock()) ffff90876f9d7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813550.272379:0:3317:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788813550.272384:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e453800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1875706583801344:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788813550.272391:0:3317:0:(import.c:65:import_set_state_nolock()) ffff90876f9d2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788813550.272744:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813550.272750:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788813550.272753:0:8:0:(import.c:65:import_set_state_nolock()) ffff90876f9d2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788813550.272758:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 483 00000100:00080000:2.0:1788813550.272763:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788813550.272775:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90876f9d2000 using connection 192.168.204.147@tcp/0@lo 00000100:00100000:2.0:1788813550.272807:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90876eb71f80 x1875706583804416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788813550.272820:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813550.272823:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788813550.272824:0:8:0:(import.c:65:import_set_state_nolock()) ffff90876f9d7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788813550.272827:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 483 00000100:00080000:2.0:1788813550.272829:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788813550.272842:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90876f9d7800 using connection 192.168.204.147@tcp/0@lo 00000100:00100000:2.0:1788813550.272855:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90876eb71c00 x1875706583804544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788813550.272923:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875706583804672:0@lo:400:kworker.0 00000100:00100000:0.0:1788813550.272987:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813550.273075:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583804672 00000100:00100000:1.0:1788813550.273083:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583804672 00000100:00100000:1.0:1788813550.273144:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813550.273153:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875706583804672:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788813550.273500:0:3317:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788813550.273516:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e450e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1875706583801216:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788813550.273544:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1875706583804416:0@lo:8:kworker.0 00000400:00000100:3.0:1788813550.273576:0:3317:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706583804416 offset 0 length 520: 4 00000100:00100000:3.0:1788813550.273617:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1875706583804544:0@lo:8:kworker.0 00000400:00000100:3.0:1788813550.273656:0:3317:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875706583804544 offset 0 length 520: 4 00000100:00100000:1.0:1788813550.274117:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875706583804672:12345-0@lo:400:kworker.0 Request processed in 963us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813550.274126:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788813550.274217:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90876eb73480 x1875706583804672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813550.274230:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875706583804672:0@lo:400:kworker.0 00010000:00010000:0.0:1788813550.845228:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788813551.231176:0:14431:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788813551.231184:0:14431:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90874923c800 from 10 10000000:01000000:2.0:1788813551.231190:0:14431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788813551.231234:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908774369800/0x6d74dbab2ddb28a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813551.231245:0:14431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908774369800/0x6d74dbab2ddb28a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813551.231255:0:14431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908774369800/0x6d74dbab2ddb28a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813551.231281:0:14431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583804800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788813551.231349:0:14431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813551.231433:0:14431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087486e4840 going to sleep for 11 seconds 00000100:00100000:0.0:1788813551.232688:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583804800 00000100:00100000:0.0:1788813551.232700:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583804800 00000100:00100000:0.0:1788813551.232762:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788813551.232773:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d99ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+11:14431:x1875706583804800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813551.232788:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813551.232806:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908740031400/0x6d74dbab2ddb28b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb28a9 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813551.232831:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908740031400/0x6d74dbab2ddb28b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb28a9 expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813551.232843:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908740031400/0x6d74dbab2ddb28b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb28a9 expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813551.232851:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740031400, rc 0) 00000100:00100000:0.0:1788813551.232913:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d99ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+12:14431:x1875706583804800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813551.232927:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788813551.233013:0:14431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583804800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813551.233030:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908774369800/0x6d74dbab2ddb28a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb28b0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813551.233039:0:14431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908774369800/0x6d74dbab2ddb28a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb28b0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813551.233104:0:14431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583804928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813551.233134:0:14431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813551.233171:0:14431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087486e4840 going to sleep for 11 seconds 00000100:00100000:0.0:1788813551.234754:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583804928 00000100:00100000:0.0:1788813551.234766:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583804928 00000100:00100000:0.0:1788813551.234823:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788813551.234833:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+12:14431:x1875706583804928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813551.235121:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+12:14431:x1875706583804928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 289us (1985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813551.235128:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788813551.235215:0:14431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583804928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813551.235258:0:14431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583805056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813551.235301:0:14431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813551.235336:0:14431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087486e4840 going to sleep for 11 seconds 00000100:00100000:0.0:1788813551.235383:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583805056 00000100:00100000:0.0:1788813551.235463:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583805056 00000100:00100000:0.0:1788813551.236087:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788813551.236096:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d99a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+12:14431:x1875706583805056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813551.236260:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d99a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+12:14431:x1875706583805056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813551.236267:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788813551.236330:0:14431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583805056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788813551.237015:0:14929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788813551.237069:0:14431:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788813551.237085:0:14431:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788813551.237095:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908774369800/0x6d74dbab2ddb28a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb28b0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813551.237108:0:14431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908774369800/0x6d74dbab2ddb28a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb28b0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813551.869707:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788813552.256268:0:14468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788813552.897098:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813553.918773:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813554.944018:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788813555.118262:0:15117:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788813555.118265:0:15117:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788813555.118387:0:15117:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9087466da800 00000020:01000004:3.0:1788813555.118404:0:15117:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788813555.118416:0:15117:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788813555.118429:0:15117:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9087757a3380) 00000020:00000080:3.0:1788813555.118442:0:15117:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788813555.162112:0:15117:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788813555.164138:0:15117:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788813555.164964:0:15117:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788813555.165202:0:15117:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788813555.165431:0:15117:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788813555.165869:0:15117:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 565: rc = 0 00100000:10000000:0.0:1788813555.165966:0:15117:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 565: rc = 0 00100000:10000000:0.0:1788813555.166111:0:15117:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 565: rc = 0 00100000:10000000:0.0:1788813555.166736:0:15117:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 382: rc = 0 00100000:10000000:0.0:1788813555.168123:0:15117:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 382: rc = 0 00100000:10000000:0.0:1788813555.169474:0:15117:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 382: rc = 0 00100000:10000000:0.0:1788813555.170018:0:15117:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 382: rc = 0 00100000:10000000:0.0:1788813555.170301:0:15117:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 382: rc = 0 00100000:10000000:0.0:1788813555.170564:0:15117:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 382: rc = 0 00000020:00000080:0.0:1788813555.171882:0:15117:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788813555.171895:0:15117:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788813555.172076:0:15117:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6d74dbab2ddb28be 00000020:01000004:0.0:1788813555.172086:0:15117:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788813555.172108:0:15117:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.147@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788813555.172111:0:15117:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.147@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788813555.172118:0:15117:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788813555.172122:0:15117:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788813555.172133:0:15117:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90876f9cb380) 00000020:00000080:0.0:1788813555.172143:0:15117:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1788813555.175801:0:15117:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788813555.175989:0:15117:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788813555.175996:0:15117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788813555.183967:0:15117:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788813555.183981:0:15117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788813555.185253:0:15117:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788813555.185263:0:15117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788813555.188315:0:15117:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788813555.188492:0:15117:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788813555.188499:0:15117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788813555.192451:0:15117:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788813555.192463:0:15117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788813555.220061:0:15117:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788813555.220482:0:15117:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788813555.220489:0:15117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788813555.223982:0:15117:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788813555.224008:0:15117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788813555.225887:0:15117:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788813555.225898:0:15117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788813555.229462:0:15117:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788813555.229826:0:15117:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788813555.229834:0:15117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788813555.235622:0:15117:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788813555.235649:0:15117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788813555.290464:0:15117:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788813555.290692:0:15117:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788813555.290699:0:15117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788813555.292853:0:15117:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788813555.292867:0:15117:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788813555.293758:0:15117:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788813555.293859:0:15117:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788813555.293866:0:15117:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.147@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788813555.305303:0:15117:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.147@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788813555.305347:0:15117:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.147@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788813555.305351:0:15117:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788813555.305353:0:15117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788813555.305354:0:15117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813555.305360:0:15117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813555.305361:0:15117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813555.305363:0:15117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813555.305364:0:15117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813555.305365:0:15117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813555.305367:0:15117:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788813555.305370:0:15117:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788813555.305372:0:15117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788813555.305373:0:15117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788813555.305374:0:15117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813555.305375:0:15117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813555.305376:0:15117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813555.305377:0:15117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813555.305378:0:15117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813555.305378:0:15117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813555.305379:0:15117:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788813555.305408:0:15117:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788813555.305432:0:15117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583805184:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788813555.305513:0:15117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813555.305733:0:15117:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fa350c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813555.305909:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583805184 00000100:00100000:0.0:1788813555.305916:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583805184 00000100:00100000:0.0:1788813555.306005:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788813555.306015:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+12:15117:x1875706583805184:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788813555.306045:0:14427:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788813555.306048:0:14427:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788813555.306052:0:14427:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788813555.315570:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+12:15117:x1875706583805184:12345-0@lo:253:mount.lustre.0 Request processed in 9549us (10048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813555.315617:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788813555.315730:0:15117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583805184:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788813555.315746:0:15117:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788813555.315749:0:15117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788813555.315751:0:15117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788813555.315752:0:15117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813555.315754:0:15117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813555.315755:0:15117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813555.315756:0:15117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813555.315757:0:15117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813555.315759:0:15117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813555.315761:0:15117:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788813555.315791:0:15117:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9087466da800 from lustre-OST0000 10000000:01000000:2.0:1788813555.315847:0:15117:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788813555.315851:0:15117:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788813555.315858:0:15117:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90876f9c8000 local copy 00010000:00010000:2.0:1788813555.315868:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb27b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb27bb expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813555.316097:0:15117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583805312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813555.316137:0:15117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813555.316184:0:15117:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877fa35600 going to sleep for 11 seconds 00000100:00100000:0.0:1788813555.316429:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583805312 00000100:00100000:0.0:1788813555.316443:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583805312 00000100:00100000:0.0:1788813555.316482:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788813555.316492:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d99b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+12:15117:x1875706583805312:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813555.316671:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d99b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+12:15117:x1875706583805312:12345-0@lo:501:mount.lustre.0 Request processed in 181us (533us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788813555.316678:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788813555.316780:0:15117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583805312:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788813555.316812:0:15117:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.147@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788813555.316974:0:15117:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.147@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788813555.316982:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb27b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb27bb expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813555.316992:0:15117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb27b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb27bb expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813555.317017:0:15117:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9087466da800 10000000:01000000:1.0:1788813555.317022:0:15117:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788813555.317028:0:15117:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff90876f9c8000 10000000:01000000:1.0:1788813555.317030:0:15117:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788813555.317033:0:15117:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff90876f9c8000 from 1 10000000:01000000:1.0:1788813555.317036:0:15117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788813555.317063:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908749d72400/0x6d74dbab2ddb28cc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813555.317072:0:15117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908749d72400/0x6d74dbab2ddb28cc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813555.317082:0:15117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908749d72400/0x6d74dbab2ddb28cc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813555.317098:0:15117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583805440:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788813555.317127:0:15117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813555.317423:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583805440 00000100:00100000:0.0:1788813555.317429:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583805440 00000100:00100000:0.0:1788813555.317510:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788813555.317518:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d99a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+12:15117:x1875706583805440:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813555.317529:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813555.317965:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908740030200/0x6d74dbab2ddb28d3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb28cc expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813555.317992:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908740030200/0x6d74dbab2ddb28d3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb28cc expref: 13 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813555.318005:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908740030200/0x6d74dbab2ddb28d3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb28cc expref: 13 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813555.318015:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908740030200, rc 0) 00000100:00100000:0.0:1788813555.318058:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d99a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+13:15117:x1875706583805440:12345-0@lo:101:mount.lustre.0 Request processed in 541us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813555.318064:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788813555.318287:0:15117:0:(client.c:2716:ptlrpc_set_wait()) set ffff908761e85a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788813555.318308:0:15117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583805440:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813555.318324:0:15117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908749d72400/0x6d74dbab2ddb28cc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb28d3 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813555.318346:0:15117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908749d72400/0x6d74dbab2ddb28cc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb28d3 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813555.318364:0:15117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788813555.318382:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908749d72400/0x6d74dbab2ddb28cc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb28d3 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813555.318389:0:15117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908749d72400/0x6d74dbab2ddb28cc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb28d3 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813555.318396:0:15117:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788813555.318401:0:15117:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788813555.318406:0:15117:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788813555.318409:0:15117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788813555.318429:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908749d73800/0x6d74dbab2ddb28da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813555.318436:0:15117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908749d73800/0x6d74dbab2ddb28da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813555.318443:0:15117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908749d73800/0x6d74dbab2ddb28da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813555.318460:0:15117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583805568:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788813555.318492:0:15117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813555.318507:0:15117:0:(client.c:2716:ptlrpc_set_wait()) set ffff908761e85a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788813555.318962:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583805568 00000100:00100000:3.0:1788813555.318969:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583805568 00000100:00100000:3.0:1788813555.319000:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788813555.319008:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+13:15117:x1875706583805568:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788813555.319019:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813555.319033:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908773c95600/0x6d74dbab2ddb28e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb28da expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813555.319051:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908773c95600/0x6d74dbab2ddb28e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb28da expref: 14 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813555.319060:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908773c95600/0x6d74dbab2ddb28e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb28da expref: 14 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813555.319067:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c95600, rc 0) 00000100:00100000:3.0:1788813555.319116:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+14:15117:x1875706583805568:12345-0@lo:101:mount.lustre.0 Request processed in 108us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813555.319132:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788813555.319305:0:15117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583805568:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813555.319319:0:15117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908749d73800/0x6d74dbab2ddb28da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb28e1 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813555.319334:0:15117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908749d73800/0x6d74dbab2ddb28da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb28e1 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788813555.320079:0:15117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788813555.320975:0:15117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788813555.321211:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788813555.321290:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788813555.321327:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788813555.321375:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788813555.321414:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788813555.321447:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788813555.321511:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788813555.321520:0:15117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788813555.321619:0:15117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583805696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813555.321679:0:15117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813555.321712:0:15117:0:(client.c:2716:ptlrpc_set_wait()) set ffff908761e85e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788813555.322517:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583805696 00000100:00100000:3.0:1788813555.322528:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583805696 00000100:00100000:3.0:1788813555.322573:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788813555.322619:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+14:15117:x1875706583805696:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813555.325007:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+14:15117:x1875706583805696:12345-0@lo:501:mount.lustre.0 Request processed in 2386us (3321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813555.325021:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788813555.325475:0:15117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583805696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813555.325527:0:15117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583805824:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788813555.325619:0:15117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813555.325647:0:15117:0:(client.c:2716:ptlrpc_set_wait()) set ffff908761e85e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788813555.325722:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583805824 00000100:00100000:3.0:1788813555.325729:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583805824 00000100:00100000:3.0:1788813555.326117:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788813555.326128:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+14:15117:x1875706583805824:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788813555.326490:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+14:15117:x1875706583805824:12345-0@lo:503:mount.lustre.0 Request processed in 364us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813555.326498:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788813555.327140:0:15117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583805824:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788813555.328256:0:15117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788813555.328347:0:15117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583805952:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813555.328420:0:15117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813555.328513:0:15117:0:(client.c:2716:ptlrpc_set_wait()) set ffff908761e85e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788813555.328562:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583805952 00000100:00100000:3.0:1788813555.328570:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583805952 00000100:00100000:3.0:1788813555.328959:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788813555.328971:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+14:15117:x1875706583805952:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788813555.329246:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+14:15117:x1875706583805952:12345-0@lo:502:mount.lustre.0 Request processed in 277us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813555.329254:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788813555.329352:0:15117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583805952:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788813555.329683:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788813555.329744:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788813555.329794:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788813555.329855:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788813555.329892:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788813555.329925:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788813555.329970:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788813555.330005:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788813555.330035:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788813555.330081:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788813555.330118:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788813555.330181:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788813555.330217:0:15117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583806080:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813555.330269:0:15117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813555.330755:0:15117:0:(client.c:2716:ptlrpc_set_wait()) set ffff908761e85e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788813555.330938:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583806080 00000100:00100000:0.0:1788813555.330946:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583806080 00000100:00100000:0.0:1788813555.330981:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788813555.330988:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+14:15117:x1875706583806080:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813555.331251:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+14:15117:x1875706583806080:12345-0@lo:502:mount.lustre.0 Request processed in 262us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813555.331259:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788813555.334779:0:15117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583806080:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788813555.335103:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788813555.335119:0:15117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788813555.341079:0:15131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788813555.341091:0:15131:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788813555.341097:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813555.341099:0:15131:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788813555.341118:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788813555.341135:0:15131:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9087757a0000) 00000020:00000080:3.0:1788813555.341285:0:15131:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788813555.341295:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788813555.341376:0:15131:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9087466da800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788813555.341384:0:15131:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788813555.341392:0:15131:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6d74dbab2ddb28ef 00010000:00010000:3.0:1788813555.350441:0:15131:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788813555.353344:0:15131:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1788813555.360257:0:15131:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788813555.362627:0:15131:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788813555.362640:0:15131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813555.362646:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813555.362648:0:15131:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788813555.362651:0:15131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788813555.362655:0:15131:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1788813555.362656:0:15131:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788813555.362659:0:15131:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788813555.362660:0:15131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788813555.362664:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813555.362665:0:15131:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788813555.362667:0:15131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813555.362670:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813555.362671:0:15131:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788813555.362674:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788813555.362676:0:15131:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788813555.362678:0:15131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813555.362680:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813555.362682:0:15131:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788813555.362684:0:15131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813555.362685:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813555.362687:0:15131:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788813555.362689:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788813555.362753:0:15131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813555.362757:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813555.362758:0:15131:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788813555.362761:0:15131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788813555.362957:0:15117:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788813555.362992:0:15117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788813555.363017:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908749d73800/0x6d74dbab2ddb28da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb28e1 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813555.363030:0:15117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908749d73800/0x6d74dbab2ddb28da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb28e1 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813555.363038:0:15117:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9087466da800 from 1 10000000:01000000:1.0:1788813555.363041:0:15117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788813555.363076:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908749d73c00/0x6d74dbab2ddb28f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813555.363096:0:15117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908749d73c00/0x6d74dbab2ddb28f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813555.363108:0:15117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908749d73c00/0x6d74dbab2ddb28f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813555.363134:0:15117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583806208:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788813555.363218:0:15117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813555.363262:0:15117:0:(client.c:2716:ptlrpc_set_wait()) set ffff908761e85e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788813555.363418:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583806208 00000100:00100000:2.0:1788813555.363426:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583806208 00000100:00100000:2.0:1788813555.363467:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788813555.363476:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+14:15117:x1875706583806208:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788813555.363489:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813555.363502:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908774369600/0x6d74dbab2ddb28fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb28f6 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813555.363524:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908774369600/0x6d74dbab2ddb28fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb28f6 expref: 15 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813555.363534:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908774369600/0x6d74dbab2ddb28fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb28f6 expref: 15 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813555.363542:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369600, rc 0) 00000100:00100000:2.0:1788813555.363622:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+15:15117:x1875706583806208:12345-0@lo:101:mount.lustre.0 Request processed in 147us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813555.363629:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788813555.363721:0:15117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583806208:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788813555.363737:0:15117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908749d73c00/0x6d74dbab2ddb28f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb28fd expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813555.363745:0:15117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908749d73c00/0x6d74dbab2ddb28f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb28fd expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788813555.364205:0:15117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788813555.364505:0:15117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788813555.364795:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788813555.364852:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788813555.364913:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788813555.364920:0:15117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788813555.364982:0:15117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583806336:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813555.365029:0:15117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813555.365058:0:15117:0:(client.c:2716:ptlrpc_set_wait()) set ffff908761e85e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788813555.365230:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583806336 00000100:00100000:2.0:1788813555.365237:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583806336 00000100:00100000:2.0:1788813555.365281:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788813555.365290:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+15:15117:x1875706583806336:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813555.365495:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+15:15117:x1875706583806336:12345-0@lo:501:mount.lustre.0 Request processed in 205us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813555.365509:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788813555.366949:0:15117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583806336:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813555.367018:0:15117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583806464:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788813555.367091:0:15117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813555.367123:0:15117:0:(client.c:2716:ptlrpc_set_wait()) set ffff908761e85e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788813555.369851:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583806464 00000100:00100000:2.0:1788813555.369865:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583806464 00000100:00100000:2.0:1788813555.369916:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788813555.369925:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+15:15117:x1875706583806464:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788813555.370178:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+15:15117:x1875706583806464:12345-0@lo:503:mount.lustre.0 Request processed in 253us (3087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813555.370186:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788813555.370534:0:15117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583806464:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788813555.374516:0:15117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788813555.374642:0:15117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583806592:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813555.374728:0:15117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813555.374777:0:15117:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749af13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813555.375244:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583806592 00000100:00100000:2.0:1788813555.375253:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583806592 00000100:00100000:2.0:1788813555.375324:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788813555.375333:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+15:15117:x1875706583806592:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813555.375556:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+15:15117:x1875706583806592:12345-0@lo:502:mount.lustre.0 Request processed in 223us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813555.375564:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788813555.376038:0:15117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583806592:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788813555.376526:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788813555.376602:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788813555.376655:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788813555.376692:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788813555.376727:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788813555.376921:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788813555.376964:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788813555.377074:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788813555.377118:0:15117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583806720:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813555.377189:0:15117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813555.377223:0:15117:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749af13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813555.377322:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583806720 00000100:00100000:2.0:1788813555.377329:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583806720 00000100:00100000:2.0:1788813555.377376:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788813555.377385:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+15:15117:x1875706583806720:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813555.377706:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+15:15117:x1875706583806720:12345-0@lo:502:mount.lustre.0 Request processed in 321us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813555.377714:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788813555.378122:0:15117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583806720:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788813555.378243:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788813555.378558:0:15117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788813555.382789:0:15135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813555.382937:0:15135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813555.382941:0:15135:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788813555.382948:0:15135:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9087466da800 00000020:00000080:2.0:1788813555.382961:0:15135:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788813555.382969:0:15135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813555.382971:0:15135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813555.382972:0:15135:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788813555.382975:0:15135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813555.382977:0:15135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813555.382978:0:15135:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788813555.382981:0:15135:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9087466da800 00000020:00000080:2.0:1788813555.382983:0:15135:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788813555.383050:0:15135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813555.383054:0:15135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813555.383055:0:15135:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788813555.383058:0:15135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788813555.383060:0:15135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813555.383061:0:15135:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788813555.383065:0:15135:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9087466da800 00000020:00000080:2.0:1788813555.383067:0:15135:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788813555.383104:0:15135:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788813555.383107:0:15135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788813555.383109:0:15135:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788813555.383111:0:15135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788813555.386493:0:15117:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788813555.386537:0:15117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788813555.386565:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908749d73c00/0x6d74dbab2ddb28f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb28fd expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813555.386593:0:15117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908749d73c00/0x6d74dbab2ddb28f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb28fd expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813555.386682:0:15117:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788813555.386687:0:15117:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9087466da800 10000000:01000000:0.0:1788813555.386690:0:15117:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9087466da800 10000000:01000000:0.0:1788813555.386694:0:15117:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788813555.386700:0:15117:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9087466da800 from 1 10000000:01000000:0.0:1788813555.386703:0:15117:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788813555.386742:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740030000/0x6d74dbab2ddb2904 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813555.386751:0:15117:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908740030000/0x6d74dbab2ddb2904 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813555.386775:0:15117:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908740030000/0x6d74dbab2ddb2904 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813555.386811:0:15117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583806848:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788813555.386882:0:15117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813555.386930:0:15117:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749af1300 going to sleep for 11 seconds 00000100:00080000:2.0:1788813555.388948:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813555.388958:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788813555.388962:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788813555.388964:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788813555.389038:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788813555.389039:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583806848 00000100:00100000:3.0:1788813555.389050:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583806848 00000100:00100000:2.0:1788813555.389056:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583806976:0@lo:400:kworker.0 00000100:00100000:2.0:1788813555.389136:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813555.389188:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583806976 00000100:00100000:2.0:1788813555.389192:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583806976 00000100:00100000:2.0:1788813555.389232:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813555.389241:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583806976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813555.389250:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788813555.389262:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+15:15117:x1875706583806848:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788813555.389287:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813555.389308:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908773c94200/0x6d74dbab2ddb290b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb2904 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813555.389310:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583806976:12345-0@lo:400:kworker.0 Request processed in 69us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813555.389325:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788813555.389345:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908773c94200/0x6d74dbab2ddb290b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb2904 expref: 16 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813555.389371:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908773c94200/0x6d74dbab2ddb290b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb2904 expref: 16 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1788813555.389377:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90876eb73100 x1875706583806976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813555.389392:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583806976:0@lo:400:kworker.0 00010000:00010000:3.0:1788813555.389437:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c94200, rc 0) 00000100:00100000:3.0:1788813555.389553:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+16:15117:x1875706583806848:12345-0@lo:101:mount.lustre.0 Request processed in 293us (2670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813555.389561:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788813555.390483:0:15117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583806848:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813555.390503:0:15117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908740030000/0x6d74dbab2ddb2904 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb290b expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813555.390514:0:15117:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908740030000/0x6d74dbab2ddb2904 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb290b expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788813555.391195:0:15117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788813555.391532:0:15117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813555.391853:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788813555.391900:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788813555.391938:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788813555.391989:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788813555.392029:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788813555.392079:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788813555.392116:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788813555.392152:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788813555.392214:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788813555.392251:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788813555.392303:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788813555.392352:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788813555.392389:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788813555.392423:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788813555.392486:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788813555.392539:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788813555.392571:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788813555.392662:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788813555.392702:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788813555.392736:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788813555.392784:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788813555.392820:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788813555.392853:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788813555.392899:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788813555.392935:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788813555.392977:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788813555.393029:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788813555.393067:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788813555.393147:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788813555.393155:0:15117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788813555.399502:0:15117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583807104:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813555.399569:0:15117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813555.399625:0:15117:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749af1600 going to sleep for 11 seconds 00000100:00100000:3.0:1788813555.399762:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583807104 00000100:00100000:3.0:1788813555.399770:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583807104 00000100:00100000:3.0:1788813555.399835:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788813555.399846:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+16:15117:x1875706583807104:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813555.400109:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+16:15117:x1875706583807104:12345-0@lo:501:mount.lustre.0 Request processed in 264us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813555.400117:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788813555.400192:0:15117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583807104:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813555.400236:0:15117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583807232:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788813555.400287:0:15117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813555.400307:0:15117:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749af1600 going to sleep for 11 seconds 00000100:00100000:3.0:1788813555.400525:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583807232 00000100:00100000:3.0:1788813555.400531:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583807232 00000100:00100000:3.0:1788813555.400558:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788813555.400565:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+16:15117:x1875706583807232:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788813555.400728:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+16:15117:x1875706583807232:12345-0@lo:503:mount.lustre.0 Request processed in 163us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813555.400735:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788813555.400880:0:15117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583807232:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788813555.401801:0:15117:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788813555.402057:0:15117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583807360:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813555.402645:0:15117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813555.402696:0:15117:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749af1600 going to sleep for 11 seconds 00000100:00100000:2.0:1788813555.402896:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583807360 00000100:00100000:2.0:1788813555.402904:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583807360 00000100:00100000:2.0:1788813555.402947:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788813555.402970:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+16:15117:x1875706583807360:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813555.403211:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+16:15117:x1875706583807360:12345-0@lo:502:mount.lustre.0 Request processed in 255us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813555.403218:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788813555.404049:0:15117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583807360:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788813555.404483:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788813555.404542:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788813555.404608:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788813555.404767:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788813555.404814:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788813555.405130:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788813555.405180:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788813555.405217:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788813555.406011:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788813555.406291:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788813555.406337:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788813555.406400:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788813555.406442:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788813555.407076:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788813555.407151:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788813555.407217:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788813555.407261:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788813555.407328:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788813555.407801:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788813555.407839:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788813555.407906:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788813555.408280:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788813555.408325:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788813555.408397:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788813555.408441:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788813555.408497:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788813555.408597:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788813555.408644:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788813555.408685:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788813555.408746:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788813555.408787:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788813555.408844:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788813555.408882:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788813555.409170:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788813555.409210:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788813555.409256:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788813555.409305:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788813555.409336:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788813555.409625:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788813555.409672:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788813555.409721:0:15117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583807488:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813555.409797:0:15117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813555.409842:0:15117:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749af1600 going to sleep for 11 seconds 00000100:00100000:2.0:1788813555.410695:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583807488 00000100:00100000:2.0:1788813555.410705:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583807488 00000100:00100000:2.0:1788813555.410763:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788813555.410773:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+16:15117:x1875706583807488:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813555.412105:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+16:15117:x1875706583807488:12345-0@lo:502:mount.lustre.0 Request processed in 1328us (2303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813555.412116:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788813555.413191:0:15117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583807488:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788813555.413331:0:15117:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788813555.413346:0:15117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788813555.417106:0:15140:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788813555.417123:0:15140:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff90876f9ccd40) 00000020:00000080:0.0:1788813555.417146:0:15140:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788813555.420263:0:15140:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9087466da800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788813555.420285:0:15140:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9087466da800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788813555.420288:0:15140:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9087466da800 3 00010000:00080000:0.0:1788813555.420326:0:15140:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9087660d0800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.147@tcp at head 00010000:00010000:0.0:1788813555.429495:0:15140:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1788813555.429745:0:15140:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788813555.429786:0:15140:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788813555.430181:0:15140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x6d74dbab2ddb2919 00000100:00080000:0.0:1788813555.430193:0:15140:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788813555.430206:0:15140:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9087660d0800 using connection 192.168.204.147@tcp/0@lo 00000100:00100000:0.0:1788813555.430244:0:15140:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90876e927480 x1875706583807616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788813555.430290:0:15140:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788813555.430317:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813555.430322:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788813555.430325:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813555.430328:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788813555.437489:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3317:1875706583807616:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788813555.437512:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:3.0:1788813555.437566:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813555.437722:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583807616 00000100:00100000:3.0:1788813555.437731:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583807616 00000100:00100000:3.0:1788813555.437785:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788813555.437794:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3317:x1875706583807616:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788813555.437822:0:14432:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:3.0:1788813555.437856:0:14432:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x6d74dbab2ddb2920 00000004:00100000:3.0:1788813555.437869:0:14432:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788813555.437984:0:14432:0:(import.c:65:import_set_state_nolock()) ffff9087739c6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788813555.438040:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875706583807616:12345-0@lo:38:llog_process_th.0 Request processed in 246us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813555.438048:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788813555.438087:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90876e927480 x1875706583807616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813555.438097:0:3317:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788813555.438104:0:3317:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788813555.438112:0:3317:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788813555.438116:0:3317:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788813555.438118:0:3317:0:(import.c:65:import_set_state_nolock()) ffff9087660d0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788813555.438124:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3317:1875706583807616:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1788813555.439757:0:15117:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788813555.439809:0:15117:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788813555.439828:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740030000/0x6d74dbab2ddb2904 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb290b expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813555.439841:0:15117:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908740030000/0x6d74dbab2ddb2904 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb290b expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788813555.439894:0:15117:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788813555.439897:0:15117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788813555.439898:0:15117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813555.439899:0:15117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788813555.439901:0:15117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813555.439902:0:15117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813555.439903:0:15117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788813555.439905:0:15117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813555.439906:0:15117:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788813555.439910:0:15117:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788813555.439912:0:15117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788813555.439913:0:15117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788813555.439914:0:15117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788813555.439915:0:15117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788813555.439916:0:15117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788813555.439917:0:15117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788813555.439918:0:15117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788813555.439919:0:15117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788813555.439920:0:15117:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788813555.439945:0:15117:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788813555.439966:0:15117:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642916680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583807744:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788813555.440030:0:15117:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813555.440077:0:15117:0:(client.c:2716:ptlrpc_set_wait()) set ffff908761e85c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813555.440077:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583807744 00000100:00100000:0.0:1788813555.440094:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583807744 00000100:00100000:0.0:1788813555.440149:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788813555.440159:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+16:15117:x1875706583807744:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788813555.440184:0:14428:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788813555.440196:0:14428:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788813555.474382:0:14428:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788813555.474409:0:14428:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788813555.474723:0:14450:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788813555.474741:0:14450:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788813555.474762:0:14450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff908749d73e00/0x6d74dbab2ddb2927 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813555.474781:0:14450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff908774368200/0x6d74dbab2ddb2894 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb288d expref: 16 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813555.474789:0:14450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff908749d73e00/0x6d74dbab2ddb2927 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813555.474832:0:14450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff908774368200/0x6d74dbab2ddb2894 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb288d expref: 16 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813555.474847:0:14450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff908774368200/0x6d74dbab2ddb2894 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb288d expref: 16 pid: 14427 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813555.474861:0:14450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14450:1875706583807872:0@lo:104: 00000100:00100000:1.0:1788813555.474921:0:14450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813555.474964:0:14450:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876e623900 going to sleep for 11 seconds 00000100:00100000:0.0:1788813555.475246:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583807872 00000100:00100000:0.0:1788813555.475254:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583807872 00000100:00100000:0.0:1788813555.475306:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788813555.475315:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642916d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+3:14450:x1875706583807872:12345-0@lo:104: 00010000:00010000:0.0:1788813555.475330:0:14418:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff908773c94800/0x6d74dbab2ddb288d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb2894 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813555.475384:0:14418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788813555.475390:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642916d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+3:14450:x1875706583807872:12345-0@lo:104: Request processed in 77us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813555.475396:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788813555.475422:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813555.475433:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908773c94800/0x6d74dbab2ddb288d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb2894 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813555.475440:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c94800 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:0.0:1788813555.475443:0:14423:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908773c94800/0x6d74dbab2ddb288d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb2894 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813555.475450:0:14423:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908773c94800/0x6d74dbab2ddb288d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb2894 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813555.475456:0:14423:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908773c94800/0x6d74dbab2ddb288d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb2894 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813555.475461:0:14423:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788813555.475489:0:14423:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff908773c94800/0x6d74dbab2ddb288d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb2894 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813555.475495:0:14423:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813555.475514:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908773c94800/0x6d74dbab2ddb288d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb2894 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813555.475520:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908773c94800/0x6d74dbab2ddb288d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb2894 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813555.475535:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813555.475537:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813555.475539:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813555.475558:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3321:1875706583808000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813555.475623:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813555.475671:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583808000 00000100:00100000:0.0:1788813555.475681:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583808000 00010000:00010000:0.0:1788813555.475697:0:14421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff908774368200/0x6d74dbab2ddb2894 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb288d expref: 17 pid: 14427 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813555.475719:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788813555.475726:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e927100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+17:3321:x1875706583808000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813555.475736:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813555.475741:0:14421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff908774368200/0x6d74dbab2ddb2894 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb288d expref: 17 pid: 14427 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813555.475752:0:14421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff908774368200/0x6d74dbab2ddb2894 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb288d expref: 17 pid: 14427 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813555.475766:0:14421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff908749d73e00/0x6d74dbab2ddb2927 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813555.475774:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908749d73e00/0x6d74dbab2ddb2927 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788813555.475786:0:14421:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001790799s 00010000:00010000:0.0:1788813555.475790:0:14421:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff908749d73e00/0x6d74dbab2ddb2927 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813555.475807:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff908749d73e00/0x6d74dbab2ddb2927 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813555.475814:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff908749d73e00/0x6d74dbab2ddb2927 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813555.475821:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff908749d73e00/0x6d74dbab2ddb2927 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813555.475838:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73e00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813555.475842:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff908749d73e00/0x6d74dbab2ddb2927 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813555.475849:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff908749d73e00/0x6d74dbab2ddb2927 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813555.475859:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff908749d73e00/0x6d74dbab2ddb2927 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813555.475869:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813555.475899:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e927100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+17:3321:x1875706583808000:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813555.475906:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788813555.475949:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3321:1875706583808000:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788813555.475972:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908774368200/0x6d74dbab2ddb2894 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb288d expref: 16 pid: 14427 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813555.475981:0:14450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14450:1875706583807872:0@lo:104: 00010000:00010000:0.0:1788813555.475992:0:14450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff908749d73e00/0x6d74dbab2ddb2927 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813555.476000:0:14450:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff908749d73e00/0x6d74dbab2ddb2927 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813555.476006:0:14450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff908749d73e00/0x6d74dbab2ddb2927 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813555.476022:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908749d73e00/0x6d74dbab2ddb2927 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813555.487175:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+15:15117:x1875706583807744:12345-0@lo:253:mount.lustre.0 Request processed in 47007us (47134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813555.487190:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788813555.488094:0:15117:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642916680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15117:1875706583807744:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788813555.488114:0:15117:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788813555.488117:0:15117:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788813555.488134:0:15117:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788813555.488135:0:15117:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813555.488137:0:15117:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813555.488138:0:15117:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813555.488139:0:15117:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813555.488140:0:15117:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813555.488142:0:15117:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813555.488143:0:15117:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788813555.488157:0:15117:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788813555.492704:0:15117:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788813555.492903:0:15117:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788813555.493202:0:15117:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788813555.493383:0:15117:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788813555.493539:0:15117:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788813555.493788:0:15117:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788813555.495100:0:15117:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788813555.586781:0:15117:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788813555.586790:0:15117:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788813555.586847:0:15117:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788813555.586900:0:15117:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.147@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788813555.586921:0:15117:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788813555.586948:0:15117:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788813555.970835:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813556.990153:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788813557.373853:0:14431:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788813557.373860:0:14431:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90874923c800 from 7 10000000:01000000:1.0:1788813557.373866:0:14431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788813557.373913:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908749d72000/0x6d74dbab2ddb292e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813557.373924:0:14431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908749d72000/0x6d74dbab2ddb292e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813557.373936:0:14431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908749d72000/0x6d74dbab2ddb292e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813557.373970:0:14431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642915f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583808128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788813557.374040:0:14431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813557.374084:0:14431:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876e623b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788813557.374396:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583808128 00000100:00100000:2.0:1788813557.374405:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583808128 00000100:00100000:2.0:1788813557.374472:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788813557.374482:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+15:14431:x1875706583808128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813557.374495:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813557.374510:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908774369400/0x6d74dbab2ddb2935 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb292e expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813557.374534:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908774369400/0x6d74dbab2ddb2935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb292e expref: 16 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813557.374545:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908774369400/0x6d74dbab2ddb2935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb292e expref: 16 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813557.374554:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369400, rc 0) 00000100:00100000:2.0:1788813557.374631:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+16:14431:x1875706583808128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813557.374638:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788813557.374773:0:14431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642915f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583808128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813557.374789:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908749d72000/0x6d74dbab2ddb292e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2935 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813557.374798:0:14431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908749d72000/0x6d74dbab2ddb292e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb2935 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813557.374858:0:14431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e453800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583808256:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788813557.374894:0:14431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813557.374924:0:14431:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876f9be9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813557.375466:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583808256 00000100:00100000:2.0:1788813557.375472:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583808256 00000100:00100000:2.0:1788813557.375511:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788813557.375518:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+16:14431:x1875706583808256:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788813557.375534:0:14428:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788813557.375555:0:14428:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788813557.375558:0:14428:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788813557.375719:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+16:14431:x1875706583808256:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 201us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813557.375727:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788813557.377274:0:14431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e453800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583808256:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788813557.377414:0:14431:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788813557.377424:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908749d72000/0x6d74dbab2ddb292e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2935 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813557.377435:0:14431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908749d72000/0x6d74dbab2ddb292e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2935 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813558.020042:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813559.039964:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813560.062803:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788813560.510160:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813560.510185:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788813560.510188:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788813560.510192:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788813560.510301:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875706583808512:0@lo:400:kworker.0 00000100:00100000:3.0:1788813560.510387:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813560.510451:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788813560.510458:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3319:1875706583808384:0@lo:400:kworker.0 00000100:00100000:3.0:1788813560.510492:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813560.510556:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e451c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583808640:0@lo:400:kworker.0 00000100:00100000:3.0:1788813560.510623:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813560.511040:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583808512 00000100:00100000:3.0:1788813560.511054:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583808512 00000100:00100000:3.0:1788813560.511100:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583808640 00000100:00100000:3.0:1788813560.511104:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583808640 00000100:00100000:3.0:1788813560.511150:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788813560.511160:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875706583808512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813560.511239:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e453480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875706583808512:12345-0@lo:400:kworker.0 Request processed in 81us (853us total) trans 0 rc 0/0 00000100:00080000:0.0:1788813560.511240:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813560.511251:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788813560.511270:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788813560.511276:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583808640:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788813560.511322:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90876e452680 x1875706583808512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813560.511341:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875706583808512:0@lo:400:kworker.0 00000100:00100000:3.0:1788813560.511747:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583808640:12345-0@lo:400:kworker.0 Request processed in 469us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813560.511754:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788813560.511778:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583808384 00000100:00100000:3.0:1788813560.511783:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583808384 00000100:00100000:3.0:1788813560.511824:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788813560.511832:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+16:3319:x1875706583808384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813560.511872:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+16:3319:x1875706583808384:12345-0@lo:400:kworker.0 Request processed in 41us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813560.511879:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1788813560.512774:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90876e451c00 x1875706583808640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813560.512790:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e451c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583808640:0@lo:400:kworker.0 00000100:00100000:1.0:1788813560.512889:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3319:1875706583808384:0@lo:400:kworker.0 00010000:00010000:0.0:1788813561.091637:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788813561.738562:0:15485:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg447-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788813562.110011:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788813562.495647:0:14468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788813563.140502:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813564.157044:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.182464:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788813565.629399:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813565.629407:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788813565.629410:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813565.629413:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788813565.629502:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3321:1875706583808768:0@lo:400:kworker.0 00000100:00100000:1.0:1788813565.629615:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813565.629682:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875706583809024:0@lo:400:kworker.0 00000100:00100000:1.0:1788813565.629716:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813565.629737:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788813565.629742:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875706583808896:0@lo:400:kworker.0 00000100:00100000:1.0:1788813565.629766:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813565.629819:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583809024 00000100:00100000:1.0:1788813565.629827:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583809024 00000100:00100000:1.0:1788813565.629898:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583808896 00000100:00100000:1.0:1788813565.629902:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583808896 00000100:00100000:1.0:1788813565.629923:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813565.629934:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875706583809024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813565.629988:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875706583809024:12345-0@lo:400:kworker.0 Request processed in 56us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813565.629996:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813565.630016:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813565.630023:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875706583808896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813565.630050:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875706583808896:12345-0@lo:400:kworker.0 Request processed in 28us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813565.630056:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788813565.630285:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff908642914380 x1875706583808896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813565.630300:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875706583808896:0@lo:400:kworker.0 00010000:00080000:1.0:1788813565.630312:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff908642914a80 x1875706583809024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813565.630332:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875706583809024:0@lo:400:kworker.0 00000100:00080000:0.0:1788813565.630446:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813565.631016:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583808768 00000100:00100000:2.0:1788813565.631024:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583808768 00000100:00100000:2.0:1788813565.631081:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788813565.631090:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+16:3321:x1875706583808768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813565.631154:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+16:3321:x1875706583808768:12345-0@lo:400:kworker.0 Request processed in 65us (1538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813565.631160:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788813565.633451:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3321:1875706583808768:0@lo:400:kworker.0 00000100:00100000:3.0:1788813565.693104:0:3317:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813550/real 1788813550] req@ffff90876eb71f80 x1875706583804416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813565 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813565.693140:0:3317:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90876eb71f80 x1875706583804416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813565 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813565.693150:0:3317:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788813550/real 1788813550] req@ffff90876eb71c00 x1875706583804544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813565 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813565.693186:0:3317:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90876eb71c00 x1875706583804544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788813565 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788813565.693208:0:3317:0:(import.c:65:import_set_state_nolock()) ffff90876f9d2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813565.693242:0:3317:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788813565.693247:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1875706583804416:0@lo:8:kworker.0 00000100:00080000:3.0:1788813565.693253:0:3317:0:(import.c:65:import_set_state_nolock()) ffff90876f9d7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813565.693259:0:3317:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788813565.693262:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1875706583804544:0@lo:8:kworker.0 00000100:00080000:1.0:1788813565.693914:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813565.693921:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788813565.693924:0:8:0:(import.c:65:import_set_state_nolock()) ffff90876f9d2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813565.693929:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:1.0:1788813565.693935:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788813565.693947:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90876f9d2000 using connection 192.168.204.147@tcp/0@lo 00000100:00100000:1.0:1788813565.693983:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff908642914e00 x1875706583809152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813565.694011:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788813565.694015:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788813565.694016:0:8:0:(import.c:65:import_set_state_nolock()) ffff90876f9d7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788813565.694020:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:1.0:1788813565.694022:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788813565.694027:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90876f9d7800 using connection 192.168.204.147@tcp/0@lo 00000100:00100000:1.0:1788813565.694039:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff908642914a80 x1875706583809280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788813565.694120:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1875706583809152:0@lo:8:kworker.0 00000100:00100000:3.0:1788813565.694185:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813565.694260:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1875706583809280:0@lo:8:kworker.0 00000100:00100000:3.0:1788813565.694289:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813565.694343:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583809152 00000100:00100000:3.0:1788813565.694351:0:15120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583809152 00000100:00100000:3.0:1788813565.694402:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583809280 00000100:00100000:3.0:1788813565.694407:0:15120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583809280 00000100:00100000:3.0:1788813565.694431:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788813565.694440:0:15120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e450700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3317:x1875706583809152:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788813565.694472:0:15120:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:3.0:1788813565.694729:0:15120:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d74dbab2ddb293c 00002000:00100000:3.0:1788813565.694746:0:15120:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90876e333800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788813565.694751:0:15120:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788813565.694755:0:15120:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788813565.695145:0:15120:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788813565.695174:0:15120:0:(import.c:65:import_set_state_nolock()) ffff9087739c3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788813565.695234:0:15120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e450700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3317:x1875706583809152:12345-0@lo:8:kworker.0 Request processed in 793us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813565.695241:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788813565.695264:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788813565.695269:0:15120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e453100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3317:x1875706583809280:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788813565.695281:0:15120:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1788813565.697117:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff908642914e00 x1875706583809152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788813585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788813565.697133:0:3317:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788813565.697143:0:3317:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788813565.697151:0:3317:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788813565.697157:0:3317:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788813565.697159:0:3317:0:(import.c:65:import_set_state_nolock()) ffff90876f9d2000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788813565.697321:0:3317:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788813565.697328:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1875706583809152:0@lo:8:kworker.0 00000004:00080000:0.0:1788813565.699647:0:14456:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788813565.699962:0:14456:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 507942381139ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788813565.706985:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813565.707366:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583809408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813565.707454:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788813565.708375:0:14457:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1788813565.708410:0:14457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642916300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14457:1875706583809536:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788813565.708466:0:14457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813565.708482:0:14457:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749ce4780 going to sleep for 11 seconds 00000100:00100000:0.0:1788813565.709413:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583809408 00000100:00100000:0.0:1788813565.709425:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583809408 00000100:00100000:0.0:1788813565.709484:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788813565.709496:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1875706583809408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788813565.709529:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788813565.709624:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1875706583809408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (2169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813565.709631:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788813565.709653:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788813565.709683:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff908642914380 x1875706583809408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813581 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813565.709717:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583809408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813565.710520:0:15119:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788813565.710532:0:15119:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788813565.713882:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583809536 00000100:00100000:0.0:1788813565.713898:0:15119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583809536 00000100:00100000:1.0:1788813565.714163:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813565.714174:0:15121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14457:x1875706583809536:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788813565.718013:0:15649:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788813565.718306:0:15649:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00080000:1.0:1788813565.729043:0:15121:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788813565.729055:0:15121:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788813565.729060:0:15121:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00100000:3.0:1788813565.733064:0:15120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e453100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3317:x1875706583809280:12345-0@lo:8:kworker.0 Request processed in 37787us (38770us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788813565.733088:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788813565.733154:0:3317:0:(import.c:65:import_set_state_nolock()) ffff90876f9d7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813565.733160:0:3317:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788813565.733164:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1875706583809280:0@lo:8:kworker.0 00002000:00010000:1.0:1788813565.752500:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788813565.752512:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006246ceb3/0x6d74dbab2ddb2943 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.752531:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1788813565.752535:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813565.752542:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006246ceb3/0x6d74dbab2ddb2943 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.752560:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006246ceb3/0x6d74dbab2ddb2943 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.752572:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006246ceb3/0x6d74dbab2ddb2943 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.752606:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006246ceb3/0x6d74dbab2ddb2943 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.752627:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788813565.753026:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788813565.753038:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c24d612e/0x6d74dbab2ddb294a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.753046:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1788813565.753050:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813565.753055:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c24d612e/0x6d74dbab2ddb294a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.753064:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c24d612e/0x6d74dbab2ddb294a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.753086:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c24d612e/0x6d74dbab2ddb294a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.753094:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c24d612e/0x6d74dbab2ddb294a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.753109:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788813565.753627:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788813565.753635:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006246ceb3/0x6d74dbab2ddb2943 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.753644:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73600 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813565.753649:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006246ceb3/0x6d74dbab2ddb2943 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.753659:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006246ceb3/0x6d74dbab2ddb2943 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.753678:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006246ceb3/0x6d74dbab2ddb2943 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.753685:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006246ceb3/0x6d74dbab2ddb2943 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.753702:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813565.753706:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c24d612e/0x6d74dbab2ddb294a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.753722:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d72a00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813565.753726:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c24d612e/0x6d74dbab2ddb294a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.753733:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c24d612e/0x6d74dbab2ddb294a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.753742:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c24d612e/0x6d74dbab2ddb294a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.753748:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c24d612e/0x6d74dbab2ddb294a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.753759:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813565.753760:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813565.753762:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813565.756158:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788813565.759234:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788813565.759935:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788813565.759947:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000488d9c35/0x6d74dbab2ddb2951 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.759964:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=508s v=(0 0) 00010000:00010000:1.0:1788813565.759968:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813565.759975:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000488d9c35/0x6d74dbab2ddb2951 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.759992:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000488d9c35/0x6d74dbab2ddb2951 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.760010:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000488d9c35/0x6d74dbab2ddb2951 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.760017:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000488d9c35/0x6d74dbab2ddb2951 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.760082:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788813565.760655:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788813565.760662:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a33758cd/0x6d74dbab2ddb2958 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.760673:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=508s v=(0 0) 00010000:00010000:1.0:1788813565.760676:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813565.760681:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a33758cd/0x6d74dbab2ddb2958 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.760692:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a33758cd/0x6d74dbab2ddb2958 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.760700:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a33758cd/0x6d74dbab2ddb2958 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.760708:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a33758cd/0x6d74dbab2ddb2958 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.766052:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788813565.766067:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000488d9c35/0x6d74dbab2ddb2951 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.766092:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73400 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813565.766096:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000488d9c35/0x6d74dbab2ddb2951 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.766130:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000488d9c35/0x6d74dbab2ddb2951 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.766153:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000488d9c35/0x6d74dbab2ddb2951 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.766162:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000488d9c35/0x6d74dbab2ddb2951 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.766190:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813565.766194:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a33758cd/0x6d74dbab2ddb2958 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.766200:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73000 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813565.766204:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a33758cd/0x6d74dbab2ddb2958 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.766212:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a33758cd/0x6d74dbab2ddb2958 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.766221:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a33758cd/0x6d74dbab2ddb2958 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.766230:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813565.766231:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813565.766240:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.766987:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788813565.766998:0:15121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a33758cd/0x6d74dbab2ddb2958 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788813565.768716:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788813565.768728:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c062335/0x6d74dbab2ddb295f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.768743:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=508s v=(0 0) 00010000:00010000:1.0:1788813565.768747:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813565.768753:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c062335/0x6d74dbab2ddb295f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.768767:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c062335/0x6d74dbab2ddb295f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.768787:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c062335/0x6d74dbab2ddb295f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.768795:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c062335/0x6d74dbab2ddb295f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.768813:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813565.768824:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813565.768828:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c062335/0x6d74dbab2ddb295f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.768841:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d72800 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813565.768846:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c062335/0x6d74dbab2ddb295f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.768854:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c062335/0x6d74dbab2ddb295f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.768870:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c062335/0x6d74dbab2ddb295f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.768877:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c062335/0x6d74dbab2ddb295f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.768893:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.768894:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.768896:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813565.769323:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788813565.769330:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8ebb1f6/0x6d74dbab2ddb2966 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.769339:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=508s v=(0 0) 00010000:00010000:1.0:1788813565.769342:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813565.769346:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8ebb1f6/0x6d74dbab2ddb2966 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.769356:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8ebb1f6/0x6d74dbab2ddb2966 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.769371:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8ebb1f6/0x6d74dbab2ddb2966 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.769378:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8ebb1f6/0x6d74dbab2ddb2966 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.769392:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813565.769400:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813565.769404:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8ebb1f6/0x6d74dbab2ddb2966 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.769409:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73a00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813565.769412:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8ebb1f6/0x6d74dbab2ddb2966 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.769419:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8ebb1f6/0x6d74dbab2ddb2966 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.769429:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8ebb1f6/0x6d74dbab2ddb2966 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.769435:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8ebb1f6/0x6d74dbab2ddb2966 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.769447:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.769454:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.769455:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813565.769896:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813565.771466:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788813565.771477:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ea1915f/0x6d74dbab2ddb296d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.771492:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=508s v=(0 0) 00010000:00010000:1.0:1788813565.771497:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813565.771502:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ea1915f/0x6d74dbab2ddb296d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.771515:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ea1915f/0x6d74dbab2ddb296d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.771525:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ea1915f/0x6d74dbab2ddb296d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.771532:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ea1915f/0x6d74dbab2ddb296d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.771558:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813565.772303:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813565.772312:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ea1915f/0x6d74dbab2ddb296d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.772322:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d72c00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813565.772326:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ea1915f/0x6d74dbab2ddb296d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.772336:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ea1915f/0x6d74dbab2ddb296d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.772356:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ea1915f/0x6d74dbab2ddb296d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.772363:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ea1915f/0x6d74dbab2ddb296d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.772384:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813565.772386:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813565.772388:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813565.775405:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788813565.775420:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fef5fbc6/0x6d74dbab2ddb2974 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.775435:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=508s v=(0 0) 00010000:00010000:1.0:1788813565.775440:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813565.775447:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fef5fbc6/0x6d74dbab2ddb2974 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.775471:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fef5fbc6/0x6d74dbab2ddb2974 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.775482:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fef5fbc6/0x6d74dbab2ddb2974 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.775489:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fef5fbc6/0x6d74dbab2ddb2974 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.775517:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813565.776766:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813565.776776:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fef5fbc6/0x6d74dbab2ddb2974 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.776788:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d72200 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813565.776792:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fef5fbc6/0x6d74dbab2ddb2974 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.776812:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fef5fbc6/0x6d74dbab2ddb2974 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.776831:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fef5fbc6/0x6d74dbab2ddb2974 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.776839:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fef5fbc6/0x6d74dbab2ddb2974 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.776863:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813565.776865:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813565.776867:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813565.779871:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788813565.779882:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b34bf5a1/0x6d74dbab2ddb297b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.779899:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=508s v=(0 0) 00010000:00010000:1.0:1788813565.779903:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813565.779909:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b34bf5a1/0x6d74dbab2ddb297b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.779922:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b34bf5a1/0x6d74dbab2ddb297b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.779932:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b34bf5a1/0x6d74dbab2ddb297b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.779953:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b34bf5a1/0x6d74dbab2ddb297b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.779978:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813565.782823:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813565.782834:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b34bf5a1/0x6d74dbab2ddb297b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.782846:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d72600 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813565.782851:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b34bf5a1/0x6d74dbab2ddb297b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.782862:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b34bf5a1/0x6d74dbab2ddb297b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.782882:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b34bf5a1/0x6d74dbab2ddb297b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.782905:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b34bf5a1/0x6d74dbab2ddb297b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.782929:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813565.782931:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813565.782932:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813565.783301:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788813565.783309:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e7a340d/0x6d74dbab2ddb2982 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.783320:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=508s v=(0 0) 00010000:00010000:1.0:1788813565.783324:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813565.783329:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e7a340d/0x6d74dbab2ddb2982 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.783340:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e7a340d/0x6d74dbab2ddb2982 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.783349:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e7a340d/0x6d74dbab2ddb2982 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.783356:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e7a340d/0x6d74dbab2ddb2982 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.783379:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813565.784115:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813565.784122:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e7a340d/0x6d74dbab2ddb2982 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.784131:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73e00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813565.784135:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e7a340d/0x6d74dbab2ddb2982 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.784144:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e7a340d/0x6d74dbab2ddb2982 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.784158:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e7a340d/0x6d74dbab2ddb2982 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.784166:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e7a340d/0x6d74dbab2ddb2982 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.784182:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813565.784184:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813565.784185:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813565.784836:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788813565.784843:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b82d78f7/0x6d74dbab2ddb2989 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.784859:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=508s v=(0 0) 00010000:00010000:1.0:1788813565.784863:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813565.784868:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b82d78f7/0x6d74dbab2ddb2989 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.784880:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b82d78f7/0x6d74dbab2ddb2989 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.784889:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b82d78f7/0x6d74dbab2ddb2989 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.784897:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b82d78f7/0x6d74dbab2ddb2989 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.784945:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788813565.785378:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788813565.785384:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b81ed45c/0x6d74dbab2ddb2990 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.785392:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=508s v=(0 0) 00010000:00010000:1.0:1788813565.785395:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813565.785398:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b81ed45c/0x6d74dbab2ddb2990 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.785407:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b81ed45c/0x6d74dbab2ddb2990 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.785426:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b81ed45c/0x6d74dbab2ddb2990 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.785433:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b81ed45c/0x6d74dbab2ddb2990 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.793116:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788813565.793130:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b82d78f7/0x6d74dbab2ddb2989 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.793145:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148dc00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813565.793150:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b82d78f7/0x6d74dbab2ddb2989 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.793162:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b82d78f7/0x6d74dbab2ddb2989 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.793182:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b82d78f7/0x6d74dbab2ddb2989 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.793189:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b82d78f7/0x6d74dbab2ddb2989 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.793210:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813565.793214:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b81ed45c/0x6d74dbab2ddb2990 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.793220:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148de00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813565.793223:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b81ed45c/0x6d74dbab2ddb2990 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.793230:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b81ed45c/0x6d74dbab2ddb2990 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.793251:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b81ed45c/0x6d74dbab2ddb2990 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.793259:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813565.793261:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813565.793263:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.794139:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788813565.794148:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.794150:0:15121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b81ed45c/0x6d74dbab2ddb2990 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788813565.796847:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788813565.796860:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034f6028e/0x6d74dbab2ddb2997 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.796876:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=508s v=(0 0) 00010000:00010000:1.0:1788813565.796880:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813565.796886:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034f6028e/0x6d74dbab2ddb2997 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.796901:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034f6028e/0x6d74dbab2ddb2997 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.796912:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034f6028e/0x6d74dbab2ddb2997 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.796930:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034f6028e/0x6d74dbab2ddb2997 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.796953:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813565.796972:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813565.796979:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034f6028e/0x6d74dbab2ddb2997 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.796988:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148ce00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813565.796993:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034f6028e/0x6d74dbab2ddb2997 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.797001:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034f6028e/0x6d74dbab2ddb2997 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.797032:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034f6028e/0x6d74dbab2ddb2997 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.797039:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034f6028e/0x6d74dbab2ddb2997 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.797056:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813565.797058:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813565.797064:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813565.798920:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813565.798931:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bed008c/0x6d74dbab2ddb299e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.798948:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788813565.798952:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813565.798958:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bed008c/0x6d74dbab2ddb299e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.798970:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bed008c/0x6d74dbab2ddb299e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.798980:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bed008c/0x6d74dbab2ddb299e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.798987:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bed008c/0x6d74dbab2ddb299e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.799094:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813565.799264:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813565.799271:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bed008c/0x6d74dbab2ddb299e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.799279:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031200 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813565.799283:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bed008c/0x6d74dbab2ddb299e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.799304:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bed008c/0x6d74dbab2ddb299e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.799322:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bed008c/0x6d74dbab2ddb299e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.799329:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bed008c/0x6d74dbab2ddb299e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.799345:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.799346:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.799348:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813565.799566:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813565.799572:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000efcdb01/0x6d74dbab2ddb29a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.799719:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788813565.799723:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813565.799727:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000efcdb01/0x6d74dbab2ddb29a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.799748:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000efcdb01/0x6d74dbab2ddb29a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.799757:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000efcdb01/0x6d74dbab2ddb29a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.799764:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000efcdb01/0x6d74dbab2ddb29a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.800083:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788813565.800634:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813565.800641:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b6db7e9/0x6d74dbab2ddb29ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.800651:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788813565.800655:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813565.800659:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b6db7e9/0x6d74dbab2ddb29ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.800669:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b6db7e9/0x6d74dbab2ddb29ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.800677:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b6db7e9/0x6d74dbab2ddb29ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.800696:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b6db7e9/0x6d74dbab2ddb29ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.801167:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813565.801179:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000efcdb01/0x6d74dbab2ddb29a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.801188:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740030e00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813565.801193:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000efcdb01/0x6d74dbab2ddb29a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.801203:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000efcdb01/0x6d74dbab2ddb29a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.801219:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000efcdb01/0x6d74dbab2ddb29a5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.801227:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000efcdb01/0x6d74dbab2ddb29a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.801242:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813565.801245:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b6db7e9/0x6d74dbab2ddb29ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.801252:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031e00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813565.801255:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b6db7e9/0x6d74dbab2ddb29ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.801262:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b6db7e9/0x6d74dbab2ddb29ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.801283:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b6db7e9/0x6d74dbab2ddb29ac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.801304:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.801306:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.801308:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813565.801414:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788813565.801421:0:15121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b6db7e9/0x6d74dbab2ddb29ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788813565.801924:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813565.801931:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb29b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.801942:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788813565.801946:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813565.801951:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb29b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.801961:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb29b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.801970:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb29b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.801978:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb29b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.802171:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813565.802178:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb29b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.802186:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031000 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813565.802190:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb29b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.802199:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb29b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.802213:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb29b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.802221:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.802223:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.802225:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813565.802297:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788813565.802302:0:15121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb29b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788813565.803792:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813565.803806:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006db76c5b/0x6d74dbab2ddb29ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.803821:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788813565.803825:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813565.803831:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006db76c5b/0x6d74dbab2ddb29ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.803843:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006db76c5b/0x6d74dbab2ddb29ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.803855:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006db76c5b/0x6d74dbab2ddb29ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.803863:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006db76c5b/0x6d74dbab2ddb29ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.804269:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813565.804277:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006db76c5b/0x6d74dbab2ddb29ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.804387:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740030a00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813565.804922:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006db76c5b/0x6d74dbab2ddb29ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.804936:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006db76c5b/0x6d74dbab2ddb29ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.804955:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006db76c5b/0x6d74dbab2ddb29ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.804963:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.804965:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.804967:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813565.805386:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788813565.805394:0:15121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006db76c5b/0x6d74dbab2ddb29ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.806198:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813565.807046:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813565.807054:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000082f1fd7/0x6d74dbab2ddb29c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.807082:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788813565.807086:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813565.807092:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000082f1fd7/0x6d74dbab2ddb29c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.807105:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000082f1fd7/0x6d74dbab2ddb29c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.807120:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000082f1fd7/0x6d74dbab2ddb29c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.807127:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000082f1fd7/0x6d74dbab2ddb29c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.807271:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813565.807351:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813565.807358:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000082f1fd7/0x6d74dbab2ddb29c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.807366:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031600 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813565.807371:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000082f1fd7/0x6d74dbab2ddb29c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.807380:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000082f1fd7/0x6d74dbab2ddb29c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.807397:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000082f1fd7/0x6d74dbab2ddb29c1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.807460:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000082f1fd7/0x6d74dbab2ddb29c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.807477:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.807478:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.807480:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813565.808086:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813565.808093:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029e65866/0x6d74dbab2ddb29c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.808103:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788813565.808106:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813565.808117:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029e65866/0x6d74dbab2ddb29c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.808127:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029e65866/0x6d74dbab2ddb29c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.808135:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029e65866/0x6d74dbab2ddb29c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.808142:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029e65866/0x6d74dbab2ddb29c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.808156:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813565.808291:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813565.808297:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029e65866/0x6d74dbab2ddb29c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.808305:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740030c00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813565.808309:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029e65866/0x6d74dbab2ddb29c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.808316:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029e65866/0x6d74dbab2ddb29c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.808330:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029e65866/0x6d74dbab2ddb29c8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.808337:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029e65866/0x6d74dbab2ddb29c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.808352:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.808354:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.808356:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813565.808874:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813565.808880:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ccbdf97/0x6d74dbab2ddb29cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.808889:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788813565.808892:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813565.808897:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ccbdf97/0x6d74dbab2ddb29cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.808906:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ccbdf97/0x6d74dbab2ddb29cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.808915:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ccbdf97/0x6d74dbab2ddb29cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.808932:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ccbdf97/0x6d74dbab2ddb29cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.808954:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813565.809035:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813565.809041:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ccbdf97/0x6d74dbab2ddb29cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.809048:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a1400 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813565.809052:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ccbdf97/0x6d74dbab2ddb29cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.809060:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ccbdf97/0x6d74dbab2ddb29cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.809085:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ccbdf97/0x6d74dbab2ddb29cf lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.809092:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ccbdf97/0x6d74dbab2ddb29cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.809107:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.809109:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.809110:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813565.810706:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813565.810715:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c28342a8/0x6d74dbab2ddb29d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.810729:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788813565.810733:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813565.810738:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c28342a8/0x6d74dbab2ddb29d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.810751:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c28342a8/0x6d74dbab2ddb29d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.810760:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c28342a8/0x6d74dbab2ddb29d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.810768:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c28342a8/0x6d74dbab2ddb29d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.810793:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813565.810870:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813565.810877:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c28342a8/0x6d74dbab2ddb29d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.810885:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a1800 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813565.810889:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c28342a8/0x6d74dbab2ddb29d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.810907:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c28342a8/0x6d74dbab2ddb29d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.810923:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c28342a8/0x6d74dbab2ddb29d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.810930:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c28342a8/0x6d74dbab2ddb29d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.810949:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.810951:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.810953:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813565.811220:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813565.811226:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c061e141/0x6d74dbab2ddb29dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.811239:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788813565.811243:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813565.811247:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c061e141/0x6d74dbab2ddb29dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.811256:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c061e141/0x6d74dbab2ddb29dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.811265:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c061e141/0x6d74dbab2ddb29dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.811273:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c061e141/0x6d74dbab2ddb29dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.812359:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788813565.813064:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813565.813084:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e619de5/0x6d74dbab2ddb29e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.813097:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788813565.813102:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813565.813107:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e619de5/0x6d74dbab2ddb29e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.813120:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e619de5/0x6d74dbab2ddb29e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.813140:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e619de5/0x6d74dbab2ddb29e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.813148:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e619de5/0x6d74dbab2ddb29e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.813911:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788813565.814405:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813565.814412:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002020f8bf/0x6d74dbab2ddb29eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.814423:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=508s v=(0 0) 00010000:00010000:0.0:1788813565.814427:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813565.814432:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002020f8bf/0x6d74dbab2ddb29eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.814442:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002020f8bf/0x6d74dbab2ddb29eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.814452:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002020f8bf/0x6d74dbab2ddb29eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.814460:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002020f8bf/0x6d74dbab2ddb29eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.814478:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788813565.814595:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788813565.814603:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c061e141/0x6d74dbab2ddb29dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.814611:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a1600 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813565.814616:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c061e141/0x6d74dbab2ddb29dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.814625:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c061e141/0x6d74dbab2ddb29dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.814642:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c061e141/0x6d74dbab2ddb29dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.814662:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c061e141/0x6d74dbab2ddb29dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.814685:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813565.814688:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e619de5/0x6d74dbab2ddb29e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.814695:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a0200 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813565.814698:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e619de5/0x6d74dbab2ddb29e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.814705:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e619de5/0x6d74dbab2ddb29e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.814715:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e619de5/0x6d74dbab2ddb29e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.814722:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e619de5/0x6d74dbab2ddb29e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.814737:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813565.814740:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002020f8bf/0x6d74dbab2ddb29eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.814746:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a0400 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813565.814754:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002020f8bf/0x6d74dbab2ddb29eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.814763:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002020f8bf/0x6d74dbab2ddb29eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.814772:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002020f8bf/0x6d74dbab2ddb29eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.814779:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002020f8bf/0x6d74dbab2ddb29eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.814791:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.814793:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.814795:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.814805:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813565.816450:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788813565.816462:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b81ed45c/0x6d74dbab2ddb29f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.816476:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=508s v=(0 0) 00010000:00010000:1.0:1788813565.816480:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813565.816557:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b81ed45c/0x6d74dbab2ddb29f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.816571:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b81ed45c/0x6d74dbab2ddb29f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.816672:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b81ed45c/0x6d74dbab2ddb29f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.816680:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b81ed45c/0x6d74dbab2ddb29f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.816735:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788813565.817203:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788813565.817209:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000982dc1a0/0x6d74dbab2ddb29f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.817218:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=508s v=(0 0) 00010000:00010000:1.0:1788813565.817221:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813565.817224:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000982dc1a0/0x6d74dbab2ddb29f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.817233:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000982dc1a0/0x6d74dbab2ddb29f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.817241:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000982dc1a0/0x6d74dbab2ddb29f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.817247:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000982dc1a0/0x6d74dbab2ddb29f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.818606:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788813565.818617:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b81ed45c/0x6d74dbab2ddb29f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.818630:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148de00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813565.818634:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b81ed45c/0x6d74dbab2ddb29f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.818645:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b81ed45c/0x6d74dbab2ddb29f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.818664:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b81ed45c/0x6d74dbab2ddb29f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.818672:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b81ed45c/0x6d74dbab2ddb29f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.818693:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813565.818696:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000982dc1a0/0x6d74dbab2ddb29f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.818704:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148ca00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813565.818707:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000982dc1a0/0x6d74dbab2ddb29f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.818732:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000982dc1a0/0x6d74dbab2ddb29f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.818743:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000982dc1a0/0x6d74dbab2ddb29f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.818751:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813565.818753:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813565.818755:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.818842:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788813565.818851:0:15121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000982dc1a0/0x6d74dbab2ddb29f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788813565.819413:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788813565.819421:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fe3761d/0x6d74dbab2ddb2a00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.819433:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=508s v=(0 0) 00010000:00010000:1.0:1788813565.819437:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813565.819443:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fe3761d/0x6d74dbab2ddb2a00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.819455:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fe3761d/0x6d74dbab2ddb2a00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.819464:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fe3761d/0x6d74dbab2ddb2a00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813565.819472:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fe3761d/0x6d74dbab2ddb2a00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.819692:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813565.819698:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fe3761d/0x6d74dbab2ddb2a00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.819706:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148c600 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813565.819709:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fe3761d/0x6d74dbab2ddb2a00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.819717:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fe3761d/0x6d74dbab2ddb2a00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.819730:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fe3761d/0x6d74dbab2ddb2a00 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813565.819750:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813565.819752:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813565.819754:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813565.819832:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788813565.819837:0:15121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fe3761d/0x6d74dbab2ddb2a00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788813565.820031:0:15121:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1788813565.820142:0:15121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642917b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14457:x1875706583809536:12345-0@lo:5:osp-pre-0-0.0 Request processed in 105967us (111672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813565.820152:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788813565.820200:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813565.820320:0:14457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642916300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14457:1875706583809536:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788813565.820336:0:14457:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1788813565.820383:0:14457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb73100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14457:1875706583809664:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788813565.820426:0:14457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813565.820471:0:14457:0:(client.c:2716:ptlrpc_set_wait()) set ffff908781f58000 going to sleep for 11 seconds 00000100:00100000:0.0:1788813565.820473:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583809664 00000100:00100000:0.0:1788813565.820552:0:15119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583809664 00000100:00100000:0.0:1788813565.820623:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788813565.820633:0:15119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14457:x1875706583809664:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788813565.820676:0:15119:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1788813565.826448:0:15119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14457:x1875706583809664:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5646us (5851us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788813565.826463:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788813565.826727:0:14457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb73100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14457:1875706583809664:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788813565.826744:0:14457:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1788813566.205198:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813567.229262:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813568.253350:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813569.290105:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788813569.559927:0:15836:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788813569.559931:0:15836:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788813569.560062:0:15836:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff908766548800 00000020:01000004:1.0:1788813569.560078:0:15836:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788813569.560092:0:15836:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788813569.560104:0:15836:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff90876fac0000) 00000020:00000080:1.0:1788813569.560120:0:15836:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788813569.588771:0:15836:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788813569.599567:0:15836:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788813569.604140:0:15836:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788813569.604400:0:15836:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788813569.604666:0:15836:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788813569.607811:0:15836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 597: rc = 0 00100000:10000000:0.0:1788813569.607920:0:15836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 597: rc = 0 00100000:10000000:0.0:1788813569.608032:0:15836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 597: rc = 0 00100000:10000000:1.0:1788813569.611640:0:15836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 769: rc = 0 00100000:10000000:1.0:1788813569.611960:0:15836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 769: rc = 0 00100000:10000000:1.0:1788813569.612245:0:15836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:1.0:1788813569.613276:0:15836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 769: rc = 0 00100000:10000000:1.0:1788813569.613533:0:15836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:1.0:1788813569.613829:0:15836:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 769: rc = 0 00000020:00000080:0.0:1788813569.614497:0:15836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788813569.614511:0:15836:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788813569.614522:0:15836:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6d74dbab2ddb2a0e 00000020:01000004:0.0:1788813569.614531:0:15836:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788813569.614553:0:15836:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.147@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788813569.614557:0:15836:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.147@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788813569.614564:0:15836:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788813569.614609:0:15836:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1788813569.614615:0:15836:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.147@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788813569.638638:0:15836:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.147@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788813569.638679:0:15836:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.147@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788813569.638684:0:15836:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788813569.638686:0:15836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788813569.638687:0:15836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813569.638688:0:15836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813569.638689:0:15836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813569.638690:0:15836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813569.638692:0:15836:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788813569.638694:0:15836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813569.638695:0:15836:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788813569.638699:0:15836:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788813569.638701:0:15836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788813569.638702:0:15836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788813569.638704:0:15836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813569.638705:0:15836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813569.638705:0:15836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813569.638712:0:15836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813569.638713:0:15836:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788813569.638714:0:15836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813569.638715:0:15836:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788813569.638757:0:15836:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788813569.638780:0:15836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e451880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583809792:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788813569.638851:0:15836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813569.638916:0:15836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087466b0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788813569.639104:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583809792 00000100:00100000:1.0:1788813569.639112:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583809792 00000100:00100000:1.0:1788813569.639163:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788813569.639173:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+16:15836:x1875706583809792:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788813569.639200:0:14428:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788813569.639209:0:14428:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788813569.639213:0:14428:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788813569.677817:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+16:15836:x1875706583809792:12345-0@lo:253:mount.lustre.0 Request processed in 38637us (38957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813569.677832:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788813569.678038:0:15836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e451880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583809792:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788813569.678053:0:15836:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788813569.678057:0:15836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788813569.678059:0:15836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788813569.678060:0:15836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788813569.678061:0:15836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788813569.678062:0:15836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788813569.678064:0:15836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788813569.678065:0:15836:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788813569.678067:0:15836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788813569.678068:0:15836:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788813569.678088:0:15836:0:(tgt_mount.c:101:server_register_mount()) register mount ffff908766548800 from lustre-OST0001 10000000:01000000:3.0:1788813569.678117:0:15836:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788813569.678120:0:15836:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788813569.678127:0:15836:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90876f9c8000 local copy 00010000:00010000:3.0:1788813569.678137:0:15836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb27b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb27bb expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813569.678380:0:15836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e451880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583809920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813569.678420:0:15836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813569.678457:0:15836:0:(client.c:2716:ptlrpc_set_wait()) set ffff908781f58e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788813569.678523:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583809920 00000100:00100000:0.0:1788813569.678529:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583809920 00000100:00100000:0.0:1788813569.678575:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788813569.678612:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+16:15836:x1875706583809920:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813569.678863:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+16:15836:x1875706583809920:12345-0@lo:501:mount.lustre.0 Request processed in 252us (442us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788813569.678871:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788813569.682678:0:15836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e451880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583809920:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788813569.682708:0:15836:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.147@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788813569.682978:0:15836:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.147@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788813569.683005:0:15836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb27b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb27bb expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813569.683016:0:15836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908740031800/0x6d74dbab2ddb27b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb27bb expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788813569.683047:0:15836:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff908766548800 10000000:01000000:3.0:1788813569.683052:0:15836:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788813569.683057:0:15836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788813569.683059:0:15836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788813569.683064:0:15836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788813569.683067:0:15836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788813569.683099:0:15836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908773c94400/0x6d74dbab2ddb2a15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813569.683107:0:15836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908773c94400/0x6d74dbab2ddb2a15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813569.683118:0:15836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908773c94400/0x6d74dbab2ddb2a15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813569.683138:0:15836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e451880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583810048:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788813569.683202:0:15836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813569.683245:0:15836:0:(client.c:2716:ptlrpc_set_wait()) set ffff908781f58e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788813569.683358:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583810048 00000100:00100000:0.0:1788813569.683365:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583810048 00000100:00100000:0.0:1788813569.683421:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788813569.683430:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+16:15836:x1875706583810048:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813569.683443:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813569.683457:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9087413a1800/0x6d74dbab2ddb2a1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb2a15 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813569.683481:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9087413a1800/0x6d74dbab2ddb2a1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb2a15 expref: 17 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813569.683491:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9087413a1800/0x6d74dbab2ddb2a1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb2a15 expref: 17 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813569.683499:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9087413a1800, rc 0) 00000100:00100000:0.0:1788813569.683545:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+17:15836:x1875706583810048:12345-0@lo:101:mount.lustre.0 Request processed in 117us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813569.683551:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788813569.686414:0:15836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e451880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583810048:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788813569.686456:0:15836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908773c94400/0x6d74dbab2ddb2a15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2a1c expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813569.686469:0:15836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908773c94400/0x6d74dbab2ddb2a15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb2a1c expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788813569.687227:0:15836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788813569.688108:0:15836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788813569.688364:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788813569.688409:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788813569.688444:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788813569.688492:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788813569.688531:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788813569.688565:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788813569.692977:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788813569.693010:0:15836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788813569.693127:0:15836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb72a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583810176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813569.693193:0:15836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813569.693228:0:15836:0:(client.c:2716:ptlrpc_set_wait()) set ffff908749ce4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813569.693792:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583810176 00000100:00100000:0.0:1788813569.693800:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583810176 00000100:00100000:0.0:1788813569.693858:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788813569.693868:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+17:15836:x1875706583810176:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813569.694326:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+17:15836:x1875706583810176:12345-0@lo:501:mount.lustre.0 Request processed in 459us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813569.694335:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788813569.694548:0:15836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb72a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583810176:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788813569.694620:0:15836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e451880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583810304:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788813569.694665:0:15836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813569.694688:0:15836:0:(client.c:2716:ptlrpc_set_wait()) set ffff908781f58180 going to sleep for 11 seconds 00000100:00100000:2.0:1788813569.694831:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583810304 00000100:00100000:2.0:1788813569.694837:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583810304 00000100:00100000:2.0:1788813569.694874:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788813569.694882:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+17:15836:x1875706583810304:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788813569.695220:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+17:15836:x1875706583810304:12345-0@lo:503:mount.lustre.0 Request processed in 338us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813569.695229:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788813569.695336:0:15836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e451880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583810304:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788813569.695975:0:15836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788813569.696056:0:15836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642917100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583810432:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813569.696105:0:15836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813569.696133:0:15836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087453ea3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788813569.696230:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583810432 00000100:00100000:3.0:1788813569.696236:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583810432 00000100:00100000:3.0:1788813569.696262:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788813569.696270:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+17:15836:x1875706583810432:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788813569.696469:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+17:15836:x1875706583810432:12345-0@lo:502:mount.lustre.0 Request processed in 198us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813569.696475:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788813569.696566:0:15836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642917100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583810432:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788813569.696848:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788813569.696913:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788813569.696953:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788813569.697014:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788813569.697051:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788813569.697084:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788813569.697133:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788813569.697171:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788813569.697232:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788813569.697265:0:15836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642917100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583810560:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813569.697316:0:15836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813569.697343:0:15836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087453ea3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788813569.697436:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583810560 00000100:00100000:0.0:1788813569.697442:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583810560 00000100:00100000:0.0:1788813569.697470:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788813569.697478:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+17:15836:x1875706583810560:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813569.697670:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+17:15836:x1875706583810560:12345-0@lo:502:mount.lustre.0 Request processed in 192us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813569.697677:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788813569.697798:0:15836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642917100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583810560:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788813569.697864:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788813569.697873:0:15836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1788813569.702007:0:15837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788813569.702018:0:15837:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788813569.702025:0:15837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788813569.702027:0:15837:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788813569.702033:0:15837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788813569.702048:0:15837:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9087757a19c0) 00000020:00000080:3.0:1788813569.702074:0:15837:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788813569.702081:0:15837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788813569.702173:0:15837:0:(tgt_mount.c:153:server_get_mount()) get mount ffff908766548800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788813569.702182:0:15837:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788813569.702189:0:15837:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6d74dbab2ddb2a2a 00010000:00010000:2.0:1788813569.705483:0:15837:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1788813569.709118:0:15837:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1788813569.712912:0:15837:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788813569.721135:0:15837:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788813569.721149:0:15837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813569.721156:0:15837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813569.721158:0:15837:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788813569.721161:0:15837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813569.721165:0:15837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813569.721167:0:15837:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788813569.721170:0:15837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788813569.721172:0:15837:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788813569.721175:0:15837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813569.721177:0:15837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813569.721178:0:15837:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788813569.721180:0:15837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813569.721183:0:15837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813569.721184:0:15837:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788813569.721187:0:15837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788813569.721250:0:15837:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813569.721254:0:15837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813569.721256:0:15837:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788813569.721259:0:15837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788813569.721425:0:15836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788813569.721453:0:15836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788813569.721479:0:15836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908773c94400/0x6d74dbab2ddb2a15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2a1c expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813569.721503:0:15836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908773c94400/0x6d74dbab2ddb2a15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2a1c expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813569.721511:0:15836:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff908766548800 from 1 10000000:01000000:1.0:1788813569.721514:0:15836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788813569.721550:0:15836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148d600/0x6d74dbab2ddb2a31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813569.721558:0:15836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff90874148d600/0x6d74dbab2ddb2a31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813569.721570:0:15836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff90874148d600/0x6d74dbab2ddb2a31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813569.721626:0:15836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642917100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583810688:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788813569.721696:0:15836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813569.721732:0:15836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087453ead80 going to sleep for 11 seconds 00000100:00100000:0.0:1788813569.724808:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583810688 00000100:00100000:0.0:1788813569.724820:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583810688 00000100:00100000:0.0:1788813569.724884:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788813569.724894:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+17:15836:x1875706583810688:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813569.724911:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813569.724929:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9087413a1400/0x6d74dbab2ddb2a38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb2a31 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813569.724958:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9087413a1400/0x6d74dbab2ddb2a38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb2a31 expref: 18 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813569.724969:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9087413a1400/0x6d74dbab2ddb2a38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb2a31 expref: 18 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813569.724977:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9087413a1400, rc 0) 00000100:00100000:0.0:1788813569.725065:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+18:15836:x1875706583810688:12345-0@lo:101:mount.lustre.0 Request processed in 172us (3368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813569.725071:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788813569.725129:0:15836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642917100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583810688:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813569.725148:0:15836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff90874148d600/0x6d74dbab2ddb2a31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2a38 expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813569.725159:0:15836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff90874148d600/0x6d74dbab2ddb2a31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb2a38 expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788813569.725719:0:15836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788813569.726087:0:15836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788813569.726338:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788813569.726387:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788813569.726465:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788813569.726474:0:15836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788813569.726543:0:15836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583810816:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813569.726628:0:15836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813569.726936:0:15836:0:(client.c:2716:ptlrpc_set_wait()) set ffff90874812f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788813569.727708:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583810816 00000100:00100000:1.0:1788813569.727717:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583810816 00000100:00100000:1.0:1788813569.727765:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788813569.727775:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+18:15836:x1875706583810816:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813569.728027:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+18:15836:x1875706583810816:12345-0@lo:501:mount.lustre.0 Request processed in 253us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813569.728034:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788813569.732261:0:15836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583810816:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788813569.732332:0:15836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583810944:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788813569.732411:0:15836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813569.732459:0:15836:0:(client.c:2716:ptlrpc_set_wait()) set ffff90874812f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788813569.734254:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583810944 00000100:00100000:2.0:1788813569.734269:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583810944 00000100:00100000:2.0:1788813569.734864:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788813569.734877:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+18:15836:x1875706583810944:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788813569.735157:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+18:15836:x1875706583810944:12345-0@lo:503:mount.lustre.0 Request processed in 283us (2745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813569.735165:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788813569.735357:0:15836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583810944:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788813569.735924:0:15836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788813569.736008:0:15836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583811072:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813569.736058:0:15836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813569.736094:0:15836:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c1c7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813569.736370:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583811072 00000100:00100000:2.0:1788813569.736378:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583811072 00000100:00100000:2.0:1788813569.736419:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788813569.736428:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fafe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+18:15836:x1875706583811072:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813569.736900:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fafe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+18:15836:x1875706583811072:12345-0@lo:502:mount.lustre.0 Request processed in 471us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813569.736908:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788813569.740750:0:15836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583811072:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788813569.741071:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788813569.741138:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788813569.741207:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788813569.741245:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788813569.741278:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788813569.741320:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788813569.741353:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788813569.741387:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788813569.741429:0:15836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642915880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583811200:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788813569.741508:0:15836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813569.741553:0:15836:0:(client.c:2716:ptlrpc_set_wait()) set ffff908781f58e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788813569.741675:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583811200 00000100:00100000:0.0:1788813569.741682:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583811200 00000100:00100000:0.0:1788813569.741738:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788813569.741748:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877fafe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+18:15836:x1875706583811200:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813569.741947:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877fafe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+18:15836:x1875706583811200:12345-0@lo:502:mount.lustre.0 Request processed in 200us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813569.741955:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788813569.742020:0:15836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642915880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583811200:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788813569.742109:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788813569.742120:0:15836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788813569.742706:0:15841:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813569.742722:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813569.742724:0:15841:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788813569.742731:0:15841:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff908766548800 00000020:00000080:0.0:1788813569.742733:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788813569.742740:0:15841:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813569.742742:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813569.742744:0:15841:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788813569.742746:0:15841:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813569.742748:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813569.742749:0:15841:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788813569.742752:0:15841:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff908766548800 00000020:00000080:0.0:1788813569.742754:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788813569.742803:0:15841:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788813569.744313:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813569.744318:0:15841:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788813569.744327:0:15841:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788813569.744333:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788813569.744335:0:15841:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788813569.744340:0:15841:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff908766548800 00000020:00000080:0.0:1788813569.744343:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788813569.750776:0:15841:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788813569.750789:0:15841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788813569.750792:0:15841:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788813569.750797:0:15841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788813569.752692:0:15836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788813569.752734:0:15836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788813569.752762:0:15836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148d600/0x6d74dbab2ddb2a31 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2a38 expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813569.752776:0:15836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff90874148d600/0x6d74dbab2ddb2a31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2a38 expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813569.752825:0:15836:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788813569.752828:0:15836:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff908766548800 10000000:01000000:0.0:1788813569.752831:0:15836:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff908766548800 10000000:01000000:0.0:1788813569.752835:0:15836:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788813569.752841:0:15836:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff908766548800 from 1 10000000:01000000:0.0:1788813569.752850:0:15836:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788813569.752886:0:15836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff9087413a1600/0x6d74dbab2ddb2a3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813569.752895:0:15836:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff9087413a1600/0x6d74dbab2ddb2a3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813569.752906:0:15836:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff9087413a1600/0x6d74dbab2ddb2a3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813569.752929:0:15836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e925c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583811328:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788813569.753007:0:15836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813569.753046:0:15836:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c1c7180 going to sleep for 11 seconds 00000100:00100000:0.0:1788813569.753078:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583811328 00000100:00100000:0.0:1788813569.753083:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583811328 00000100:00100000:0.0:1788813569.753121:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788813569.753129:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+18:15836:x1875706583811328:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813569.753142:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813569.753153:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9087413a0200/0x6d74dbab2ddb2a46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb2a3f expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813569.753175:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9087413a0200/0x6d74dbab2ddb2a46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb2a3f expref: 19 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813569.753186:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9087413a0200/0x6d74dbab2ddb2a46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb2a3f expref: 19 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813569.753194:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9087413a0200, rc 0) 00000100:00100000:0.0:1788813569.753227:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:15836:x1875706583811328:12345-0@lo:101:mount.lustre.0 Request processed in 98us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813569.753243:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788813569.753289:0:15836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e925c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583811328:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788813569.753303:0:15836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff9087413a1600/0x6d74dbab2ddb2a3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2a46 expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813569.753312:0:15836:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff9087413a1600/0x6d74dbab2ddb2a3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb2a46 expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788813569.760154:0:15836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788813569.760755:0:15836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788813569.761051:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788813569.761096:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788813569.761128:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788813569.761170:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788813569.761204:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788813569.761250:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788813569.761287:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788813569.761338:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788813569.761385:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788813569.761420:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788813569.761453:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788813569.761503:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788813569.761541:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788813569.761572:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788813569.761660:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788813569.761699:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788813569.761731:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788813569.761789:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788813569.761824:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788813569.761853:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788813569.761909:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788813569.761946:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788813569.761975:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788813569.762046:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788813569.762080:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788813569.762110:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788813569.762167:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788813569.762205:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788813569.762238:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788813569.762284:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1788813569.762317:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1788813569.762349:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1788813569.762380:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1788813569.762426:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1788813569.766793:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1788813569.766938:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1788813569.766978:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1788813569.767091:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1788813569.767100:0:15836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788813569.767198:0:15836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583811456:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813569.767278:0:15836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813569.767325:0:15836:0:(client.c:2716:ptlrpc_set_wait()) set ffff908781f58b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788813569.767636:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583811456 00000100:00100000:2.0:1788813569.767644:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583811456 00000100:00100000:2.0:1788813569.767689:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788813569.767697:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:15836:x1875706583811456:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788813569.767931:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:15836:x1875706583811456:12345-0@lo:501:mount.lustre.0 Request processed in 234us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813569.767939:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788813569.773170:0:15836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583811456:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788813569.773230:0:15836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583811584:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788813569.773304:0:15836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813569.773340:0:15836:0:(client.c:2716:ptlrpc_set_wait()) set ffff908781f58b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788813569.778381:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583811584 00000100:00100000:0.0:1788813569.778395:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583811584 00000100:00100000:0.0:1788813569.778451:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788813569.778460:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:15836:x1875706583811584:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788813569.778711:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:15836:x1875706583811584:12345-0@lo:503:mount.lustre.0 Request processed in 251us (5406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813569.778719:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788813569.778989:0:15836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642915c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583811584:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788813569.779628:0:15836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788813569.779700:0:15836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e925c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583811712:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813569.779752:0:15836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813569.779787:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583811712 00000100:00100000:0.0:1788813569.779793:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583811712 00000100:00100000:0.0:1788813569.779824:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788813569.779833:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:15836:x1875706583811712:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813569.780012:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:15836:x1875706583811712:12345-0@lo:502:mount.lustre.0 Request processed in 180us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813569.780029:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788813569.780088:0:15836:0:(client.c:2716:ptlrpc_set_wait()) set ffff908781e33c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788813569.780105:0:15836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e925c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583811712:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788813569.782447:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788813569.782773:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788813569.782809:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788813569.783240:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788813569.783279:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788813569.783327:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788813569.783363:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788813569.784060:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788813569.784132:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788813569.784167:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788813569.784198:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788813569.784244:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788813569.784277:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788813569.784308:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788813569.790742:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788813569.790805:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788813569.790840:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788813569.790886:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788813569.790919:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788813569.790950:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788813569.791007:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788813569.791069:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788813569.791104:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788813569.791152:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788813569.791187:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788813569.791220:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788813569.791268:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788813569.791312:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788813569.791344:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788813569.791387:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788813569.791421:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788813569.791454:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788813569.791488:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788813569.791535:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788813569.791571:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788813569.791649:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788813569.791686:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788813569.791734:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788813569.791781:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788813569.791815:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788813569.791862:0:15836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e925c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583811840:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788813569.791942:0:15836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813569.791987:0:15836:0:(client.c:2716:ptlrpc_set_wait()) set ffff908781e33c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813569.792876:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583811840 00000100:00100000:2.0:1788813569.792886:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583811840 00000100:00100000:2.0:1788813569.792940:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788813569.792950:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:15836:x1875706583811840:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788813569.793207:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:15836:x1875706583811840:12345-0@lo:502:mount.lustre.0 Request processed in 258us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813569.793215:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788813569.794043:0:15836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e925c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583811840:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788813569.794165:0:15836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788813569.794180:0:15836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788813569.798420:0:15846:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788813569.798439:0:15846:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff90876f9c99c0) 00000020:00000080:0.0:1788813569.798472:0:15846:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1788813569.798550:0:15846:0:(tgt_mount.c:153:server_get_mount()) get mount ffff908766548800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788813569.798554:0:15846:0:(tgt_mount.c:187:server_put_mount()) put mount ffff908766548800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788813569.798557:0:15846:0:(obd_mount.c:710:lustre_put_lsi()) put ffff908766548800 3 00010000:00080000:0.0:1788813569.798880:0:15846:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9086435bc800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.147@tcp at head 00010000:00010000:1.0:1788813569.807378:0:15846:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1788813569.807653:0:15846:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788813569.807836:0:15846:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788813569.807850:0:15846:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x6d74dbab2ddb2a54 00000100:00080000:1.0:1788813569.807861:0:15846:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788813569.807872:0:15846:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9086435bc800 using connection 192.168.204.147@tcp/0@lo 00000100:00100000:1.0:1788813569.807912:0:15846:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff908642914700 x1875706583811968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788813569.807942:0:15846:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788813569.810022:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3317:1875706583811968:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788813569.810100:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788813569.810240:0:484:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813569.810250:0:484:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788813569.810253:0:484:0:(import.c:65:import_set_state_nolock()) ffff90876f9d7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788813569.810258:0:484:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 507 00000100:00080000:0.0:1788813569.810262:0:484:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788813569.810271:0:484:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90876f9d7800 using connection 192.168.204.147@tcp/0@lo 00000100:00100000:0.0:1788813569.810292:0:484:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90876e926680 x1875706583812224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788813569.810339:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583812096:0@lo:400:kworker.0 00000100:00100000:0.0:1788813569.810368:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813569.810417:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1875706583812224:0@lo:8:kworker.0 00000100:00100000:0.0:1788813569.810440:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813569.810466:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875706583812352:0@lo:400:kworker.0 00000100:00100000:0.0:1788813569.810489:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813569.810507:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788813569.810512:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583812480:0@lo:400:kworker.0 00000100:00100000:0.0:1788813569.810531:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813569.810561:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583812096 00000100:00100000:0.0:1788813569.810568:0:15650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583812096 00000100:00100000:0.0:1788813569.810635:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583812224 00000100:00100000:0.0:1788813569.810639:0:15650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583812224 00000100:00100000:0.0:1788813569.810656:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788813569.810665:0:15650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3321:x1875706583812096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813569.811759:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788813569.811769:0:15120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3317:x1875706583812224:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788813569.811851:0:15120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3317:x1875706583812224:12345-0@lo:8:kworker.0 Request processed in 82us (1410us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788813569.811858:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788813569.811901:0:3317:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788813569.811908:0:3317:0:(import.c:65:import_set_state_nolock()) ffff90876f9d7800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788813569.811912:0:3317:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788813569.811915:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1875706583812224:0@lo:8:kworker.0 00000100:00100000:0.0:1788813569.812967:0:15650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3321:x1875706583812096:12345-0@lo:400:kworker.0 Request processed in 2300us (2595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813569.812976:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788813569.813022:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583811968 00000100:00100000:0.0:1788813569.813040:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583811968 00000100:00100000:0.0:1788813569.813060:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583812352 00000100:00100000:0.0:1788813569.813063:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583812352 00000100:00100000:0.0:1788813569.813082:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583812480 00000100:00100000:0.0:1788813569.813085:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583812480 00000100:00100000:0.0:1788813569.813102:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788813569.813109:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875706583812352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813569.813147:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875706583812352:12345-0@lo:400:kworker.0 Request processed in 38us (2657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813569.813153:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788813569.813165:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788813569.813171:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583812480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813569.813212:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583812480:12345-0@lo:400:kworker.0 Request processed in 42us (2680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813569.813219:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788813569.813231:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788813569.813235:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3317:x1875706583811968:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788813569.813255:0:14432:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:0.0:1788813569.813290:0:14432:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x6d74dbab2ddb2a5b 00000004:00100000:0.0:1788813569.813304:0:14432:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788813569.813339:0:14432:0:(import.c:65:import_set_state_nolock()) ffff9086435be000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788813569.813376:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875706583811968:12345-0@lo:38:llog_process_th.0 Request processed in 139us (3277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813569.813383:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788813569.813401:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788813569.813405:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788813569.813440:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90876e924380 x1875706583812480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813569.813458:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583812480:0@lo:400:kworker.0 00010000:00080000:0.0:1788813569.813471:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90876e925880 x1875706583812352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788813569.813479:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875706583812352:0@lo:400:kworker.0 00000040:00080000:0.0:1788813569.813662:0:15846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:3.0:1788813569.813952:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583812096:0@lo:400:kworker.0 00010000:00080000:3.0:1788813569.813987:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff908642914700 x1875706583811968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788813579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788813569.814005:0:3317:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788813569.814012:0:3317:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788813569.814020:0:3317:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788813569.814024:0:3317:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788813569.814027:0:3317:0:(import.c:65:import_set_state_nolock()) ffff9086435bc800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788813569.814032:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3317:1875706583811968:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788813569.814211:0:15836:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788813569.814236:0:15836:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788813569.814261:0:15836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff9087413a1600/0x6d74dbab2ddb2a3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2a46 expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813569.814273:0:15836:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff9087413a1600/0x6d74dbab2ddb2a3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2a46 expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788813569.814325:0:15836:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788813569.814327:0:15836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788813569.814328:0:15836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813569.814330:0:15836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813569.814331:0:15836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813569.814333:0:15836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813569.814334:0:15836:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813569.814335:0:15836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813569.814337:0:15836:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788813569.814340:0:15836:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788813569.814342:0:15836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788813569.814343:0:15836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788813569.814344:0:15836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813569.814345:0:15836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813569.814346:0:15836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813569.814347:0:15836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813569.814348:0:15836:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813569.814349:0:15836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813569.814350:0:15836:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788813569.814370:0:15836:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788813569.814385:0:15836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583812608:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788813569.814432:0:15836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813569.814471:0:15836:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876e623180 going to sleep for 11 seconds 00000100:00100000:3.0:1788813569.814550:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583812608 00000100:00100000:3.0:1788813569.814557:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583812608 00000100:00100000:2.0:1788813569.815025:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788813569.815036:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:15836:x1875706583812608:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788813569.815072:0:14427:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788813569.815087:0:14427:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788813569.860211:0:14427:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788813569.860233:0:14427:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788813569.860370:0:14450:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788813569.860376:0:14450:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788813569.860474:0:14450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb2a62 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813569.860496:0:14450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff908774369400/0x6d74dbab2ddb2935 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb292e expref: 19 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813569.860505:0:14450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb2a62 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813569.860553:0:14450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff908774369400/0x6d74dbab2ddb2935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb292e expref: 19 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813569.860567:0:14450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff908774369400/0x6d74dbab2ddb2935 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb292e expref: 19 pid: 14426 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813569.860621:0:14450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e925880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14450:1875706583812736:0@lo:104: 00000100:00100000:0.0:1788813569.860689:0:14450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813569.860736:0:14450:0:(client.c:2716:ptlrpc_set_wait()) set ffff908781e33600 going to sleep for 11 seconds 00000100:00100000:3.0:1788813569.860773:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583812736 00000100:00100000:3.0:1788813569.860782:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583812736 00000100:00100000:3.0:1788813569.860824:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788813569.860833:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e924380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+3:14450:x1875706583812736:12345-0@lo:104: 00010000:00010000:3.0:1788813569.860861:0:14417:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff908749d72000/0x6d74dbab2ddb292e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb2935 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813569.860922:0:14417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788813569.860928:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e924380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+3:14450:x1875706583812736:12345-0@lo:104: Request processed in 97us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813569.860935:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788813569.861118:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813569.861125:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908749d72000/0x6d74dbab2ddb292e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb2935 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813569.861143:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d72000 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:0.0:1788813569.861147:0:14423:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908749d72000/0x6d74dbab2ddb292e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb2935 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813569.861155:0:14423:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908749d72000/0x6d74dbab2ddb292e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb2935 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788813569.861163:0:14423:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908749d72000/0x6d74dbab2ddb292e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb2935 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788813569.861168:0:14423:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788813569.861205:0:14423:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff908749d72000/0x6d74dbab2ddb292e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb2935 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813569.861212:0:14423:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788813569.861233:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908749d72000/0x6d74dbab2ddb292e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb2935 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813569.861239:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908749d72000/0x6d74dbab2ddb292e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb2935 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813569.861369:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813569.861371:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813569.861373:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813569.861387:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3320:1875706583812864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788813569.861492:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813569.861553:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583812864 00000100:00100000:3.0:1788813569.861559:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583812864 00010000:00010000:3.0:1788813569.861595:0:14421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff908774369400/0x6d74dbab2ddb2935 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb292e expref: 20 pid: 14426 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813569.861633:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788813569.861641:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e927800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+20:3320:x1875706583812864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788813569.861651:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813569.861656:0:14421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff908774369400/0x6d74dbab2ddb2935 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb292e expref: 20 pid: 14426 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813569.861678:0:14421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff908774369400/0x6d74dbab2ddb2935 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb292e expref: 20 pid: 14426 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813569.861694:0:14421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb2a62 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813569.861702:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb2a62 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788813569.861716:0:14421:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001790799s 00010000:00010000:3.0:1788813569.861721:0:14421:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb2a62 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813569.861739:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb2a62 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813569.861745:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb2a62 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813569.861752:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb2a62 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813569.861757:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a0400 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:3.0:1788813569.861761:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb2a62 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813569.861767:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb2a62 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813569.861776:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb2a62 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813569.861785:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813569.861827:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e927800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+20:3320:x1875706583812864:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813569.861834:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788813569.861867:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3320:1875706583812864:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813569.862044:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908774369400/0x6d74dbab2ddb2935 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb292e expref: 19 pid: 14426 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813569.862054:0:14450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e925880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14450:1875706583812736:0@lo:104: 00010000:00010000:1.0:1788813569.862067:0:14450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb2a62 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813569.862075:0:14450:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb2a62 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813569.862081:0:14450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb2a62 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813569.862087:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9087413a0400/0x6d74dbab2ddb2a62 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813569.875734:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+18:15836:x1875706583812608:12345-0@lo:253:mount.lustre.0 Request processed in 60692us (61292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813569.875763:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788813569.875911:0:15836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb70700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7dbbe9e7-bc92-4769-ab24-5734c43403ec:15836:1875706583812608:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788813569.875927:0:15836:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788813569.875929:0:15836:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788813569.875931:0:15836:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788813569.875932:0:15836:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788813569.875940:0:15836:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788813569.875941:0:15836:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788813569.875942:0:15836:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788813569.875944:0:15836:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788813569.875946:0:15836:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788813569.875947:0:15836:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788813569.875962:0:15836:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788813569.884948:0:15836:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788813569.885137:0:15836:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788813569.885491:0:15836:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788813569.885820:0:15836:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788813569.886314:0:15836:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788813569.887850:0:15836:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788813569.890974:0:15836:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788813569.964709:0:15836:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788813569.964719:0:15836:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788813569.964752:0:15836:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788813569.964813:0:15836:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.147@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788813569.964829:0:15836:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788813569.964857:0:15836:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788813570.301960:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813570.754275:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813570.754299:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583812992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813570.754364:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813570.754437:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583812992 00000100:00100000:2.0:1788813570.754444:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583812992 00000100:00100000:2.0:1788813570.754506:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813570.754515:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1875706583812992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813570.754552:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813570.754621:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1875706583812992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813570.754628:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788813570.754743:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583812992:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788813570.851104:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1788813570.851176:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 10000000:01000000:3.0:1788813571.006185:0:14431:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788813571.006192:0:14431:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90874923c800 from 8 10000000:01000000:3.0:1788813571.006197:0:14431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788813571.006245:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff908773c95c00/0x6d74dbab2ddb2a69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813571.006256:0:14431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff908773c95c00/0x6d74dbab2ddb2a69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813571.006283:0:14431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff908773c95c00/0x6d74dbab2ddb2a69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813571.006310:0:14431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e450a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583813120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788813571.006381:0:14431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813571.006456:0:14431:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c1c9600 going to sleep for 11 seconds 00000100:00100000:1.0:1788813571.007639:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583813120 00000100:00100000:1.0:1788813571.007662:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583813120 00000100:00100000:1.0:1788813571.007732:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788813571.007743:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+18:14431:x1875706583813120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788813571.007768:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813571.007786:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90874148d000/0x6d74dbab2ddb2a70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb2a69 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813571.007813:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90874148d000/0x6d74dbab2ddb2a70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb2a69 expref: 19 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813571.007824:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90874148d000/0x6d74dbab2ddb2a70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb2a69 expref: 19 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813571.007833:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148d000, rc 0) 00000100:00100000:1.0:1788813571.007906:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:14431:x1875706583813120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (1526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813571.007913:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788813571.008907:0:14431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e450a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583813120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788813571.008930:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff908773c95c00/0x6d74dbab2ddb2a69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2a70 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813571.008940:0:14431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff908773c95c00/0x6d74dbab2ddb2a69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb2a70 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813571.009021:0:14431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e450a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583813248:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788813571.009067:0:14431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813571.009109:0:14431:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c1c9600 going to sleep for 11 seconds 00000100:00100000:0.0:1788813571.009174:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583813248 00000100:00100000:0.0:1788813571.009179:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583813248 00000100:00100000:0.0:1788813571.009219:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788813571.009227:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:14431:x1875706583813248:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788813571.009244:0:14427:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788813571.009262:0:14427:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788813571.009265:0:14427:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788813571.009348:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:14431:x1875706583813248:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813571.009355:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788813571.009433:0:14431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e450a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583813248:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788813571.010088:0:14431:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788813571.010097:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff908773c95c00/0x6d74dbab2ddb2a69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2a70 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813571.010107:0:14431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff908773c95c00/0x6d74dbab2ddb2a69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2a70 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813571.329870:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813572.348841:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788813572.733258:0:14468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788813573.372892:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813574.398764:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788813574.844817:0:484:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788813574.844824:0:484:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788813574.844828:0:484:0:(import.c:65:import_set_state_nolock()) ffff90876f9d7800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788813574.844845:0:484:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90876f9d7800 using connection 192.168.204.147@tcp/0@lo 00000100:00100000:0.0:1788813574.844871:0:484:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90876e925880 x1875706583813632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788813574.844948:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583813760:0@lo:400:kworker.0 00000100:00100000:0.0:1788813574.845013:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813574.845066:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788813574.845072:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583813888:0@lo:400:kworker.0 00000100:00100000:0.0:1788813574.845094:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813574.845125:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583813760 00000100:00100000:0.0:1788813574.845134:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583813760 00000100:00100000:0.0:1788813574.845174:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583813888 00000100:00100000:0.0:1788813574.845177:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583813888 00000100:00100000:0.0:1788813574.845204:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788813574.845212:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583813760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813574.845266:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583813760:12345-0@lo:400:kworker.0 Request processed in 53us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813574.845274:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788813574.845290:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788813574.845297:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583813888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813574.845409:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e924700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583813504:0@lo:400:kworker.0 00000100:00100000:1.0:1788813574.845472:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3318:1875706583813376:0@lo:400:kworker.0 00000100:00100000:2.0:1788813574.847722:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1875706583813632:0@lo:8:kworker.0 00000100:00100000:3.0:1788813574.855070:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813574.871133:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813574.871199:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875706583814016:0@lo:400:kworker.0 00000100:00100000:1.0:1788813574.871243:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813574.871293:0:14435:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788813574.871302:0:14435:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788813574.871340:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583813504 00000100:00100000:1.0:1788813574.871348:0:15119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583813504 00000100:00100000:1.0:1788813574.871407:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813574.871421:0:15119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583813504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813574.871486:0:15119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583813504:12345-0@lo:400:kworker.0 Request processed in 69us (16426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813574.871494:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813574.871534:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583813376 00000100:00100000:1.0:1788813574.871538:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583813376 00000100:00100000:1.0:1788813574.871563:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788813574.871569:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:3318:x1875706583813376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813574.871627:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:3318:x1875706583813376:12345-0@lo:400:kworker.0 Request processed in 59us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813574.871633:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788813574.871803:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788813574.871822:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e924700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583813504:0@lo:400:kworker.0 00000100:00100000:1.0:1788813574.871850:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3318:1875706583813376:0@lo:400:kworker.0 00000100:00100000:0.0:1788813574.873226:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583813888:12345-0@lo:400:kworker.0 Request processed in 27921us (28122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813574.873253:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788813574.873292:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583814016 00000100:00100000:0.0:1788813574.873300:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583814016 00000100:00100000:0.0:1788813574.873351:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788813574.873359:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875706583814016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813574.873423:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875706583814016:12345-0@lo:400:kworker.0 Request processed in 65us (2179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813574.873429:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788813574.873447:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788813574.873452:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788813574.873791:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e927480 x1875706583814016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813574.873813:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875706583814016:0@lo:400:kworker.0 00000100:00100000:2.0:1788813574.875529:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813574.875610:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583813632 00000100:00100000:2.0:1788813574.875619:0:15650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583813632 00000100:00100000:2.0:1788813574.875657:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788813574.875665:0:15650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3317:x1875706583813632:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788813574.875697:0:15650:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 517 last 0 00000020:00000080:2.0:1788813574.875734:0:15650:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d74dbab2ddb2a77 00002000:00100000:2.0:1788813574.875748:0:15650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff908766547800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788813574.875767:0:15650:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788813574.875770:0:15650:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788813574.876156:0:15650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788813574.876182:0:15650:0:(import.c:65:import_set_state_nolock()) ffff908766546000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788813574.876235:0:15650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3317:x1875706583813632:12345-0@lo:8:kworker.0 Request processed in 570us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813574.876243:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788813574.876303:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e925880 x1875706583813632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788813599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788813574.878632:0:3317:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788813574.878650:0:3317:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788813574.878657:0:3317:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788813574.878661:0:3317:0:(import.c:65:import_set_state_nolock()) ffff90876f9d7800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788813574.878685:0:3317:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788813574.878695:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e925880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3317:1875706583813632:0@lo:8:kworker.0 00000004:00080000:2.0:1788813574.878791:0:14459:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1788813574.878810:0:14459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb73b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14459:1875706583814272:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788813574.878873:0:14459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813574.878916:0:14459:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876e623840 going to sleep for 11 seconds 00000004:00080000:2.0:1788813574.878933:0:14458:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788813574.881565:0:14458:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 517123981950ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788813574.881789:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583814144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813574.881869:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813574.881940:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583814144 00000100:00100000:1.0:1788813574.881949:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583814144 00000100:00100000:1.0:1788813574.882002:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788813574.882012:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875706583814144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788813574.882051:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813574.882102:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642915c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875706583814144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813574.882109:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788813574.882129:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788813574.882158:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876eb72300 x1875706583814144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788813590 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813574.882189:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583814144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813574.885502:0:15649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583814272 00000100:00100000:0.0:1788813574.885516:0:15649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583814272 00000100:00100000:0.0:1788813574.885565:0:15649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788813574.885575:0:15649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14459:x1875706583814272:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788813574.888130:0:15649:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788813574.888141:0:15649:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788813574.888147:0:15649:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00010000:00080000:1.0:1788813574.893861:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e926680 x1875706583813888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813574.893882:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e926680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583813888:0@lo:400:kworker.0 00010000:00080000:1.0:1788813574.893908:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90876e925180 x1875706583813760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788813590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788813574.893918:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583813760:0@lo:400:kworker.0 00002000:00010000:0.0:1788813574.917788:0:15649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813574.917801:0:15649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050ea6a4a/0x6d74dbab2ddb2a7e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.917820:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788813574.917824:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813574.917831:0:15649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050ea6a4a/0x6d74dbab2ddb2a7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.917851:0:15649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050ea6a4a/0x6d74dbab2ddb2a7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.917871:0:15649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050ea6a4a/0x6d74dbab2ddb2a7e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.917878:0:15649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050ea6a4a/0x6d74dbab2ddb2a7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.917907:0:15649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788813574.918350:0:15649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813574.918356:0:15649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc3b4b05/0x6d74dbab2ddb2a85 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.918365:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788813574.918369:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813574.918373:0:15649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc3b4b05/0x6d74dbab2ddb2a85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.918382:0:15649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc3b4b05/0x6d74dbab2ddb2a85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.918391:0:15649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc3b4b05/0x6d74dbab2ddb2a85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.918399:0:15649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc3b4b05/0x6d74dbab2ddb2a85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.918424:0:15649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788813574.918838:0:15649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813574.918844:0:15649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002020f8bf/0x6d74dbab2ddb2a8c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.918853:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788813574.918856:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813574.918860:0:15649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002020f8bf/0x6d74dbab2ddb2a8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.918869:0:15649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002020f8bf/0x6d74dbab2ddb2a8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.918876:0:15649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002020f8bf/0x6d74dbab2ddb2a8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.918884:0:15649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002020f8bf/0x6d74dbab2ddb2a8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.918903:0:15649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788813574.919269:0:15649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813574.919275:0:15649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e65866/0x6d74dbab2ddb2a93 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.919282:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788813574.919291:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813574.919295:0:15649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029e65866/0x6d74dbab2ddb2a93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.919304:0:15649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029e65866/0x6d74dbab2ddb2a93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.919312:0:15649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e65866/0x6d74dbab2ddb2a93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.919320:0:15649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029e65866/0x6d74dbab2ddb2a93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.919327:0:15649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788813574.919738:0:15649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813574.919744:0:15649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000082f1fd7/0x6d74dbab2ddb2a9a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.919753:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788813574.919756:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813574.919760:0:15649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000082f1fd7/0x6d74dbab2ddb2a9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.919769:0:15649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000082f1fd7/0x6d74dbab2ddb2a9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.919778:0:15649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000082f1fd7/0x6d74dbab2ddb2a9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.919792:0:15649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000082f1fd7/0x6d74dbab2ddb2a9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.919799:0:15649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788813574.928018:0:15649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813574.928031:0:15649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006db76c5b/0x6d74dbab2ddb2aa1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.928047:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788813574.928052:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813574.928058:0:15649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006db76c5b/0x6d74dbab2ddb2aa1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.928073:0:15649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006db76c5b/0x6d74dbab2ddb2aa1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.928083:0:15649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006db76c5b/0x6d74dbab2ddb2aa1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.928091:0:15649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006db76c5b/0x6d74dbab2ddb2aa1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.928101:0:15649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1788813574.928416:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788813574.928426:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050ea6a4a/0x6d74dbab2ddb2a7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928435:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a1c00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813574.928440:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050ea6a4a/0x6d74dbab2ddb2a7e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928450:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050ea6a4a/0x6d74dbab2ddb2a7e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928473:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050ea6a4a/0x6d74dbab2ddb2a7e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928480:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050ea6a4a/0x6d74dbab2ddb2a7e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928516:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788813574.928520:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc3b4b05/0x6d74dbab2ddb2a85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928526:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a0800 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813574.928530:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc3b4b05/0x6d74dbab2ddb2a85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928538:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc3b4b05/0x6d74dbab2ddb2a85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928548:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc3b4b05/0x6d74dbab2ddb2a85 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928554:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc3b4b05/0x6d74dbab2ddb2a85 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928569:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788813574.928572:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002020f8bf/0x6d74dbab2ddb2a8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928592:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9087413a0400 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813574.928596:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002020f8bf/0x6d74dbab2ddb2a8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928614:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002020f8bf/0x6d74dbab2ddb2a8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928624:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002020f8bf/0x6d74dbab2ddb2a8c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928630:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002020f8bf/0x6d74dbab2ddb2a8c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928644:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788813574.928648:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029e65866/0x6d74dbab2ddb2a93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928653:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740030c00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813574.928655:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e65866/0x6d74dbab2ddb2a93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928662:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e65866/0x6d74dbab2ddb2a93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928669:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029e65866/0x6d74dbab2ddb2a93 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928676:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029e65866/0x6d74dbab2ddb2a93 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928697:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813574.928701:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000082f1fd7/0x6d74dbab2ddb2a9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928707:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031600 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813574.928709:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000082f1fd7/0x6d74dbab2ddb2a9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928716:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000082f1fd7/0x6d74dbab2ddb2a9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928726:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000082f1fd7/0x6d74dbab2ddb2a9a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928733:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000082f1fd7/0x6d74dbab2ddb2a9a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928744:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813574.928746:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006db76c5b/0x6d74dbab2ddb2aa1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928752:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740030a00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813574.928755:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006db76c5b/0x6d74dbab2ddb2aa1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928775:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006db76c5b/0x6d74dbab2ddb2aa1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928784:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006db76c5b/0x6d74dbab2ddb2aa1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928791:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006db76c5b/0x6d74dbab2ddb2aa1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.928803:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813574.928804:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813574.928806:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813574.935914:0:15649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813574.935932:0:15649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000efcdb01/0x6d74dbab2ddb2aa8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.935960:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788813574.935965:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813574.935973:0:15649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000efcdb01/0x6d74dbab2ddb2aa8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.935990:0:15649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000efcdb01/0x6d74dbab2ddb2aa8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.936002:0:15649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000efcdb01/0x6d74dbab2ddb2aa8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.936010:0:15649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000efcdb01/0x6d74dbab2ddb2aa8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.936032:0:15649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788813574.940436:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788813574.940453:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000efcdb01/0x6d74dbab2ddb2aa8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813574.940469:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740030e00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:2.0:1788813574.940489:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000efcdb01/0x6d74dbab2ddb2aa8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813574.940502:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000efcdb01/0x6d74dbab2ddb2aa8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813574.940528:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000efcdb01/0x6d74dbab2ddb2aa8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813574.940536:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000efcdb01/0x6d74dbab2ddb2aa8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813574.940568:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813574.940570:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813574.940571:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813574.940592:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813574.941184:0:15649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813574.944312:0:15649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bed008c/0x6d74dbab2ddb2aaf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.944342:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788813574.944348:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813574.944355:0:15649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bed008c/0x6d74dbab2ddb2aaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.944371:0:15649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bed008c/0x6d74dbab2ddb2aaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.944399:0:15649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bed008c/0x6d74dbab2ddb2aaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.946432:0:15649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bed008c/0x6d74dbab2ddb2aaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.946465:0:15649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788813574.947135:0:15649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813574.947144:0:15649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb2ab6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.947156:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788813574.947161:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813574.947167:0:15649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb2ab6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.947182:0:15649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb2ab6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813574.947506:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813574.947515:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bed008c/0x6d74dbab2ddb2aaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813574.947524:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031200 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:3.0:1788813574.947530:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bed008c/0x6d74dbab2ddb2aaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813574.947542:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bed008c/0x6d74dbab2ddb2aaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813574.947564:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bed008c/0x6d74dbab2ddb2aaf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813574.947571:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bed008c/0x6d74dbab2ddb2aaf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813574.947619:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813574.947621:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813574.947623:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813574.949308:0:15649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb2ab6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.949330:0:15649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb2ab6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.949367:0:15649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813574.949384:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813574.949390:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb2ab6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.949398:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031000 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813574.949404:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb2ab6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.949412:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb2ab6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.949433:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb2ab6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.949440:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb2ab6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.949465:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813574.949467:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813574.949469:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813574.950069:0:15649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813574.950078:0:15649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b6db7e9/0x6d74dbab2ddb2abd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.950091:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788813574.950101:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813574.950108:0:15649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b6db7e9/0x6d74dbab2ddb2abd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.950136:0:15649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b6db7e9/0x6d74dbab2ddb2abd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.950145:0:15649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b6db7e9/0x6d74dbab2ddb2abd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.950152:0:15649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b6db7e9/0x6d74dbab2ddb2abd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.950171:0:15649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813574.950183:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813574.954708:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b6db7e9/0x6d74dbab2ddb2abd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.954734:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031e00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813574.954740:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b6db7e9/0x6d74dbab2ddb2abd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.954752:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b6db7e9/0x6d74dbab2ddb2abd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.954777:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b6db7e9/0x6d74dbab2ddb2abd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.954798:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b6db7e9/0x6d74dbab2ddb2abd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.954830:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813574.954832:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813574.954835:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813574.965353:0:15649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813574.965368:0:15649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb2ac4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.965386:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788813574.965391:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813574.965398:0:15649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb2ac4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.965412:0:15649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb2ac4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.965423:0:15649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb2ac4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.965432:0:15649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb2ac4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.965460:0:15649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788813574.966086:0:15649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813574.966100:0:15649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001be0a066/0x6d74dbab2ddb2acb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.966121:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788813574.966126:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813574.966131:0:15649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001be0a066/0x6d74dbab2ddb2acb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.966142:0:15649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001be0a066/0x6d74dbab2ddb2acb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.966150:0:15649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001be0a066/0x6d74dbab2ddb2acb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.966157:0:15649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001be0a066/0x6d74dbab2ddb2acb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.966179:0:15649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788813574.966198:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788813574.966203:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb2ac4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.966210:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908740031000 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813574.966215:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb2ac4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.966224:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb2ac4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.966249:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb2ac4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.966257:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d9f6efa/0x6d74dbab2ddb2ac4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.966278:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813574.966281:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001be0a066/0x6d74dbab2ddb2acb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.966287:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874149ca00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813574.966290:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001be0a066/0x6d74dbab2ddb2acb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.966297:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001be0a066/0x6d74dbab2ddb2acb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.966307:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001be0a066/0x6d74dbab2ddb2acb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.966314:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001be0a066/0x6d74dbab2ddb2acb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.966326:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813574.966328:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813574.966335:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813574.966831:0:15649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813574.966839:0:15649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094bb924f/0x6d74dbab2ddb2ad2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.966848:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788813574.966852:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813574.966856:0:15649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094bb924f/0x6d74dbab2ddb2ad2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.966866:0:15649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094bb924f/0x6d74dbab2ddb2ad2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.966874:0:15649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094bb924f/0x6d74dbab2ddb2ad2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.966882:0:15649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094bb924f/0x6d74dbab2ddb2ad2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.966909:0:15649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813574.966919:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813574.966922:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094bb924f/0x6d74dbab2ddb2ad2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.966930:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874149c000 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813574.966933:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094bb924f/0x6d74dbab2ddb2ad2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.966952:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094bb924f/0x6d74dbab2ddb2ad2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.966963:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094bb924f/0x6d74dbab2ddb2ad2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.966970:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094bb924f/0x6d74dbab2ddb2ad2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.966984:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813574.966985:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813574.966987:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813574.967350:0:15649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813574.967356:0:15649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac304c5f/0x6d74dbab2ddb2ad9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.967363:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788813574.967366:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813574.967371:0:15649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac304c5f/0x6d74dbab2ddb2ad9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.967381:0:15649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac304c5f/0x6d74dbab2ddb2ad9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.967388:0:15649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac304c5f/0x6d74dbab2ddb2ad9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.967403:0:15649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac304c5f/0x6d74dbab2ddb2ad9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.967418:0:15649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813574.967428:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813574.967431:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac304c5f/0x6d74dbab2ddb2ad9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.967437:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874149d200 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813574.967440:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac304c5f/0x6d74dbab2ddb2ad9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.967447:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac304c5f/0x6d74dbab2ddb2ad9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.967459:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac304c5f/0x6d74dbab2ddb2ad9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.967467:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac304c5f/0x6d74dbab2ddb2ad9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.967483:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813574.967485:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813574.967486:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813574.967903:0:15649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813574.967918:0:15649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca7ed4c5/0x6d74dbab2ddb2ae0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.967926:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788813574.967929:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813574.967933:0:15649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca7ed4c5/0x6d74dbab2ddb2ae0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.967942:0:15649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca7ed4c5/0x6d74dbab2ddb2ae0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.967950:0:15649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca7ed4c5/0x6d74dbab2ddb2ae0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.967957:0:15649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca7ed4c5/0x6d74dbab2ddb2ae0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.967971:0:15649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813574.967979:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813574.967982:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca7ed4c5/0x6d74dbab2ddb2ae0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.967990:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874149cc00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813574.967993:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca7ed4c5/0x6d74dbab2ddb2ae0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.968000:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca7ed4c5/0x6d74dbab2ddb2ae0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.968017:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca7ed4c5/0x6d74dbab2ddb2ae0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.968024:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca7ed4c5/0x6d74dbab2ddb2ae0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.968038:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813574.968040:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813574.968041:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813574.970919:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813574.978794:0:15649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813574.978808:0:15649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cda84d02/0x6d74dbab2ddb2ae7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.978826:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788813574.978831:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813574.978838:0:15649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cda84d02/0x6d74dbab2ddb2ae7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.978852:0:15649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cda84d02/0x6d74dbab2ddb2ae7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.978863:0:15649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cda84d02/0x6d74dbab2ddb2ae7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.978870:0:15649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cda84d02/0x6d74dbab2ddb2ae7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.978917:0:15649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813574.978933:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813574.978939:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cda84d02/0x6d74dbab2ddb2ae7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.978952:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874149da00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813574.978956:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cda84d02/0x6d74dbab2ddb2ae7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.978966:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cda84d02/0x6d74dbab2ddb2ae7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.978983:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cda84d02/0x6d74dbab2ddb2ae7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.978990:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cda84d02/0x6d74dbab2ddb2ae7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.979011:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813574.979013:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813574.979014:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813574.980796:0:15649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813574.980806:0:15649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a3bdd6b/0x6d74dbab2ddb2aee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.980822:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788813574.980832:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813574.980839:0:15649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a3bdd6b/0x6d74dbab2ddb2aee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.980852:0:15649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a3bdd6b/0x6d74dbab2ddb2aee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.980863:0:15649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a3bdd6b/0x6d74dbab2ddb2aee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.980870:0:15649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a3bdd6b/0x6d74dbab2ddb2aee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.980904:0:15649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788813574.981432:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788813574.981440:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a3bdd6b/0x6d74dbab2ddb2aee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813574.981448:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874149d000 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:3.0:1788813574.981453:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a3bdd6b/0x6d74dbab2ddb2aee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813574.981468:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a3bdd6b/0x6d74dbab2ddb2aee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813574.981486:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a3bdd6b/0x6d74dbab2ddb2aee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813574.981494:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a3bdd6b/0x6d74dbab2ddb2aee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813574.981514:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813574.981516:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788813574.981517:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813574.987083:0:15649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813574.987103:0:15649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbb382b5/0x6d74dbab2ddb2af5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.987323:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788813574.987328:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813574.987335:0:15649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbb382b5/0x6d74dbab2ddb2af5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.987353:0:15649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbb382b5/0x6d74dbab2ddb2af5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.987364:0:15649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbb382b5/0x6d74dbab2ddb2af5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.987378:0:15649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbb382b5/0x6d74dbab2ddb2af5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.987405:0:15649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813574.987728:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813574.987736:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbb382b5/0x6d74dbab2ddb2af5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.987745:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9086425dea00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813574.987750:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbb382b5/0x6d74dbab2ddb2af5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.987760:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbb382b5/0x6d74dbab2ddb2af5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.987778:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbb382b5/0x6d74dbab2ddb2af5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.987799:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbb382b5/0x6d74dbab2ddb2af5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.987824:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813574.987826:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813574.987828:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813574.988298:0:15649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813574.988305:0:15649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007462e211/0x6d74dbab2ddb2afc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.988317:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788813574.988321:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813574.988326:0:15649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007462e211/0x6d74dbab2ddb2afc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.988337:0:15649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007462e211/0x6d74dbab2ddb2afc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.988345:0:15649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007462e211/0x6d74dbab2ddb2afc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.988352:0:15649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007462e211/0x6d74dbab2ddb2afc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.988369:0:15649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788813574.988820:0:15649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813574.988826:0:15649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4159efa/0x6d74dbab2ddb2b03 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.988840:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788813574.988843:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813574.988847:0:15649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4159efa/0x6d74dbab2ddb2b03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.988857:0:15649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4159efa/0x6d74dbab2ddb2b03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.988865:0:15649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4159efa/0x6d74dbab2ddb2b03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.988873:0:15649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4159efa/0x6d74dbab2ddb2b03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.988887:0:15649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788813574.988913:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788813574.988917:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007462e211/0x6d74dbab2ddb2afc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.988924:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9086425de000 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813574.988928:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007462e211/0x6d74dbab2ddb2afc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.988936:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007462e211/0x6d74dbab2ddb2afc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.988961:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007462e211/0x6d74dbab2ddb2afc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.988969:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007462e211/0x6d74dbab2ddb2afc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.988986:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813574.988988:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4159efa/0x6d74dbab2ddb2b03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.988993:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9086425df000 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813574.988996:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4159efa/0x6d74dbab2ddb2b03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.989003:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4159efa/0x6d74dbab2ddb2b03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.989011:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4159efa/0x6d74dbab2ddb2b03 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.989018:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4159efa/0x6d74dbab2ddb2b03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.989029:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813574.989031:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813574.989038:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813574.989443:0:15649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813574.989450:0:15649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a2e7305/0x6d74dbab2ddb2b0a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.989458:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788813574.989462:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813574.989466:0:15649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a2e7305/0x6d74dbab2ddb2b0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.989474:0:15649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a2e7305/0x6d74dbab2ddb2b0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.989482:0:15649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a2e7305/0x6d74dbab2ddb2b0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.989490:0:15649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a2e7305/0x6d74dbab2ddb2b0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.989505:0:15649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813574.989514:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813574.989517:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a2e7305/0x6d74dbab2ddb2b0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.989523:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9086425dfc00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813574.989526:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a2e7305/0x6d74dbab2ddb2b0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.989543:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a2e7305/0x6d74dbab2ddb2b0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.989554:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a2e7305/0x6d74dbab2ddb2b0a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.989562:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a2e7305/0x6d74dbab2ddb2b0a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.989576:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813574.989608:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813574.989610:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813574.990083:0:15649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813574.990088:0:15649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008102f8a6/0x6d74dbab2ddb2b11 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.990097:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788813574.990100:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813574.990104:0:15649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008102f8a6/0x6d74dbab2ddb2b11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.990112:0:15649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008102f8a6/0x6d74dbab2ddb2b11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.990120:0:15649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008102f8a6/0x6d74dbab2ddb2b11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.990137:0:15649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008102f8a6/0x6d74dbab2ddb2b11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.990151:0:15649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813574.990161:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813574.990165:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008102f8a6/0x6d74dbab2ddb2b11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.990172:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9086425de400 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813574.990175:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008102f8a6/0x6d74dbab2ddb2b11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.990182:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008102f8a6/0x6d74dbab2ddb2b11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.990193:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008102f8a6/0x6d74dbab2ddb2b11 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.990201:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008102f8a6/0x6d74dbab2ddb2b11 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.990217:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813574.990219:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813574.990220:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788813574.990713:0:15649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788813574.990727:0:15649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000347c2f15/0x6d74dbab2ddb2b18 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.990736:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=517s v=(0 0) 00010000:00010000:0.0:1788813574.990739:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813574.990743:0:15649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000347c2f15/0x6d74dbab2ddb2b18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.990752:0:15649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000347c2f15/0x6d74dbab2ddb2b18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.990763:0:15649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000347c2f15/0x6d74dbab2ddb2b18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.990768:0:15649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000347c2f15/0x6d74dbab2ddb2b18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.990783:0:15649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788813574.990792:0:14423:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788813574.990795:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000347c2f15/0x6d74dbab2ddb2b18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.990801:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9086425de800 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813574.991104:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788813574.992152:0:15649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788813574.992160:0:15649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039844321/0x6d74dbab2ddb2b1f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.992172:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=517s v=(0 0) 00010000:00010000:1.0:1788813574.992177:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813574.992182:0:15649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039844321/0x6d74dbab2ddb2b1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.992195:0:15649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039844321/0x6d74dbab2ddb2b1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.992204:0:15649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039844321/0x6d74dbab2ddb2b1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.992211:0:15649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039844321/0x6d74dbab2ddb2b1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.992230:0:15649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788813574.992249:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1788813574.992750:0:15649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788813574.992757:0:15649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e2f7e9e/0x6d74dbab2ddb2b26 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.992766:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=517s v=(0 0) 00010000:00010000:1.0:1788813574.992770:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813574.992774:0:15649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e2f7e9e/0x6d74dbab2ddb2b26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.992783:0:15649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e2f7e9e/0x6d74dbab2ddb2b26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.992791:0:15649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e2f7e9e/0x6d74dbab2ddb2b26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.992799:0:15649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e2f7e9e/0x6d74dbab2ddb2b26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.992807:0:15649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788813574.993202:0:15649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788813574.993209:0:15649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b30d52d/0x6d74dbab2ddb2b2d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.993218:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=517s v=(0 0) 00010000:00010000:1.0:1788813574.993221:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813574.993225:0:15649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b30d52d/0x6d74dbab2ddb2b2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.993247:0:15649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b30d52d/0x6d74dbab2ddb2b2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.993256:0:15649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b30d52d/0x6d74dbab2ddb2b2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.993263:0:15649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b30d52d/0x6d74dbab2ddb2b2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.993271:0:15649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788813574.993669:0:15649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788813574.993675:0:15649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078a86493/0x6d74dbab2ddb2b34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.993683:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=517s v=(0 0) 00010000:00010000:1.0:1788813574.993686:0:15649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813574.993690:0:15649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078a86493/0x6d74dbab2ddb2b34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.993698:0:15649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078a86493/0x6d74dbab2ddb2b34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.993706:0:15649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078a86493/0x6d74dbab2ddb2b34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.993722:0:15649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078a86493/0x6d74dbab2ddb2b34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.993730:0:15649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:1.0:1788813574.993921:0:15649:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:1.0:1788813574.994029:0:15649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14459:x1875706583814272:12345-0@lo:5:osp-pre-1-0.0 Request processed in 108453us (115152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813574.994038:0:15649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788813574.994822:0:14459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb73b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14459:1875706583814272:0@lo:5:osp-pre-1-0.0 00010000:00010000:1.0:1788813574.994840:0:16096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000004:00080000:3.0:1788813574.994841:0:14459:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00010000:00010000:1.0:1788813574.994850:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039844321/0x6d74dbab2ddb2b1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.994860:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148d200 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813574.994863:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039844321/0x6d74dbab2ddb2b1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.994873:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039844321/0x6d74dbab2ddb2b1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813574.994887:0:14459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e450380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14459:1875706583814400:0@lo:5:osp-pre-1-0.0 00010000:00010000:1.0:1788813574.994901:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039844321/0x6d74dbab2ddb2b1f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.994908:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039844321/0x6d74dbab2ddb2b1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.994945:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1788813574.994946:0:14459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788813574.994949:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b30d52d/0x6d74dbab2ddb2b2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.994955:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148d800 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813574.994958:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b30d52d/0x6d74dbab2ddb2b2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.994966:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b30d52d/0x6d74dbab2ddb2b2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.994976:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b30d52d/0x6d74dbab2ddb2b2d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.994983:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b30d52d/0x6d74dbab2ddb2b2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813574.994991:0:14459:0:(client.c:2716:ptlrpc_set_wait()) set ffff908761e85840 going to sleep for 11 seconds 00010000:00010000:1.0:1788813574.994995:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813574.994999:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078a86493/0x6d74dbab2ddb2b34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.995004:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148c400 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813574.995007:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a86493/0x6d74dbab2ddb2b34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.995027:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078a86493/0x6d74dbab2ddb2b34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.995038:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078a86493/0x6d74dbab2ddb2b34 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.995045:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078a86493/0x6d74dbab2ddb2b34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813574.995060:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813574.995062:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813574.995063:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813574.995075:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583814400 00000100:00100000:1.0:1788813574.995081:0:15120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583814400 00000100:00100000:1.0:1788813574.995131:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788813574.995141:0:15120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e453b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14459:x1875706583814400:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788813574.995186:0:15120:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1788813574.998348:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000347c2f15/0x6d74dbab2ddb2b18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.998378:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000347c2f15/0x6d74dbab2ddb2b18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.998417:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000347c2f15/0x6d74dbab2ddb2b18 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.998426:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000347c2f15/0x6d74dbab2ddb2b18 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813574.998450:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813574.998453:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813574.998455:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813575.004555:0:15120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e453b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14459:x1875706583814400:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9409us (9601us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788813575.004569:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788813575.006504:0:14459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e450380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14459:1875706583814400:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788813575.006526:0:14459:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1788813575.007751:0:16097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813575.007906:0:16097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788813575.007910:0:16097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813575.008434:0:16096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e2f7e9e/0x6d74dbab2ddb2b26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813575.008451:0:16096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148d400 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:0.0:1788813575.008457:0:16096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e2f7e9e/0x6d74dbab2ddb2b26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813575.008469:0:16096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e2f7e9e/0x6d74dbab2ddb2b26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813575.008492:0:16096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e2f7e9e/0x6d74dbab2ddb2b26 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813575.008500:0:16096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e2f7e9e/0x6d74dbab2ddb2b26 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813575.008541:0:16096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813575.008543:0:16096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813575.008545:0:16096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788813575.008556:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1788813575.424309:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788813575.461048:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1788813575.461070:0:7669:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788813575.875841:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e451180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583814528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788813575.875928:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813575.876008:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583814528 00000100:00100000:3.0:1788813575.876017:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583814528 00000100:00100000:3.0:1788813575.876061:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788813575.876070:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e452a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583814528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813575.876118:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813575.876163:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e452a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583814528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813575.876171:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788813575.876221:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e451180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583814528:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788813576.449179:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788813577.223550:0:16199:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg447-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788813577.469618:0:16097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813578.493735:0:16096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813579.520285:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813579.527876:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813579.527979:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562846592 00000100:00100000:1.0:1788813579.527991:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562846592 00000100:00100000:1.0:1788813579.528039:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 73 00000100:00100000:1.0:1788813579.528048:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2358:x1875706562846592:12345-192.168.204.47@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788813579.528080:0:14428:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 764df018-de8a-4291-9451-854d34c91a19@192.168.204.47@tcp t0 exp 0000000000000000 cur 521 last 0 00000020:00000080:1.0:1788813579.528119:0:14428:0:(genops.c:1384:class_connect()) connect: client 764df018-de8a-4291-9451-854d34c91a19, cookie 0x6d74dbab2ddb2b3b 00000100:00080000:1.0:1788813579.528262:0:14428:0:(import.c:65:import_set_state_nolock()) ffff9087466dc800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813579.528342:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:764df018-de8a-4291-9451-854d34c91a19+5:2358:x1875706562846592:12345-192.168.204.47@tcp:250:mount.lustre.0 Request processed in 293us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813579.528350:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 73 00000100:00100000:2.0:1788813579.538196:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813579.538307:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562846720 00000100:00100000:1.0:1788813579.538317:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562846720 00000100:00100000:1.0:1788813579.538389:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 74 00000100:00100000:1.0:1788813579.538399:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:764df018-de8a-4291-9451-854d34c91a19+5:13742:x1875706562846720:12345-192.168.204.47@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788813579.538416:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813579.538435:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90874148d400/0x6d74dbab2ddb2b42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x31ee63787e48417a expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813579.538464:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90874148d400/0x6d74dbab2ddb2b42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48417a expref: 6 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813579.538477:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90874148d400/0x6d74dbab2ddb2b42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48417a expref: 6 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813579.538487:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148d400, rc 0) 00000100:00100000:1.0:1788813579.538548:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:764df018-de8a-4291-9451-854d34c91a19+6:13742:x1875706562846720:12345-192.168.204.47@tcp:101:mount.lustre.0 Request processed in 150us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813579.538572:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 74 00000100:00100000:2.0:1788813579.540634:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813579.540743:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562846848 00000100:00100000:0.0:1788813579.540751:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562846848 00000100:00100000:0.0:1788813579.540816:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 75 00000100:00100000:0.0:1788813579.540826:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:764df018-de8a-4291-9451-854d34c91a19+6:13742:x1875706562846848:12345-192.168.204.47@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788813579.541185:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:764df018-de8a-4291-9451-854d34c91a19+6:13742:x1875706562846848:12345-192.168.204.47@tcp:501:mount.lustre.0 Request processed in 360us (603us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788813579.541194:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 75 00000100:00100000:2.0:1788813579.547142:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813579.547388:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562846976 00000100:00100000:0.0:1788813579.547400:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562846976 00000100:00100000:0.0:1788813579.547464:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 76 00000100:00100000:0.0:1788813579.547475:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908749a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:764df018-de8a-4291-9451-854d34c91a19+6:13742:x1875706562846976:12345-192.168.204.47@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788813579.547493:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813579.547512:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9086425dee00/0x6d74dbab2ddb2b49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x31ee63787e484181 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813579.547541:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9086425dee00/0x6d74dbab2ddb2b49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484181 expref: 7 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813579.547552:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9086425dee00/0x6d74dbab2ddb2b49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484181 expref: 7 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813579.547575:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9086425dee00, rc 0) 00000100:00100000:0.0:1788813579.547873:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908749a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:764df018-de8a-4291-9451-854d34c91a19+7:13742:x1875706562846976:12345-192.168.204.47@tcp:101:mount.lustre.0 Request processed in 398us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813579.547881:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 76 00000100:00100000:2.0:1788813579.556548:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813579.556694:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562847104 00000100:00100000:1.0:1788813579.556706:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562847104 00000100:00100000:1.0:1788813579.556772:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 77 00000100:00100000:1.0:1788813579.556783:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087820dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:764df018-de8a-4291-9451-854d34c91a19+7:13742:x1875706562847104:12345-192.168.204.47@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788813579.557251:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087820dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:764df018-de8a-4291-9451-854d34c91a19+8:13742:x1875706562847104:12345-192.168.204.47@tcp:501:mount.lustre.0 Request processed in 467us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813579.557260:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 77 00000100:00100000:2.0:1788813579.559669:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813579.567528:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562847232 00000100:00100000:0.0:1788813579.567548:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562847232 00000100:00100000:0.0:1788813579.567639:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 78 00000100:00100000:0.0:1788813579.567649:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087820d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:764df018-de8a-4291-9451-854d34c91a19+8:13742:x1875706562847232:12345-192.168.204.47@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788813579.568172:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087820d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:764df018-de8a-4291-9451-854d34c91a19+8:13742:x1875706562847232:12345-192.168.204.47@tcp:503:mount.lustre.0 Request processed in 440us (8519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813579.568182:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 78 00000100:00100000:2.0:1788813579.573497:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813579.573623:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562847360 00000100:00100000:1.0:1788813579.573636:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562847360 00000100:00100000:1.0:1788813579.573698:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 79 00000100:00100000:1.0:1788813579.573709:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087820dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:764df018-de8a-4291-9451-854d34c91a19+8:13761:x1875706562847360:12345-192.168.204.47@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788813579.574104:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087820dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:764df018-de8a-4291-9451-854d34c91a19+8:13761:x1875706562847360:12345-192.168.204.47@tcp:502:llog_process_th.0 Request processed in 395us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813579.574113:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 79 00000100:00100000:2.0:1788813579.588698:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813579.589558:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562847488 00000100:00100000:1.0:1788813579.589572:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562847488 00000100:00100000:1.0:1788813579.589664:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 80 00000100:00100000:1.0:1788813579.589674:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087820d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:764df018-de8a-4291-9451-854d34c91a19+8:13761:x1875706562847488:12345-192.168.204.47@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788813579.589985:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087820d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:764df018-de8a-4291-9451-854d34c91a19+8:13761:x1875706562847488:12345-192.168.204.47@tcp:502:llog_process_th.0 Request processed in 311us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813579.589993:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 80 00000100:00100000:2.0:1788813579.604099:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813579.610566:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562847616 00000100:00100000:0.0:1788813579.610595:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562847616 00000100:00100000:0.0:1788813579.610667:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 81 00000100:00100000:0.0:1788813579.610679:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9087820db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:764df018-de8a-4291-9451-854d34c91a19+8:13742:x1875706562847616:12345-192.168.204.47@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788813579.610696:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813579.610715:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9086425df400/0x6d74dbab2ddb2b50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x31ee63787e4841ab expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813579.610747:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9086425df400/0x6d74dbab2ddb2b50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4841ab expref: 9 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813579.610760:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9086425df400/0x6d74dbab2ddb2b50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4841ab expref: 9 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813579.610770:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9086425df400, rc 0) 00000100:00100000:0.0:1788813579.610934:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9087820db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:764df018-de8a-4291-9451-854d34c91a19+9:13742:x1875706562847616:12345-192.168.204.47@tcp:101:mount.lustre.0 Request processed in 256us (6851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813579.610942:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 81 00000100:00100000:2.0:1788813579.622859:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813579.622965:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562847744 00000100:00100000:0.0:1788813579.622976:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562847744 00000100:00100000:0.0:1788813579.623084:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 82 00000100:00100000:0.0:1788813579.623099:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:764df018-de8a-4291-9451-854d34c91a19+9:13742:x1875706562847744:12345-192.168.204.47@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788813579.623126:0:14427:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788813579.623148:0:14427:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788813579.623152:0:14427:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788813579.623155:0:14427:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788813579.623158:0:14427:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788813579.627457:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:764df018-de8a-4291-9451-854d34c91a19+9:13742:x1875706562847744:12345-192.168.204.47@tcp:256:mount.lustre.0 Request processed in 4353us (4597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813579.627473:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 82 00000100:00100000:2.0:1788813579.630838:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813579.631223:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562847872 00000100:00100000:1.0:1788813579.631234:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562847872 00000100:00100000:1.0:1788813579.631314:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 83 00000100:00100000:1.0:1788813579.631324:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:764df018-de8a-4291-9451-854d34c91a19+9:13742:x1875706562847872:12345-192.168.204.47@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788813579.631344:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813579.631367:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90874148da00/0x6d74dbab2ddb2b57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x31ee63787e4841b2 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813579.631400:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90874148da00/0x6d74dbab2ddb2b57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4841b2 expref: 10 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813579.631412:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90874148da00/0x6d74dbab2ddb2b57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4841b2 expref: 10 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813579.631423:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148da00, rc 0) 00000100:00100000:1.0:1788813579.631490:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:764df018-de8a-4291-9451-854d34c91a19+10:13742:x1875706562847872:12345-192.168.204.47@tcp:101:mount.lustre.0 Request processed in 167us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813579.631497:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 83 00000100:00100000:2.0:1788813579.634251:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813579.634428:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562848000 00000100:00100000:0.0:1788813579.634441:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562848000 00000100:00100000:0.0:1788813579.634573:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 84 00000100:00100000:0.0:1788813579.634625:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:764df018-de8a-4291-9451-854d34c91a19+10:13742:x1875706562848000:12345-192.168.204.47@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788813579.634960:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:764df018-de8a-4291-9451-854d34c91a19+10:13742:x1875706562848000:12345-192.168.204.47@tcp:501:mount.lustre.0 Request processed in 376us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813579.634968:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 84 00000100:00100000:2.0:1788813579.638062:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813579.638164:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562848128 00000100:00100000:0.0:1788813579.638176:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562848128 00000100:00100000:0.0:1788813579.638872:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 85 00000100:00100000:0.0:1788813579.638888:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:764df018-de8a-4291-9451-854d34c91a19+10:13742:x1875706562848128:12345-192.168.204.47@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788813579.639307:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:764df018-de8a-4291-9451-854d34c91a19+10:13742:x1875706562848128:12345-192.168.204.47@tcp:503:mount.lustre.0 Request processed in 412us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813579.639317:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 85 00000100:00100000:2.0:1788813579.642838:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813579.643449:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562848256 00000100:00100000:0.0:1788813579.643460:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562848256 00000100:00100000:0.0:1788813579.643524:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 86 00000100:00100000:0.0:1788813579.643535:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d99bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:764df018-de8a-4291-9451-854d34c91a19+10:13767:x1875706562848256:12345-192.168.204.47@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788813579.643939:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d99bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:764df018-de8a-4291-9451-854d34c91a19+10:13767:x1875706562848256:12345-192.168.204.47@tcp:502:llog_process_th.0 Request processed in 404us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813579.643948:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 86 00000100:00100000:2.0:1788813579.649286:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813579.649956:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562848384 00000100:00100000:0.0:1788813579.649967:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562848384 00000100:00100000:0.0:1788813579.650022:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 87 00000100:00100000:0.0:1788813579.650032:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d99b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:764df018-de8a-4291-9451-854d34c91a19+10:13767:x1875706562848384:12345-192.168.204.47@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788813579.650765:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d99b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:764df018-de8a-4291-9451-854d34c91a19+10:13767:x1875706562848384:12345-192.168.204.47@tcp:502:llog_process_th.0 Request processed in 721us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813579.650774:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 87 00000100:00100000:0.0:1788813579.661075:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813579.661150:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562848512 00000100:00100000:1.0:1788813579.661162:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562848512 00000100:00100000:1.0:1788813579.661216:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 4 00000100:00100000:1.0:1788813579.661225:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2358:x1875706562848512:12345-192.168.204.47@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788813579.661260:0:14436:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 174ca40a-6963-45bf-98f2-c54b8bfcdb58@192.168.204.47@tcp t0 exp 0000000000000000 cur 521 last 0 00000020:00000080:1.0:1788813579.661312:0:14436:0:(genops.c:1384:class_connect()) connect: client 174ca40a-6963-45bf-98f2-c54b8bfcdb58, cookie 0x6d74dbab2ddb2b5e 00000004:00100000:1.0:1788813579.661349:0:14436:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788813579.661355:0:14436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1788813579.701748:0:14436:0:(import.c:65:import_set_state_nolock()) ffff90874c567000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788813579.702286:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+6:2358:x1875706562848512:12345-192.168.204.47@tcp:38:mount.lustre.0 Request processed in 41057us (41218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813579.702308:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 4 00000100:00100000:2.0:1788813579.706942:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813579.707056:0:16090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562848640 00000100:00100000:0.0:1788813579.707069:0:16090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562848640 00000100:00100000:0.0:1788813579.707153:0:16090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 5 00000100:00100000:0.0:1788813579.707165:0:16090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:174ca40a-6963-45bf-98f2-c54b8bfcdb58+6:0:x1875706562848640:12345-192.168.204.47@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788813579.707211:0:16090:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788813579.707306:0:16090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:174ca40a-6963-45bf-98f2-c54b8bfcdb58+6:0:x1875706562848640:12345-192.168.204.47@tcp:41:mount.lustre.0 Request processed in 143us (375us total) trans 0 rc 0/0 00000100:00080000:1.0:1788813579.707464:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788813579.707499:0:16090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 5 00000100:00100000:0.0:1788813579.708656:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813579.708744:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562848768 00000100:00100000:1.0:1788813579.708755:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562848768 00000100:00100000:1.0:1788813579.708827:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 6 00000100:00100000:1.0:1788813579.708837:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+6:13742:x1875706562848768:12345-192.168.204.47@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788813579.708860:0:14435:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788813579.708922:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+6:13742:x1875706562848768:12345-192.168.204.47@tcp:41:mount.lustre.0 Request processed in 86us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813579.708929:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 6 00000100:00100000:3.0:1788813579.711650:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813579.711764:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562848896 00000100:00100000:2.0:1788813579.711774:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562848896 00000100:00100000:2.0:1788813579.711841:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 7 00000100:00100000:2.0:1788813579.711852:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+6:13742:x1875706562848896:12345-192.168.204.47@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788813579.711969:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+6:13742:x1875706562848896:12345-192.168.204.47@tcp:40:mount.lustre.0 Request processed in 118us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813579.711977:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 7 00000100:00100000:0.0:1788813579.714204:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813579.714250:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813579.714306:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813579.714636:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562849280 00000100:00100000:3.0:1788813579.714647:0:14437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562849280 00000100:00100000:3.0:1788813579.714705:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 0 00000100:00100000:3.0:1788813579.714717:0:14437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+6:13742:x1875706562849280:12345-192.168.204.47@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788813579.715257:0:14437:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 473us 00000100:00100000:2.0:1788813579.715725:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562849024 00000100:00100000:2.0:1788813579.715732:0:15121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562849024 00000100:00100000:2.0:1788813579.715760:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562849152 00000100:00100000:2.0:1788813579.715763:0:15121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562849152 00000100:00100000:2.0:1788813579.715789:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 8 00000100:00100000:2.0:1788813579.715816:0:15121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1875706562849024:12345-192.168.204.47@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788813579.715848:0:15121:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 174ca40a-6963-45bf-98f2-c54b8bfcdb58@192.168.204.47@tcp t0 exp 0000000000000000 cur 521 last 0 00000020:00000080:2.0:1788813579.715893:0:15121:0:(genops.c:1384:class_connect()) connect: client 174ca40a-6963-45bf-98f2-c54b8bfcdb58, cookie 0x6d74dbab2ddb2b65 00002000:00100000:2.0:1788813579.715905:0:15121:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 174ca40a-6963-45bf-98f2-c54b8bfcdb58/ffff90876e330800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788813579.715932:0:15121:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788813579.716245:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 9 00000100:00100000:3.0:1788813579.716251:0:15650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2358:x1875706562849152:12345-192.168.204.47@tcp:8:mount.lustre.0 00002000:00080000:2.0:1788813579.716262:0:15121:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00010000:00080000:3.0:1788813579.716267:0:15650:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 174ca40a-6963-45bf-98f2-c54b8bfcdb58@192.168.204.47@tcp t0 exp 0000000000000000 cur 521 last 0 00000020:00000080:3.0:1788813579.716284:0:15650:0:(genops.c:1384:class_connect()) connect: client 174ca40a-6963-45bf-98f2-c54b8bfcdb58, cookie 0x6d74dbab2ddb2b6c 00000100:00080000:2.0:1788813579.716295:0:15121:0:(import.c:65:import_set_state_nolock()) ffff908749d46800 : changing import state from RECOVER to FULL 00002000:00100000:3.0:1788813579.716301:0:15650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 174ca40a-6963-45bf-98f2-c54b8bfcdb58/ffff908641b86800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788813579.716315:0:15650:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788813579.716362:0:15121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+6:2358:x1875706562849024:12345-192.168.204.47@tcp:8:mount.lustre.0 Request processed in 563us (2110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813579.716370:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 8 00002000:00080000:3.0:1788813579.716735:0:15650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788813579.716752:0:15650:0:(import.c:65:import_set_state_nolock()) ffff908641b80800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788813579.716781:0:15650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+6:2358:x1875706562849152:12345-192.168.204.47@tcp:8:mount.lustre.0 Request processed in 528us (2474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813579.716788:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 9 00000004:00200000:1.0:1788813579.727704:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788813579.727848:0:14437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+6:13742:x1875706562849280:12345-192.168.204.47@tcp:33:mount.lustre.0 Request processed in 13127us (13650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813579.727866:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 0 00000100:00100000:0.0:1788813579.910303:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813579.910474:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562849408 00000100:00100000:1.0:1788813579.910486:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562849408 00000100:00100000:1.0:1788813579.910560:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 8 00000100:00100000:1.0:1788813579.910571:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+6:13788:x1875706562849408:12345-192.168.204.47@tcp:101:mkdir.0 00010000:00010000:1.0:1788813579.910623:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813579.910701:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c000/0x6d74dbab2ddb2b73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4841dc expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813579.910770:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ca00/0x6d74dbab2ddb2b7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813579.910785:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ca00/0x6d74dbab2ddb2b7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813579.910812:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ca00/0x6d74dbab2ddb2b7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813579.910848:0:14435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788813579.910865:0:14435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813579.910906:0:14435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ca00/0x6d74dbab2ddb2b7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813579.910932:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c000/0x6d74dbab2ddb2b73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4841dc expref: 8 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813579.910952:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ca00/0x6d74dbab2ddb2b7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4841dc expref: 7 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813579.910960:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908742cc6600) 00010000:00010000:1.0:1788813579.910963:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813579.910966:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148ca00, rc 0) 00000100:00100000:1.0:1788813579.911032:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+7:13788:x1875706562849408:12345-192.168.204.47@tcp:101:mkdir.0 Request processed in 462us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813579.911040:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 8 00000100:00100000:3.0:1788813579.965012:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583814656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813579.965127:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813579.965278:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583814656 00000100:00100000:1.0:1788813579.965287:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583814656 00000100:00100000:1.0:1788813579.965372:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813579.965382:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583814656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788813579.965410:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813579.965469:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e450000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583814656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813579.965477:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813579.965518:0:3321:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788813579.965539:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583814656:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788813579.965713:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813579.966153:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583814912:0@lo:400:kworker.0 00000100:00100000:2.0:1788813579.966199:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813579.966235:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788813579.966241:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3319:1875706583814784:0@lo:400:kworker.0 00000100:00100000:2.0:1788813579.966270:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813579.966292:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875706583815296:0@lo:400:kworker.0 00000100:00100000:2.0:1788813579.966330:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813579.966362:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583815296 00000100:00100000:2.0:1788813579.966369:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583815296 00000100:00100000:2.0:1788813579.966414:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788813579.966422:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875706583815296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813579.966468:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875706583815296:12345-0@lo:400:kworker.0 Request processed in 46us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813579.966475:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788813579.966494:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813579.966521:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875706583815296:0@lo:400:kworker.0 00000100:00100000:3.0:1788813579.966683:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583814912 00000100:00100000:3.0:1788813579.966689:0:15120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583814912 00000100:00100000:3.0:1788813579.966731:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788813579.966739:0:15120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583814912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813579.966780:0:15120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583814912:12345-0@lo:400:kworker.0 Request processed in 43us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813579.966787:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788813579.966827:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583814912:0@lo:400:kworker.0 00000100:00100000:0.0:1788813579.966895:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583815040:0@lo:400:kworker.0 00000100:00100000:0.0:1788813579.966928:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813579.966962:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788813579.966968:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e451c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583815168:0@lo:400:kworker.0 00000100:00100000:0.0:1788813579.966988:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813579.967015:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583814784 00000100:00100000:0.0:1788813579.967019:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583814784 00000100:00100000:0.0:1788813579.967045:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788813579.967052:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d99a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:3319:x1875706583814784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813579.967088:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d99a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:3319:x1875706583814784:12345-0@lo:400:kworker.0 Request processed in 36us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813579.967109:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788813579.967492:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583815040 00000100:00100000:2.0:1788813579.967498:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583815040 00000100:00100000:2.0:1788813579.967533:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583815168 00000100:00100000:2.0:1788813579.967537:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583815168 00000100:00100000:2.0:1788813579.967561:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788813579.967567:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583815040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813579.967637:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583815040:12345-0@lo:400:kworker.0 Request processed in 70us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813579.967643:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788813579.967657:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788813579.967662:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583815168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813579.967690:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875706583815168:12345-0@lo:400:kworker.0 Request processed in 28us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813579.967695:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788813579.967710:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788813579.967714:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813579.967738:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e451c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875706583815168:0@lo:400:kworker.0 00000100:00100000:2.0:1788813579.967747:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e452300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583815040:0@lo:400:kworker.0 00000100:00100000:3.0:1788813579.968187:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3319:1875706583814784:0@lo:400:kworker.0 00000001:00100000:1.0:1788813580.514117:0:7669:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 174ca40a-6963-45bf-98f2-c54b8bfcdb58 00010000:00010000:1.0:1788813580.542616:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813580.989151:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583815424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813580.989226:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813580.990100:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583815424 00000100:00100000:2.0:1788813580.990110:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583815424 00000100:00100000:2.0:1788813580.990168:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788813580.990178:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583815424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813580.990214:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813580.990281:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583815424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813580.990288:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813580.993451:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e450380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583815424:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788813581.045231:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 174ca40a-6963-45bf-98f2-c54b8bfcdb58 00010000:00010000:0.0:1788813581.565841:0:16097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813581.893981:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813581.894406:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562849536 00000100:00100000:2.0:1788813581.894418:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562849536 00000100:00100000:2.0:1788813581.894520:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 9 00000100:00100000:2.0:1788813581.894532:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+7:13841:x1875706562849536:12345-192.168.204.47@tcp:41:lfs.0 00000004:00000024:2.0:1788813581.894616:0:14436:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788813581.894737:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+7:13841:x1875706562849536:12345-192.168.204.47@tcp:41:lfs.0 Request processed in 207us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813581.894744:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 9 00000100:00080000:0.0:1788813581.895160:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813581.900359:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813581.902787:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562849664 00000100:00100000:2.0:1788813581.902805:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562849664 00000100:00100000:2.0:1788813581.903009:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 6 00000100:00100000:2.0:1788813581.903020:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:174ca40a-6963-45bf-98f2-c54b8bfcdb58+5:13841:x1875706562849664:12345-192.168.204.47@tcp:13:lfs.0 00002000:00000024:2.0:1788813581.903047:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813581.903140:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e453800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:174ca40a-6963-45bf-98f2-c54b8bfcdb58+5:13841:x1875706562849664:12345-192.168.204.47@tcp:13:lfs.0 Request processed in 123us (2797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813581.903147:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 6 00000100:00080000:0.0:1788813581.905944:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813581.912670:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813581.913602:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562849792 00000100:00100000:2.0:1788813581.913614:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562849792 00000100:00100000:2.0:1788813581.913697:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 7 00000100:00100000:2.0:1788813581.913708:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642915880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:174ca40a-6963-45bf-98f2-c54b8bfcdb58+5:13841:x1875706562849792:12345-192.168.204.47@tcp:13:lfs.0 00002000:00000024:2.0:1788813581.913747:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813581.913876:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642915880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:174ca40a-6963-45bf-98f2-c54b8bfcdb58+5:13841:x1875706562849792:12345-192.168.204.47@tcp:13:lfs.0 Request processed in 169us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813581.913885:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 7 00000100:00080000:0.0:1788813581.915506:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788813582.105023:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813582.105134:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562849920 00000100:00100000:0.0:1788813582.105144:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562849920 00000100:00100000:0.0:1788813582.105224:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 89 00000100:00100000:0.0:1788813582.105234:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d99b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:764df018-de8a-4291-9451-854d34c91a19+10:13874:x1875706562849920:12345-192.168.204.47@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788813582.105251:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813582.105269:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9086425df800/0x6d74dbab2ddb2b81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x31ee63787e4841e3 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813582.105300:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9086425df800/0x6d74dbab2ddb2b81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4841e3 expref: 11 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813582.105312:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9086425df800/0x6d74dbab2ddb2b81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4841e3 expref: 11 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813582.105321:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9086425df800, rc 0) 00000100:00100000:0.0:1788813582.105381:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d99b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:764df018-de8a-4291-9451-854d34c91a19+11:13874:x1875706562849920:12345-192.168.204.47@tcp:101:mount.lustre.0 Request processed in 148us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813582.105388:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 89 00000100:00100000:1.0:1788813582.106868:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813582.106969:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562850048 00000100:00100000:2.0:1788813582.106977:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562850048 00000100:00100000:2.0:1788813582.107042:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 90 00000100:00100000:2.0:1788813582.107052:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d99ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:764df018-de8a-4291-9451-854d34c91a19+11:13874:x1875706562850048:12345-192.168.204.47@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788813582.107331:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d99ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:764df018-de8a-4291-9451-854d34c91a19+11:13874:x1875706562850048:12345-192.168.204.47@tcp:501:mount.lustre.0 Request processed in 279us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813582.107339:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 90 00000100:00100000:2.0:1788813582.119188:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813582.120990:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562850176 00000100:00100000:1.0:1788813582.121004:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562850176 00000100:00100000:1.0:1788813582.121071:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 91 00000100:00100000:1.0:1788813582.121083:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:764df018-de8a-4291-9451-854d34c91a19+11:13874:x1875706562850176:12345-192.168.204.47@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788813582.121414:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:764df018-de8a-4291-9451-854d34c91a19+11:13874:x1875706562850176:12345-192.168.204.47@tcp:503:mount.lustre.0 Request processed in 333us (2233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813582.121423:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 91 00000100:00100000:1.0:1788813582.135052:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813582.135886:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562850304 00000100:00100000:0.0:1788813582.135899:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562850304 00000100:00100000:0.0:1788813582.135966:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 92 00000100:00100000:0.0:1788813582.135977:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d99a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:764df018-de8a-4291-9451-854d34c91a19+11:13880:x1875706562850304:12345-192.168.204.47@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788813582.136301:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d99a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:764df018-de8a-4291-9451-854d34c91a19+11:13880:x1875706562850304:12345-192.168.204.47@tcp:502:llog_process_th.0 Request processed in 324us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813582.136310:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 92 00000100:00100000:3.0:1788813582.166329:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813582.167562:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562850432 00000100:00100000:2.0:1788813582.167873:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562850432 00000100:00100000:2.0:1788813582.167936:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 93 00000100:00100000:2.0:1788813582.167946:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:764df018-de8a-4291-9451-854d34c91a19+11:13880:x1875706562850432:12345-192.168.204.47@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788813582.174116:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:764df018-de8a-4291-9451-854d34c91a19+11:13880:x1875706562850432:12345-192.168.204.47@tcp:502:llog_process_th.0 Request processed in 6159us (7785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813582.174131:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 93 00000100:00100000:2.0:1788813582.182120:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813582.182866:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562850560 00000100:00100000:1.0:1788813582.182876:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562850560 00000100:00100000:1.0:1788813582.182933:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 94 00000100:00100000:1.0:1788813582.182942:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d99b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:764df018-de8a-4291-9451-854d34c91a19+11:13874:x1875706562850560:12345-192.168.204.47@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788813582.182958:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813582.182978:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90874148dc00/0x6d74dbab2ddb2b88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x31ee63787e48420d expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813582.183008:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90874148dc00/0x6d74dbab2ddb2b88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48420d expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813582.183018:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90874148dc00/0x6d74dbab2ddb2b88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48420d expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813582.183047:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148dc00, rc 0) 00000100:00100000:1.0:1788813582.183105:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d99b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:764df018-de8a-4291-9451-854d34c91a19+12:13874:x1875706562850560:12345-192.168.204.47@tcp:101:mount.lustre.0 Request processed in 164us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813582.183112:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 94 00000100:00100000:1.0:1788813582.186127:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813582.186484:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562850688 00000100:00100000:2.0:1788813582.186494:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562850688 00000100:00100000:1.0:1788813582.186995:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 95 00000100:00100000:1.0:1788813582.187006:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877d99a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:764df018-de8a-4291-9451-854d34c91a19+12:13874:x1875706562850688:12345-192.168.204.47@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788813582.187034:0:14426:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788813582.187057:0:14426:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788813582.187061:0:14426:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788813582.187063:0:14426:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788813582.187066:0:14426:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788813582.189329:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877d99a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:764df018-de8a-4291-9451-854d34c91a19+12:13874:x1875706562850688:12345-192.168.204.47@tcp:256:mount.lustre.0 Request processed in 2316us (3201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813582.189343:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 95 00000100:00100000:3.0:1788813582.192510:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813582.192710:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562850816 00000100:00100000:0.0:1788813582.192719:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562850816 00000100:00100000:0.0:1788813582.192784:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 96 00000100:00100000:0.0:1788813582.192798:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:764df018-de8a-4291-9451-854d34c91a19+12:13874:x1875706562850816:12345-192.168.204.47@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788813582.192829:0:14428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813582.192847:0:14428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9086425df200/0x6d74dbab2ddb2b8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x31ee63787e484214 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813582.192874:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9086425df200/0x6d74dbab2ddb2b8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484214 expref: 13 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813582.192885:0:14428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9086425df200/0x6d74dbab2ddb2b8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484214 expref: 13 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813582.192894:0:14428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9086425df200, rc 0) 00000100:00100000:0.0:1788813582.192951:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:764df018-de8a-4291-9451-854d34c91a19+13:13874:x1875706562850816:12345-192.168.204.47@tcp:101:mount.lustre.0 Request processed in 158us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813582.192958:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 96 00000100:00100000:1.0:1788813582.198049:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813582.198226:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562850944 00000100:00100000:2.0:1788813582.198236:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562850944 00000100:00100000:2.0:1788813582.198572:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 97 00000100:00100000:2.0:1788813582.198633:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:764df018-de8a-4291-9451-854d34c91a19+13:13874:x1875706562850944:12345-192.168.204.47@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788813582.198948:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:764df018-de8a-4291-9451-854d34c91a19+13:13874:x1875706562850944:12345-192.168.204.47@tcp:501:mount.lustre.0 Request processed in 365us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813582.198956:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 97 00000100:00100000:1.0:1788813582.201303:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813582.201939:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562851072 00000100:00100000:0.0:1788813582.201949:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562851072 00000100:00100000:1.0:1788813582.202119:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 98 00000100:00100000:1.0:1788813582.202130:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:764df018-de8a-4291-9451-854d34c91a19+13:13874:x1875706562851072:12345-192.168.204.47@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788813582.202564:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:764df018-de8a-4291-9451-854d34c91a19+13:13874:x1875706562851072:12345-192.168.204.47@tcp:503:mount.lustre.0 Request processed in 433us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813582.202572:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 98 00000100:00100000:1.0:1788813582.206067:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813582.206212:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562851200 00000100:00100000:3.0:1788813582.206223:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562851200 00000100:00100000:3.0:1788813582.206293:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 99 00000100:00100000:3.0:1788813582.206502:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:764df018-de8a-4291-9451-854d34c91a19+13:13884:x1875706562851200:12345-192.168.204.47@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788813582.206992:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:764df018-de8a-4291-9451-854d34c91a19+13:13884:x1875706562851200:12345-192.168.204.47@tcp:502:llog_process_th.0 Request processed in 687us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813582.207001:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 99 00000100:00100000:1.0:1788813582.222886:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813582.222986:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562851328 00000100:00100000:2.0:1788813582.222997:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562851328 00000100:00100000:2.0:1788813582.223064:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 100 00000100:00100000:2.0:1788813582.223074:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:764df018-de8a-4291-9451-854d34c91a19+13:13884:x1875706562851328:12345-192.168.204.47@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788813582.223786:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:764df018-de8a-4291-9451-854d34c91a19+13:13884:x1875706562851328:12345-192.168.204.47@tcp:502:llog_process_th.0 Request processed in 710us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813582.223795:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 100 00000100:00100000:3.0:1788813582.228434:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813582.228812:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562851456 00000100:00100000:1.0:1788813582.228822:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562851456 00000100:00100000:1.0:1788813582.228909:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 10 00000100:00100000:1.0:1788813582.228918:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2358:x1875706562851456:12345-192.168.204.47@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788813582.228962:0:14435:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from c86e9881-1962-411f-a069-94fc48e23217@192.168.204.47@tcp t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:1.0:1788813582.229021:0:14435:0:(genops.c:1384:class_connect()) connect: client c86e9881-1962-411f-a069-94fc48e23217, cookie 0x6d74dbab2ddb2b96 00000004:00100000:1.0:1788813582.229051:0:14435:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788813582.229190:0:14435:0:(import.c:65:import_set_state_nolock()) ffff9087739c7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813582.229285:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e451f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c86e9881-1962-411f-a069-94fc48e23217+6:2358:x1875706562851456:12345-192.168.204.47@tcp:38:mount.lustre.0 Request processed in 359us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813582.229294:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 10 00000100:00100000:0.0:1788813582.235084:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813582.235533:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562851712 00000100:00100000:2.0:1788813582.235545:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562851712 00000100:00100000:2.0:1788813582.236086:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 11 00000100:00100000:2.0:1788813582.236108:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c86e9881-1962-411f-a069-94fc48e23217+6:13874:x1875706562851712:12345-192.168.204.47@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788813582.236143:0:14436:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788813582.236229:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c86e9881-1962-411f-a069-94fc48e23217+6:13874:x1875706562851712:12345-192.168.204.47@tcp:41:mount.lustre.0 Request processed in 124us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813582.236237:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 11 00000100:00100000:1.0:1788813582.237985:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813582.238266:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562851584 00000100:00100000:2.0:1788813582.238286:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562851584 00000100:00100000:2.0:1788813582.238353:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 12 00000100:00100000:2.0:1788813582.238363:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c86e9881-1962-411f-a069-94fc48e23217+6:0:x1875706562851584:12345-192.168.204.47@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788813582.238396:0:14432:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788813582.238462:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642917100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c86e9881-1962-411f-a069-94fc48e23217+6:0:x1875706562851584:12345-192.168.204.47@tcp:41:mount.lustre.0 Request processed in 100us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813582.238487:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 12 00000100:00080000:0.0:1788813582.244404:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813582.245421:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813582.245565:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562851840 00000100:00100000:0.0:1788813582.245576:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562851840 00000100:00100000:1.0:1788813582.251453:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 13 00000100:00100000:1.0:1788813582.251465:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c86e9881-1962-411f-a069-94fc48e23217+6:13874:x1875706562851840:12345-192.168.204.47@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788813582.251565:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c86e9881-1962-411f-a069-94fc48e23217+6:13874:x1875706562851840:12345-192.168.204.47@tcp:40:mount.lustre.0 Request processed in 102us (6153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813582.251572:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 13 00000100:00100000:3.0:1788813582.261336:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813582.261388:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813582.261429:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813582.261691:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562851968 00000100:00100000:1.0:1788813582.261704:0:15650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562851968 00000100:00100000:1.0:1788813582.261756:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562852096 00000100:00100000:1.0:1788813582.261759:0:15650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562852096 00000100:00100000:1.0:1788813582.261780:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 10 00000100:00100000:1.0:1788813582.261789:0:15650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e450380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2358:x1875706562851968:12345-192.168.204.47@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788813582.261824:0:15650:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from c86e9881-1962-411f-a069-94fc48e23217@192.168.204.47@tcp t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:1.0:1788813582.261857:0:15650:0:(genops.c:1384:class_connect()) connect: client c86e9881-1962-411f-a069-94fc48e23217, cookie 0x6d74dbab2ddb2b9d 00002000:00100000:1.0:1788813582.261869:0:15650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c86e9881-1962-411f-a069-94fc48e23217/ffff9087739c4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788813582.261881:0:15650:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788813582.262143:0:15650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788813582.262188:0:15650:0:(import.c:65:import_set_state_nolock()) ffff9087742f1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788813582.262421:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562852224 00000100:00100000:0.0:1788813582.262427:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562852224 00000100:00100000:0.0:1788813582.262460:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 1 00000100:00100000:0.0:1788813582.262469:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c86e9881-1962-411f-a069-94fc48e23217+6:13874:x1875706562852224:12345-192.168.204.47@tcp:33:mount.lustre.0 00000100:00100000:1.0:1788813582.262493:0:15650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e450380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c86e9881-1962-411f-a069-94fc48e23217+6:2358:x1875706562851968:12345-192.168.204.47@tcp:8:mount.lustre.0 Request processed in 702us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813582.262501:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 10 00000100:00100000:1.0:1788813582.262520:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 11 00000100:00100000:1.0:1788813582.262525:0:15650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2358:x1875706562852096:12345-192.168.204.47@tcp:8:mount.lustre.0 00000004:00200000:0.0:1788813582.262533:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00010000:00080000:1.0:1788813582.262544:0:15650:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from c86e9881-1962-411f-a069-94fc48e23217@192.168.204.47@tcp t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:1.0:1788813582.262567:0:15650:0:(genops.c:1384:class_connect()) connect: client c86e9881-1962-411f-a069-94fc48e23217, cookie 0x6d74dbab2ddb2ba4 00002000:00100000:1.0:1788813582.262574:0:15650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c86e9881-1962-411f-a069-94fc48e23217/ffff908749dad800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788813582.262614:0:15650:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788813582.262626:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e452d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c86e9881-1962-411f-a069-94fc48e23217+6:13874:x1875706562852224:12345-192.168.204.47@tcp:33:mount.lustre.0 Request processed in 156us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813582.262634:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 1 00002000:00080000:1.0:1788813582.262858:0:15650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788813582.262874:0:15650:0:(import.c:65:import_set_state_nolock()) ffff908749daf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788813582.263888:0:15650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e452300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c86e9881-1962-411f-a069-94fc48e23217+6:2358:x1875706562852096:12345-192.168.204.47@tcp:8:mount.lustre.0 Request processed in 1355us (2452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813582.263899:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 11 00000100:00100000:3.0:1788813582.541450:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813582.541537:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562852352 00000100:00100000:2.0:1788813582.541549:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562852352 00000100:00100000:2.0:1788813582.541640:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 14 00000100:00100000:2.0:1788813582.541651:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c86e9881-1962-411f-a069-94fc48e23217+6:13905:x1875706562852352:12345-192.168.204.47@tcp:101:mkdir.0 00010000:00010000:2.0:1788813582.541672:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813582.541698:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2bab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e48423e expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813582.541782:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369c00/0x6d74dbab2ddb2bb2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813582.541797:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369c00/0x6d74dbab2ddb2bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813582.541812:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369c00/0x6d74dbab2ddb2bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813582.541848:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788813582.541852:0:14432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788813582.541872:0:14432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908774369c00/0x6d74dbab2ddb2bb2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813582.541900:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2bab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48423e expref: 8 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813582.541920:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369c00/0x6d74dbab2ddb2bb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48423e expref: 7 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813582.541948:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908742cc6600) 00010000:00010000:2.0:1788813582.541951:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813582.541954:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369c00, rc 0) 00000100:00100000:2.0:1788813582.542024:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c86e9881-1962-411f-a069-94fc48e23217+7:13905:x1875706562852352:12345-192.168.204.47@tcp:101:mkdir.0 Request processed in 374us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813582.542031:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 14 00010000:00010000:0.0:1788813582.588844:0:16096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788813582.973283:0:14468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788813583.615352:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813584.639276:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813585.084855:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583815680:0@lo:400:kworker.0 00000100:00100000:3.0:1788813585.084934:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813585.084979:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875706583816192:0@lo:400:kworker.0 00000100:00100000:3.0:1788813585.085000:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813585.085024:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788813585.085029:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876e452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3321:1875706583815552:0@lo:400:kworker.0 00000100:00100000:3.0:1788813585.085056:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813585.085079:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875706583816064:0@lo:400:kworker.0 00000100:00100000:3.0:1788813585.085099:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813585.085124:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583815808:0@lo:400:kworker.0 00000100:00100000:3.0:1788813585.085146:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813585.085165:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788813585.085170:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875706583815936:0@lo:400:kworker.0 00000100:00100000:3.0:1788813585.085202:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813585.085372:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583815680 00000100:00100000:3.0:1788813585.085381:0:15121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583815680 00000100:00100000:0.0:1788813585.085791:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583815552 00000100:00100000:0.0:1788813585.085796:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583815552 00000100:00100000:0.0:1788813585.085840:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788813585.085849:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:3321:x1875706583815552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788813585.085907:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:3321:x1875706583815552:12345-0@lo:400:kworker.0 Request processed in 59us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813585.085913:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:2.0:1788813585.088879:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813585.088951:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788813585.088970:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583816320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813585.089043:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813585.089087:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583816320 00000100:00100000:2.0:1788813585.089094:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583816320 00000100:00100000:2.0:1788813585.089148:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788813585.089157:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583816320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788813585.089205:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813585.089262:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583816320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813585.089269:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788813585.089288:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813585.089324:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583816320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813585.089559:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583816192 00000100:00100000:3.0:1788813585.089564:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583816192 00000100:00100000:3.0:1788813585.089664:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583816064 00000100:00100000:3.0:1788813585.089668:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583816064 00000100:00100000:3.0:1788813585.089685:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583815936 00000100:00100000:3.0:1788813585.089687:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583815936 00000100:00100000:3.0:1788813585.089714:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788813585.089720:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875706583816192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813585.089761:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875706583816192:12345-0@lo:400:kworker.0 Request processed in 41us (4760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813585.089768:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788813585.089780:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788813585.089795:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875706583816064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813585.089824:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875706583816064:12345-0@lo:400:kworker.0 Request processed in 30us (4724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813585.089829:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788813585.089842:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788813585.089848:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875706583815936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813585.089873:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875706583815936:12345-0@lo:400:kworker.0 Request processed in 26us (4671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813585.089878:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788813585.089900:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583815808 00000100:00100000:3.0:1788813585.089904:0:15119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583815808 00000100:00100000:3.0:1788813585.089928:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788813585.089934:0:15119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583815808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813585.089963:0:15119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583815808:12345-0@lo:400:kworker.0 Request processed in 29us (4816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813585.089969:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788813585.090011:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875706583815936:0@lo:400:kworker.0 00000100:00100000:3.0:1788813585.090022:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583815808:0@lo:400:kworker.0 00000100:00100000:3.0:1788813585.090049:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876e452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3321:1875706583815552:0@lo:400:kworker.0 00000100:00100000:3.0:1788813585.090059:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875706583816064:0@lo:400:kworker.0 00000100:00100000:3.0:1788813585.090070:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875706583816192:0@lo:400:kworker.0 00000100:00100000:3.0:1788813585.090105:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788813585.090113:0:15121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583815680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813585.090160:0:15121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875706583815680:12345-0@lo:400:kworker.0 Request processed in 48us (5225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813585.090167:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788813585.090208:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875706583815680:0@lo:400:kworker.0 00000100:00080000:2.0:1788813585.090470:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1788813585.123440:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c86e9881-1962-411f-a069-94fc48e23217 00000001:00100000:1.0:1788813585.123686:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 174ca40a-6963-45bf-98f2-c54b8bfcdb58 00000001:02000400:2.0:1788813585.334108:0:16401:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1788813585.651924:0:7669:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c86e9881-1962-411f-a069-94fc48e23217 00010000:00010000:0.0:1788813585.660885:0:16097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813586.109268:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788813586.109293:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583816448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788813586.109365:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813586.109551:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583816448 00000100:00100000:3.0:1788813586.109561:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583816448 00000100:00100000:3.0:1788813586.109646:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788813586.109656:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583816448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813586.109702:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813586.109752:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642916300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583816448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813586.109758:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788813586.109852:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583816448:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788813586.175992:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c86e9881-1962-411f-a069-94fc48e23217 00010000:00010000:1.0:1788813586.684978:0:16096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813587.332965:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813587.333534:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813587.333573:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813587.333620:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813587.333623:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562852736 00000100:00100000:2.0:1788813587.333633:0:15650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562852736 00000100:00100000:0.0:1788813587.333637:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813587.333672:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813587.333693:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813587.333712:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562852864 00000100:00100000:0.0:1788813587.333714:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562852992 00000100:00100000:2.0:1788813587.333715:0:15650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562852864 00000100:00100000:0.0:1788813587.333716:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562852992 00000100:00100000:2.0:1788813587.333742:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562853120 00000100:00100000:2.0:1788813587.333744:0:15650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562853120 00000100:00100000:0.0:1788813587.333745:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562852608 00000100:00100000:0.0:1788813587.333747:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562852608 00000100:00100000:2.0:1788813587.333755:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562853248 00000100:00100000:2.0:1788813587.333757:0:15650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562853248 00000100:00100000:0.0:1788813587.333768:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 17 00000100:00100000:2.0:1788813587.333770:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 5 00000100:00100000:2.0:1788813587.333777:0:15650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+5:2362:x1875706562852736:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813587.333777:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c86e9881-1962-411f-a069-94fc48e23217+6:2362:x1875706562852992:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813587.333846:0:15650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+5:2362:x1875706562852736:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 69us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813587.333854:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 5 00000100:00100000:2.0:1788813587.333869:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 6 00000100:00100000:2.0:1788813587.333874:0:15650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+5:2361:x1875706562852864:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813587.333899:0:15650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+5:2361:x1875706562852864:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 25us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813587.333905:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 6 00000100:00100000:2.0:1788813587.333915:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 7 00000100:00100000:2.0:1788813587.333920:0:15650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c86e9881-1962-411f-a069-94fc48e23217+5:2361:x1875706562853120:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813587.333939:0:15650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c86e9881-1962-411f-a069-94fc48e23217+5:2361:x1875706562853120:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 19us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813587.333945:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 7 00000100:00100000:2.0:1788813587.333955:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 8 00000100:00100000:2.0:1788813587.333961:0:15650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c86e9881-1962-411f-a069-94fc48e23217+5:2362:x1875706562853248:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813587.333982:0:15650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c86e9881-1962-411f-a069-94fc48e23217+5:2362:x1875706562853248:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 22us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813587.333988:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 8 00000100:00080000:2.0:1788813587.334004:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813587.334013:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788813587.334015:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788813587.334098:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c86e9881-1962-411f-a069-94fc48e23217+6:2362:x1875706562852992:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 321us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813587.334105:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 17 00000100:00100000:0.0:1788813587.334120:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 18 00000100:00100000:0.0:1788813587.334126:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+6:2361:x1875706562852608:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813587.334168:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+6:2361:x1875706562852608:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 41us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813587.334174:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 18 00000100:00100000:1.0:1788813587.335352:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562852480 00000100:00100000:1.0:1788813587.335363:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562852480 00000100:00100000:1.0:1788813587.335414:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 102 00000100:00100000:1.0:1788813587.335432:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:764df018-de8a-4291-9451-854d34c91a19+13:2362:x1875706562852480:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813587.335492:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:764df018-de8a-4291-9451-854d34c91a19+13:2362:x1875706562852480:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 71us (2535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813587.335498:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 102 00010000:00010000:3.0:1788813587.708754:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813588.736885:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788813588.829810:0:16552:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc08ffbe10 20000000:00000080:3.0:1788813588.829828:0:16552:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff908766787c00 uarg=0000000000000000 20000000:01000000:3.0:1788813588.829875:0:16552:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788813588.829881:0:16552:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788813588.829885:0:16552:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788813588.830788:0:16553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1788813588.830944:0:16552:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788813588.838879:0:16552:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788813588.838909:0:16552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff908773c95400/0x6d74dbab2ddb2bb9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813588.838927:0:16552:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff908740031400/0x6d74dbab2ddb28b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb28a9 expref: 18 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813588.838934:0:16552:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff908774369600/0x6d74dbab2ddb28fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb28f6 expref: 18 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813588.838959:0:16552:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9087413a1400/0x6d74dbab2ddb2a38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb2a31 expref: 18 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813588.838969:0:16552:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90874148da00/0x6d74dbab2ddb2b57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4841b2 expref: 12 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813588.838976:0:16552:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9086425df200/0x6d74dbab2ddb2b8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484214 expref: 12 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813588.838984:0:16552:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff908773c95400/0x6d74dbab2ddb2bb9 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813588.839029:0:16552:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9086425df200/0x6d74dbab2ddb2b8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484214 expref: 12 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813588.839043:0:16552:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9086425df200/0x6d74dbab2ddb2b8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484214 expref: 12 pid: 14428 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813588.839058:0:16552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ec380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16552:1875706583816576:192.168.204.47@tcp:104: 00010000:00010000:3.0:1788813588.839352:0:16552:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90874148da00/0x6d74dbab2ddb2b57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4841b2 expref: 12 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813588.839361:0:16552:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90874148da00/0x6d74dbab2ddb2b57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4841b2 expref: 12 pid: 14426 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813588.839370:0:16552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3efb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16552:1875706583816704:192.168.204.47@tcp:104: 00010000:00010000:3.0:1788813588.839403:0:16552:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9087413a1400/0x6d74dbab2ddb2a38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb2a31 expref: 18 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813588.839421:0:16552:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9087413a1400/0x6d74dbab2ddb2a38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb2a31 expref: 18 pid: 14428 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813588.839430:0:16552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ef800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16552:1875706583816832:0@lo:104: 00000100:00100000:3.0:1788813588.839471:0:16552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788813588.839513:0:16552:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff908774369600/0x6d74dbab2ddb28fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb28f6 expref: 18 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813588.839521:0:16552:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff908774369600/0x6d74dbab2ddb28fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb28f6 expref: 18 pid: 14427 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813588.839530:0:16552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16552:1875706583816960:0@lo:104: 00000100:00100000:3.0:1788813588.839551:0:16552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788813588.839618:0:16552:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff908740031400/0x6d74dbab2ddb28b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d74dbab2ddb28a9 expref: 18 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813588.839638:0:16552:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff908740031400/0x6d74dbab2ddb28b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d74dbab2ddb28a9 expref: 18 pid: 14427 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813588.839646:0:16552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16552:1875706583817088:0@lo:104: 00000100:00100000:3.0:1788813588.839671:0:16552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813588.839681:0:16552:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087587f2240 going to sleep for 11 seconds 00000100:00100000:1.0:1788813588.839756:0:14418:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788813588.839769:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583816832 00000100:00100000:1.0:1788813588.839776:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583816832 00000100:00100000:1.0:1788813588.839815:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583816960 00000100:00100000:1.0:1788813588.839818:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583816960 00000100:00100000:1.0:1788813588.839829:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583817088 00000100:00100000:1.0:1788813588.839831:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583817088 00000100:00100000:1.0:1788813588.839843:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813588.839852:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+5:16552:x1875706583816832:12345-0@lo:104: 00010000:00010000:1.0:1788813588.839865:0:14418:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff90874148d600/0x6d74dbab2ddb2a31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb2a38 expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.839929:0:14418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788813588.839936:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+5:16552:x1875706583816832:12345-0@lo:104: Request processed in 85us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813588.839943:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813588.839960:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813588.839965:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+4:16552:x1875706583816960:12345-0@lo:104: 00010000:00010000:1.0:1788813588.839972:0:14418:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff908749d73c00/0x6d74dbab2ddb28f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb28fd expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.840018:0:14418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788813588.840024:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+4:16552:x1875706583816960:12345-0@lo:104: Request processed in 59us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813588.840030:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813588.840043:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788813588.840048:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908760119850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+3:16552:x1875706583817088:12345-0@lo:104: 00010000:00010000:1.0:1788813588.840056:0:14418:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.147@tcp lock: ffff908774369800/0x6d74dbab2ddb28a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb28b0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.840089:0:14418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788813588.840094:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908760119850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+3:16552:x1875706583817088:12345-0@lo:104: Request processed in 46us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813588.840098:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788813588.840371:0:16096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788813588.840378:0:16096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff90874148d600/0x6d74dbab2ddb2a31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb2a38 expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.840387:0:16096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148d600 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:1.0:1788813588.840391:0:16096:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff90874148d600/0x6d74dbab2ddb2a31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb2a38 expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.840399:0:16096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff90874148d600/0x6d74dbab2ddb2a31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb2a38 expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813588.840407:0:16096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff90874148d600/0x6d74dbab2ddb2a31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb2a38 expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813588.840413:0:16096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788813588.840452:0:16096:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff90874148d600/0x6d74dbab2ddb2a31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb2a38 expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.840460:0:16096:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813588.840482:0:16096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff90874148d600/0x6d74dbab2ddb2a31 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb2a38 expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.840489:0:16096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff90874148d600/0x6d74dbab2ddb2a31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb2a38 expref: -99 pid: 15836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.840503:0:16096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788813588.840506:0:16096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908749d73c00/0x6d74dbab2ddb28f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb28fd expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.840512:0:16096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908749d73c00 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:1.0:1788813588.840515:0:16096:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908749d73c00/0x6d74dbab2ddb28f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb28fd expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.840521:0:16096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908749d73c00/0x6d74dbab2ddb28f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb28fd expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813588.840527:0:16096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908749d73c00/0x6d74dbab2ddb28f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb28fd expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813588.840533:0:16096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788813588.840545:0:16096:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff908749d73c00/0x6d74dbab2ddb28f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb28fd expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.840550:0:16096:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813588.840557:0:16096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908749d73c00/0x6d74dbab2ddb28f6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb28fd expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.840574:0:16096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908749d73c00/0x6d74dbab2ddb28f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb28fd expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.840614:0:16096:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813588.840617:0:16096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.147@tcp lock: ffff908774369800/0x6d74dbab2ddb28a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d74dbab2ddb28b0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.840636:0:16096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369800 already unused, calling callback (ffffffffc1b50c20) 10000000:00010000:1.0:1788813588.840638:0:16096:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.147@tcp lock: ffff908774369800/0x6d74dbab2ddb28a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d74dbab2ddb28b0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.840645:0:16096:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.147@tcp lock: ffff908774369800/0x6d74dbab2ddb28a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d74dbab2ddb28b0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788813588.840651:0:16096:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.147@tcp lock: ffff908774369800/0x6d74dbab2ddb28a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d74dbab2ddb28b0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813588.840656:0:16096:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788813588.840670:0:16096:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.147@tcp lock: ffff908774369800/0x6d74dbab2ddb28a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb28b0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.840676:0:16096:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788813588.840692:0:16096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.147@tcp lock: ffff908774369800/0x6d74dbab2ddb28a9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb28b0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.840699:0:16096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.147@tcp lock: ffff908774369800/0x6d74dbab2ddb28a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d74dbab2ddb28b0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.840713:0:16096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813588.840720:0:16096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813588.840722:0:16096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788813588.840728:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813588.840750:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3321:1875706583817344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813588.840788:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813588.840820:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788813588.840826:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3321:1875706583817216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813588.840846:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813588.840871:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3318:1875706583817472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813588.840891:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813588.840916:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583817344 00000100:00100000:1.0:1788813588.840921:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583817344 00010000:00010000:1.0:1788813588.840943:0:14421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff908774369600/0x6d74dbab2ddb28fd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb28f6 expref: 19 pid: 14427 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813588.840957:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583817216 00000100:00100000:1.0:1788813588.840959:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583817216 00010000:00010000:1.0:1788813588.840967:0:14421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9087413a1400/0x6d74dbab2ddb2a38 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb2a31 expref: 20 pid: 14428 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813588.840976:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583817472 00000100:00100000:1.0:1788813588.840978:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583817472 00010000:00010000:1.0:1788813588.840985:0:14421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff908740031400/0x6d74dbab2ddb28b0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb28a9 expref: 21 pid: 14427 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813588.840997:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813588.841003:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642914a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+21:3321:x1875706583817344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813588.841013:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813588.841017:0:14421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff908774369600/0x6d74dbab2ddb28fd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb28f6 expref: 21 pid: 14427 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.841033:0:14421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff908774369600/0x6d74dbab2ddb28fd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb28f6 expref: 21 pid: 14427 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.841050:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813588.841081:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642914a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+21:3321:x1875706583817344:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813588.841088:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788813588.841104:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813588.841110:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642914380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+20:3321:x1875706583817216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813588.841117:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813588.841121:0:14421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9087413a1400/0x6d74dbab2ddb2a38 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb2a31 expref: 20 pid: 14428 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.841129:0:14421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9087413a1400/0x6d74dbab2ddb2a38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb2a31 expref: 20 pid: 14428 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.841138:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813588.841159:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642914380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+20:3321:x1875706583817216:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813588.841165:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788813588.841177:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788813588.841183:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e37ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:3318:x1875706583817472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788813588.841190:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813588.841193:0:14421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff908740031400/0x6d74dbab2ddb28b0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d74dbab2ddb28a9 expref: 19 pid: 14427 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.841201:0:14421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff908740031400/0x6d74dbab2ddb28b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d74dbab2ddb28a9 expref: 19 pid: 14427 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.841216:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813588.841244:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e37ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:3318:x1875706583817472:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813588.841250:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788813588.841306:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642916d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3318:1875706583817472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813588.841330:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3321:1875706583817216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788813588.841337:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642917480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3321:1875706583817344:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788813588.841540:0:16552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9087413a1400/0x6d74dbab2ddb2a38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb2a31 expref: 18 pid: 14428 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813588.841553:0:16552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ef800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16552:1875706583816832:0@lo:104: 00010000:00010000:3.0:1788813588.841562:0:16552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908774369600/0x6d74dbab2ddb28fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb28f6 expref: 17 pid: 14427 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813588.841604:0:16552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16552:1875706583816960:0@lo:104: 00010000:00010000:3.0:1788813588.841617:0:16552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908740031400/0x6d74dbab2ddb28b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d74dbab2ddb28a9 expref: 16 pid: 14427 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813588.841637:0:16552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16552:1875706583817088:0@lo:104: 00010000:00010000:0.0:1788813588.841707:0:16097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813588.853117:0:16552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ec380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16552:1875706583816576:192.168.204.47@tcp:104: 00000100:00100000:3.0:1788813588.853133:0:16552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3efb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16552:1875706583816704:192.168.204.47@tcp:104: 00010000:00010000:3.0:1788813588.853180:0:16552:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff908773c95400/0x6d74dbab2ddb2bb9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813588.857817:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813588.857915:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813588.857997:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562853504 00000100:00100000:1.0:1788813588.858008:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562853504 00010000:00010000:1.0:1788813588.858049:0:14421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90874148da00/0x6d74dbab2ddb2b57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4841b2 expref: 13 pid: 14426 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813588.858083:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562853376 00000100:00100000:1.0:1788813588.858086:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562853376 00010000:00010000:1.0:1788813588.858100:0:14421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9086425df200/0x6d74dbab2ddb2b8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484214 expref: 14 pid: 14428 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813588.858115:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 7 00000100:00100000:1.0:1788813588.858124:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:764df018-de8a-4291-9451-854d34c91a19+14:2359:x1875706562853504:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813588.858140:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813588.858145:0:14421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90874148da00/0x6d74dbab2ddb2b57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4841b2 expref: 14 pid: 14426 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.858156:0:14421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90874148da00/0x6d74dbab2ddb2b57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4841b2 expref: 14 pid: 14426 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.858192:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90874148da00/0x6d74dbab2ddb2b57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4841b2 expref: 14 pid: 14426 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.858207:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813588.858271:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:764df018-de8a-4291-9451-854d34c91a19+13:2359:x1875706562853504:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 147us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813588.858278:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 7 00000100:00100000:1.0:1788813588.858297:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 8 00000100:00100000:1.0:1788813588.858303:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:764df018-de8a-4291-9451-854d34c91a19+12:2359:x1875706562853376:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788813588.858311:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813588.858315:0:14421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9086425df200/0x6d74dbab2ddb2b8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484214 expref: 12 pid: 14428 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.858324:0:14421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9086425df200/0x6d74dbab2ddb2b8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484214 expref: 12 pid: 14428 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.858333:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9086425df200/0x6d74dbab2ddb2b8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484214 expref: 12 pid: 14428 timeout: 631 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.858344:0:14421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff908773c95400/0x6d74dbab2ddb2bb9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.858352:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908773c95400/0x6d74dbab2ddb2bb9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.858366:0:14421:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff908773c95400/0x6d74dbab2ddb2bb9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.858386:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff908773c95400/0x6d74dbab2ddb2bb9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.858393:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff908773c95400/0x6d74dbab2ddb2bb9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.858400:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff908773c95400/0x6d74dbab2ddb2bb9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.858405:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c95400 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813588.858410:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff908773c95400/0x6d74dbab2ddb2bb9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.858417:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff908773c95400/0x6d74dbab2ddb2bb9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.858438:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff908773c95400/0x6d74dbab2ddb2bb9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813588.858448:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788813588.858472:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:764df018-de8a-4291-9451-854d34c91a19+11:2359:x1875706562853376:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 169us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813588.858478:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 8 00010000:00010000:3.0:1788813588.858563:0:16552:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff908773c95400/0x6d74dbab2ddb2bb9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813588.858575:0:16552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff908773c95400/0x6d74dbab2ddb2bb9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813588.858633:0:16552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff908773c95400/0x6d74dbab2ddb2bb9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813589.758926:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788813590.204743:0:14431:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788813590.204752:0:14431:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff908766548800 from 10 10000000:01000000:1.0:1788813590.204758:0:14431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788813590.204812:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148de00/0x6d74dbab2ddb2bc0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813590.204824:0:14431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff90874148de00/0x6d74dbab2ddb2bc0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813590.204847:0:14431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff90874148de00/0x6d74dbab2ddb2bc0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813590.204873:0:14431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642917480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583817600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788813590.204951:0:14431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813590.205005:0:14431:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876f9be900 going to sleep for 11 seconds 00000100:00100000:2.0:1788813590.205112:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583817600 00000100:00100000:2.0:1788813590.205122:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583817600 00000100:00100000:2.0:1788813590.205189:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788813590.205201:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+16:14431:x1875706583817600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813590.205215:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813590.205232:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908774369e00/0x6d74dbab2ddb2bc7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb2bc0 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813590.205258:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908774369e00/0x6d74dbab2ddb2bc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb2bc0 expref: 17 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813590.205270:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908774369e00/0x6d74dbab2ddb2bc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb2bc0 expref: 17 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813590.205278:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369e00, rc 0) 00000100:00100000:2.0:1788813590.205326:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+17:14431:x1875706583817600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813590.205332:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788813590.205393:0:14431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642917480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583817600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813590.205407:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff90874148de00/0x6d74dbab2ddb2bc0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2bc7 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813590.205417:0:14431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff90874148de00/0x6d74dbab2ddb2bc0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb2bc7 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813590.205492:0:14431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583817728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813590.205525:0:14431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813590.205539:0:14431:0:(client.c:2716:ptlrpc_set_wait()) set ffff908748f54840 going to sleep for 11 seconds 00000100:00100000:2.0:1788813590.205552:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583817728 00000100:00100000:2.0:1788813590.205555:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583817728 00000100:00100000:2.0:1788813590.205617:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788813590.205626:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+17:14431:x1875706583817728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813590.205915:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+17:14431:x1875706583817728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 291us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813590.205923:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788813590.205974:0:14431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583817728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813590.206004:0:14431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583817856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813590.206040:0:14431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813590.206053:0:14431:0:(client.c:2716:ptlrpc_set_wait()) set ffff908748f54840 going to sleep for 11 seconds 00000100:00100000:2.0:1788813590.206063:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583817856 00000100:00100000:2.0:1788813590.206067:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583817856 00000100:00100000:2.0:1788813590.206089:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788813590.206095:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+17:14431:x1875706583817856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813590.206244:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+17:14431:x1875706583817856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813590.206252:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788813590.206287:0:14431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583817856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813590.206432:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583818112:0@lo:400:kworker.0 00000100:00100000:3.0:1788813590.206467:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813590.206491:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813590.206498:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583818240:0@lo:400:kworker.0 00000100:00100000:3.0:1788813590.206524:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813590.206543:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583818624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788813590.206568:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813590.206628:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583818368:0@lo:400:kworker.0 00000100:00100000:3.0:1788813590.206645:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583818240 00000100:00100000:3.0:1788813590.206651:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583818240 00000100:00100000:1.0:1788813590.206664:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813590.206701:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788813590.206707:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583817984:0@lo:400:kworker.0 00000100:00100000:1.0:1788813590.206729:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813590.206744:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875706583818496:0@lo:400:kworker.0 00000100:00100000:1.0:1788813590.206762:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813590.206815:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583818112 00000100:00100000:2.0:1788813590.206825:0:15650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583818112 00000100:00100000:2.0:1788813590.206862:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583817984 00000100:00100000:2.0:1788813590.206865:0:15650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583817984 00000100:00100000:2.0:1788813590.206886:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788813590.206893:0:15650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583818112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813590.206934:0:15650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583818112:12345-0@lo:400:kworker.0 Request processed in 41us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813590.206940:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788813590.206952:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788813590.206958:0:15650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583817984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813590.206983:0:15650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642914a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583817984:12345-0@lo:400:kworker.0 Request processed in 26us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813590.206989:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788813590.207008:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788813590.207012:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788813590.207038:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583818112:0@lo:400:kworker.0 00000100:00100000:3.0:1788813590.209992:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583818368 00000100:00100000:3.0:1788813590.210012:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583818368 00000100:00100000:3.0:1788813590.210084:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583818496 00000100:00100000:3.0:1788813590.210317:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583818496 00000100:00100000:0.0:1788813590.210326:0:16090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788813590.210341:0:16090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583818240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813590.210352:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788813590.210361:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583818368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788813590.210442:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875706583818368:12345-0@lo:400:kworker.0 Request processed in 82us (3777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813590.210450:0:16090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875706583818240:12345-0@lo:400:kworker.0 Request processed in 112us (3924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813590.210516:0:14432:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788813590.210526:0:14432:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:2.0:1788813590.210548:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788813590.210735:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788813590.210754:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875706583818240:0@lo:400:kworker.0 00000100:00100000:1.0:1788813590.210968:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875706583818368:0@lo:400:kworker.0 00000100:00100000:1.0:1788813590.210993:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583817984:0@lo:400:kworker.0 00000040:00080000:1.0:1788813590.211751:0:16610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788813590.211807:0:14431:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 00000100:00100000:0.0:1788813590.211818:0:16090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 10000000:01000000:1.0:1788813590.211825:0:14431:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788813590.211835:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148de00/0x6d74dbab2ddb2bc0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2bc7 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813590.211840:0:16090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788813590.211846:0:14431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff90874148de00/0x6d74dbab2ddb2bc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2bc7 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813590.211851:0:16090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875706583818496:12345-0@lo:400:kworker.0 10000000:01000000:1.0:1788813590.211856:0:14431:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788813590.211868:0:14431:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9087466da800 from 10 10000000:01000000:1.0:1788813590.211871:0:14431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000100:00100000:0.0:1788813590.211911:0:16090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875706583818496:12345-0@lo:400:kworker.0 Request processed in 64us (5147us total) trans 0 rc 0/0 00010000:00010000:1.0:1788813590.211913:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148c600/0x6d74dbab2ddb2bce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813590.211917:0:16090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788813590.211921:0:14431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff90874148c600/0x6d74dbab2ddb2bce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813590.211931:0:14431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff90874148c600/0x6d74dbab2ddb2bce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813590.211951:0:14431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583818752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788813590.211951:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875706583818496:0@lo:400:kworker.0 00000100:00100000:1.0:1788813590.211987:0:14431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813590.212017:0:14431:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876f9be900 going to sleep for 11 seconds 00000100:00100000:3.0:1788813590.212020:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583818624 00000100:00100000:3.0:1788813590.212027:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583818624 00000100:00100000:3.0:1788813590.212071:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788813590.212082:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583818624:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788813590.212299:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583818752 00000100:00100000:0.0:1788813590.212305:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583818752 00002000:00000024:3.0:1788813590.212327:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813590.212388:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583818624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 308us (5817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813590.212395:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788813590.212442:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788813590.212450:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+17:14431:x1875706583818752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813590.212458:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813590.212471:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9086425df200/0x6d74dbab2ddb2bd5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb2bce expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813590.212506:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9086425df200/0x6d74dbab2ddb2bd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb2bce expref: 18 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813590.212517:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9086425df200/0x6d74dbab2ddb2bd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb2bce expref: 18 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813590.212525:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9086425df200, rc 0) 00000100:00100000:0.0:1788813590.212557:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+18:14431:x1875706583818752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813590.212563:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788813590.212700:0:14431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583818752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813590.212713:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff90874148c600/0x6d74dbab2ddb2bce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2bd5 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813590.212721:0:14431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff90874148c600/0x6d74dbab2ddb2bce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb2bd5 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813590.212769:0:14431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908643b4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583818880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813590.212795:0:14431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813590.212813:0:14431:0:(client.c:2716:ptlrpc_set_wait()) set ffff908761e85c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813590.213227:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642915500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583818624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788813590.213255:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583818880 00000100:00100000:2.0:1788813590.213260:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583818880 00000100:00100000:2.0:1788813590.213297:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788813590.213304:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+18:14431:x1875706583818880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813590.213560:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+18:14431:x1875706583818880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813590.213576:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788813590.213650:0:14431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908643b4ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583818880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813590.213687:0:14431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583819008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813590.213730:0:14431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813590.213746:0:14431:0:(client.c:2716:ptlrpc_set_wait()) set ffff908748f54780 going to sleep for 11 seconds 00000100:00100000:2.0:1788813590.213761:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583819008 00000100:00100000:2.0:1788813590.213765:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583819008 00000100:00100000:2.0:1788813590.213788:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788813590.213795:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+18:14431:x1875706583819008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813590.215436:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+18:14431:x1875706583819008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1636us (1700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813590.215447:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788813590.215513:0:14431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583819008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788813590.228868:0:16613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788813590.230805:0:14431:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788813590.230829:0:14431:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788813590.230843:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148c600/0x6d74dbab2ddb2bce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2bd5 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813590.230856:0:14431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff90874148c600/0x6d74dbab2ddb2bce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2bd5 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788813590.230867:0:14431:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788813590.230870:0:14431:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90874923c800 from 10 10000000:01000000:1.0:1788813590.230873:0:14431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788813590.230913:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb2bdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813590.230922:0:14431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb2bdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813590.230946:0:14431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb2bdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813590.230972:0:14431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642915f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583819136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788813590.231046:0:14431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813590.231086:0:14431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087412ed600 going to sleep for 11 seconds 00000100:00100000:0.0:1788813590.231127:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583819136 00000100:00100000:0.0:1788813590.231135:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583819136 00000100:00100000:0.0:1788813590.231206:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788813590.231215:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+18:14431:x1875706583819136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813590.231229:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813590.231242:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9086425dec00/0x6d74dbab2ddb2be3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d74dbab2ddb2bdc expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813590.231271:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9086425dec00/0x6d74dbab2ddb2be3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d74dbab2ddb2bdc expref: 19 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813590.231282:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9086425dec00/0x6d74dbab2ddb2be3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d74dbab2ddb2bdc expref: 19 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813590.231291:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9086425dec00, rc 0) 00000100:00100000:0.0:1788813590.231352:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:14431:x1875706583819136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813590.231359:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788813590.231404:0:14431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642915f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583819136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813590.231418:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb2bdc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2be3 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813590.231427:0:14431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb2bdc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d74dbab2ddb2be3 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813590.231472:0:14431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908643b4f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583819264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813590.231494:0:14431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813590.231512:0:14431:0:(client.c:2716:ptlrpc_set_wait()) set ffff908761e850c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813590.233915:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583819264 00000100:00100000:2.0:1788813590.233932:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583819264 00000100:00100000:2.0:1788813590.233993:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788813590.234004:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:14431:x1875706583819264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788813590.236010:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:14431:x1875706583819264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2002us (4508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813590.236023:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788813590.236160:0:14431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908643b4f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583819264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788813590.236213:0:14431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908643b4f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583819392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788813590.236266:0:14431:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813590.236313:0:14431:0:(client.c:2716:ptlrpc_set_wait()) set ffff908761e850c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788813590.236414:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583819392 00000100:00100000:2.0:1788813590.236421:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583819392 00000100:00100000:2.0:1788813590.236467:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788813590.236476:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:14431:x1875706583819392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813590.236687:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:14431:x1875706583819392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 212us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813590.236694:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788813590.247023:0:14431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908643b4f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7dbbe9e7-bc92-4769-ab24-5734c43403ec:14431:1875706583819392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788813590.248412:0:16615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788813590.248471:0:14431:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788813590.248490:0:14431:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788813590.248502:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb2bdc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2be3 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813590.248514:0:14431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.147@tcp lock: ffff90874148c000/0x6d74dbab2ddb2bdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d74dbab2ddb2be3 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813590.275023:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813590.275057:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562853632 00000100:00100000:2.0:1788813590.275067:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562853632 00000100:00100000:2.0:1788813590.275113:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 112 00000100:00100000:2.0:1788813590.275123:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:764df018-de8a-4291-9451-854d34c91a19+11:13756:x1875706562853632:12345-192.168.204.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788813590.275139:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813590.275157:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff908774368200/0x6d74dbab2ddb2bea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x31ee63787e484245 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813590.275186:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff908774368200/0x6d74dbab2ddb2bea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484245 expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813590.275197:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff908774368200/0x6d74dbab2ddb2bea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484245 expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813590.275207:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368200, rc 0) 00000100:00100000:2.0:1788813590.275258:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:764df018-de8a-4291-9451-854d34c91a19+12:13756:x1875706562853632:12345-192.168.204.47@tcp:101:ll_cfg_requeue.0 Request processed in 137us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813590.275266:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 112 00000100:00100000:2.0:1788813590.281075:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813590.282844:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562853760 00000100:00100000:3.0:1788813590.282859:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562853760 00000100:00100000:3.0:1788813590.282920:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 113 00000100:00100000:3.0:1788813590.282932:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:764df018-de8a-4291-9451-854d34c91a19+12:13756:x1875706562853760:12345-192.168.204.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813590.283626:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:764df018-de8a-4291-9451-854d34c91a19+12:13756:x1875706562853760:12345-192.168.204.47@tcp:501:ll_cfg_requeue.0 Request processed in 692us (2555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813590.283636:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 113 00000100:00100000:1.0:1788813590.288143:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813590.288202:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562853888 00000100:00100000:3.0:1788813590.288211:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562853888 00000100:00100000:3.0:1788813590.288273:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 114 00000100:00100000:3.0:1788813590.288282:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:764df018-de8a-4291-9451-854d34c91a19+12:13756:x1875706562853888:12345-192.168.204.47@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788813590.288495:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:764df018-de8a-4291-9451-854d34c91a19+12:13756:x1875706562853888:12345-192.168.204.47@tcp:503:ll_cfg_requeue.0 Request processed in 213us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813590.288503:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 114 00000100:00100000:2.0:1788813590.306841:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813590.306919:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562854016 00000100:00100000:0.0:1788813590.306929:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562854016 00000100:00100000:0.0:1788813590.306986:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 115 00000100:00100000:0.0:1788813590.306997:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:764df018-de8a-4291-9451-854d34c91a19+12:13756:x1875706562854016:12345-192.168.204.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788813590.307014:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813590.307031:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9086425de200/0x6d74dbab2ddb2bf1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x31ee63787e48424c expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813590.307060:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9086425de200/0x6d74dbab2ddb2bf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48424c expref: 13 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813590.307072:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9086425de200/0x6d74dbab2ddb2bf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48424c expref: 13 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813590.307081:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9086425de200, rc 0) 00000100:00100000:0.0:1788813590.307135:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:764df018-de8a-4291-9451-854d34c91a19+13:13756:x1875706562854016:12345-192.168.204.47@tcp:101:ll_cfg_requeue.0 Request processed in 139us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813590.307142:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 115 00000100:00100000:2.0:1788813590.324197:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813590.326110:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562854144 00000100:00100000:3.0:1788813590.326127:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562854144 00000100:00100000:3.0:1788813590.326194:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 116 00000100:00100000:3.0:1788813590.326206:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:764df018-de8a-4291-9451-854d34c91a19+13:13756:x1875706562854144:12345-192.168.204.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788813590.329320:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:764df018-de8a-4291-9451-854d34c91a19+13:13756:x1875706562854144:12345-192.168.204.47@tcp:501:ll_cfg_requeue.0 Request processed in 3105us (5123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813590.329334:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 116 00000100:00100000:0.0:1788813590.341177:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813590.341290:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562854272 00000100:00100000:2.0:1788813590.341301:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562854272 00000100:00100000:2.0:1788813590.341367:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 117 00000100:00100000:2.0:1788813590.341377:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:764df018-de8a-4291-9451-854d34c91a19+13:13756:x1875706562854272:12345-192.168.204.47@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788813590.341613:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:764df018-de8a-4291-9451-854d34c91a19+13:13756:x1875706562854272:12345-192.168.204.47@tcp:503:ll_cfg_requeue.0 Request processed in 203us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813590.341622:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 117 00010000:00010000:1.0:1788813590.781747:0:16096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788813591.229172:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788813591.229196:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876eb73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583819520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788813591.229263:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788813591.229744:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583819520 00000100:00100000:3.0:1788813591.229752:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583819520 00000100:00100000:3.0:1788813591.229797:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788813591.229806:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583819520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788813591.229839:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788813591.229890:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583819520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813591.229897:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788813591.233746:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876eb73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583819520:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788813591.804857:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788813592.189974:0:14468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788813592.450872:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813592.450909:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813592.450941:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813592.450979:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813592.450999:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813592.451017:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813592.451055:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813592.451103:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562854656 00000100:00100000:2.0:1788813592.451112:0:15650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562854656 00000100:00100000:2.0:1788813592.451164:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562855168 00000100:00100000:2.0:1788813592.451166:0:15650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562855168 00000100:00100000:2.0:1788813592.451178:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562854784 00000100:00100000:2.0:1788813592.451181:0:15650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562854784 00000100:00100000:2.0:1788813592.451193:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562855040 00000100:00100000:2.0:1788813592.451195:0:15650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562855040 00000100:00100000:2.0:1788813592.451210:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 11 00000100:00100000:2.0:1788813592.451219:0:15650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+5:2361:x1875706562854656:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:0.0:1788813592.451275:0:15649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 12 00000100:00100000:0.0:1788813592.451284:0:15649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c86e9881-1962-411f-a069-94fc48e23217+5:2361:x1875706562855168:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813592.451287:0:15650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+5:2361:x1875706562854656:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 70us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813592.451295:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 11 00000100:00100000:0.0:1788813592.451309:0:15649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c86e9881-1962-411f-a069-94fc48e23217+5:2361:x1875706562855168:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 29us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813592.451315:0:15649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 12 00000100:00100000:3.0:1788813592.451364:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562854400 00000100:00100000:3.0:1788813592.451368:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562854400 00000100:00100000:3.0:1788813592.451395:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 118 00000100:00100000:3.0:1788813592.451402:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:764df018-de8a-4291-9451-854d34c91a19+13:2361:x1875706562854400:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:3.0:1788813592.451434:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:764df018-de8a-4291-9451-854d34c91a19+13:2361:x1875706562854400:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 33us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813592.451440:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 118 00000100:00100000:3.0:1788813592.451489:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 13 00000100:00100000:3.0:1788813592.451496:0:15119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+5:2361:x1875706562854784:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:3.0:1788813592.451517:0:15119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+5:2361:x1875706562854784:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 23us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813592.451523:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 13 00000100:00100000:2.0:1788813592.451563:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 14 00000100:00100000:2.0:1788813592.451571:0:15650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c86e9881-1962-411f-a069-94fc48e23217+5:2361:x1875706562855040:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813592.451629:0:15650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c86e9881-1962-411f-a069-94fc48e23217+5:2361:x1875706562855040:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 59us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813592.451635:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 14 00000100:00100000:1.0:1788813592.451690:0:16090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562854912 00000100:00100000:1.0:1788813592.451694:0:16090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562854912 00000100:00100000:1.0:1788813592.451721:0:16090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562854528 00000100:00100000:1.0:1788813592.451724:0:16090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562854528 00000100:00100000:1.0:1788813592.451747:0:16090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 22 00000100:00100000:1.0:1788813592.451753:0:16090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c86e9881-1962-411f-a069-94fc48e23217+6:2361:x1875706562854912:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813592.451781:0:16090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c86e9881-1962-411f-a069-94fc48e23217+6:2361:x1875706562854912:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 29us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813592.451786:0:16090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 22 00000100:00100000:1.0:1788813592.451799:0:16090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 23 00000100:00100000:1.0:1788813592.451804:0:16090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876eb70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:174ca40a-6963-45bf-98f2-c54b8bfcdb58+6:2361:x1875706562854528:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:1.0:1788813592.451824:0:16090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876eb70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:174ca40a-6963-45bf-98f2-c54b8bfcdb58+6:2361:x1875706562854528:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 20us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813592.451829:0:16090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 23 00000100:00080000:1.0:1788813592.451975:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788813592.451980:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788813592.451982:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813592.765491:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813592.765787:0:16611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562855296 00000100:00100000:0.0:1788813592.765798:0:16611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562855296 00000100:00100000:0.0:1788813592.765862:0:16611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 15 00000100:00100000:0.0:1788813592.765873:0:16611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+6:14415:x1875706562855296:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788813592.765895:0:16611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813592.765919:0:16611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de000/0x6d74dbab2ddb2bf8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484253 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813592.765986:0:16611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df000/0x6d74dbab2ddb2bff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813592.766001:0:16611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df000/0x6d74dbab2ddb2bff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813592.766018:0:16611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df000/0x6d74dbab2ddb2bff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813592.766033:0:16611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfc00/0x6d74dbab2ddb2c06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813592.766051:0:16611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfc00/0x6d74dbab2ddb2c06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813592.766057:0:16611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfc00/0x6d74dbab2ddb2c06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813592.766372:0:16611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de400/0x6d74dbab2ddb2c0d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813592.766381:0:16611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de400/0x6d74dbab2ddb2c0d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813592.766387:0:16611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de400/0x6d74dbab2ddb2c0d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813592.766411:0:16611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788813592.766414:0:16611:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788813592.766448:0:16611:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de400/0x6d74dbab2ddb2c0d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813592.766459:0:16611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df000/0x6d74dbab2ddb2bff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813592.766466:0:16611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df000/0x6d74dbab2ddb2bff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813592.766472:0:16611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df000/0x6d74dbab2ddb2bff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813592.766478:0:16611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9086425df000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813592.766483:0:16611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df000/0x6d74dbab2ddb2bff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813592.766490:0:16611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df000/0x6d74dbab2ddb2bff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813592.766500:0:16611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908742cc6600) 00010000:00010000:0.0:1788813592.766509:0:16611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813592.766514:0:16611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df000/0x6d74dbab2ddb2bff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813592.766520:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df000/0x6d74dbab2ddb2bff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813592.766531:0:16611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfc00/0x6d74dbab2ddb2c06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813592.766536:0:16611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfc00/0x6d74dbab2ddb2c06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813592.766542:0:16611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfc00/0x6d74dbab2ddb2c06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813592.766558:0:16611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9086425dfc00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813592.766561:0:16611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfc00/0x6d74dbab2ddb2c06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813592.766566:0:16611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfc00/0x6d74dbab2ddb2c06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813592.766573:0:16611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff908752736900) 00010000:00010000:0.0:1788813592.766575:0:16611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813592.766578:0:16611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfc00/0x6d74dbab2ddb2c06 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813592.766635:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfc00/0x6d74dbab2ddb2c06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813592.766672:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de000/0x6d74dbab2ddb2bf8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484253 expref: 8 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813592.766696:0:16611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de400/0x6d74dbab2ddb2c0d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484253 expref: 7 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813592.766704:0:16611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff908752736e00) 00010000:00010000:0.0:1788813592.766706:0:16611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788813592.766708:0:16611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9086425de400, rc 0) 00000100:00100000:0.0:1788813592.767015:0:16611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+7:14415:x1875706562855296:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 1143us (1533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813592.767023:0:16611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 15 00000100:00100000:1.0:1788813592.772129:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813592.772368:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562855552 00000100:00100000:2.0:1788813592.772379:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562855552 00000100:00100000:2.0:1788813592.772445:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 16 00000100:00100000:2.0:1788813592.772456:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+7:14415:x1875706562855552:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813592.772478:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813592.772502:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb2c14 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e48425a expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.772641:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2c1b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.772656:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2c1b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.772667:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2c1b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.772724:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2c22 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.772731:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2c22 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.772756:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2c22 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.773479:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2c29 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.773493:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2c29 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.773502:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2c29 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813592.773511:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788813592.773837:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2c1b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.773845:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2c1b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.773851:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2c1b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.773858:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369a00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813592.773862:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2c1b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.773869:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2c1b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.773880:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff908752736e00) 00010000:00010000:2.0:1788813592.773883:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813592.773894:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2c1b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.773900:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2c1b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.773913:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2c22 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.773919:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2c22 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.773925:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2c22 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.773930:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813592.773932:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2c22 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.773939:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2c22 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.773947:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff908743ce0b00) 00010000:00010000:2.0:1788813592.773949:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813592.773952:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2c22 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.773957:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2c22 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.775787:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb2c14 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48425a expref: 10 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.775827:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369600/0x6d74dbab2ddb2c29 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48425a expref: 9 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.775835:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff908743ce0f00) 00010000:00010000:2.0:1788813592.775838:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813592.775841:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369600, rc 0) 00000100:00100000:2.0:1788813592.775963:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+9:14415:x1875706562855552:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 3508us (3844us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788813592.775973:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 16 00000100:00100000:2.0:1788813592.797512:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813592.797850:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562855680 00000100:00100000:3.0:1788813592.797861:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562855680 00000100:00100000:3.0:1788813592.797928:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 17 00000100:00100000:3.0:1788813592.797938:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+9:14415:x1875706562855680:12345-192.168.204.47@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788813592.798055:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+9:14415:x1875706562855680:12345-192.168.204.47@tcp:59:lhsmtool_posix.0 Request processed in 118us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813592.798061:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 17 00010000:00010000:0.0:1788813592.829234:0:16097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788813592.845829:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813592.845917:0:16090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562855808 00000100:00100000:1.0:1788813592.845927:0:16090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562855808 00000100:00100000:1.0:1788813592.845984:0:16090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 18 00000100:00100000:1.0:1788813592.845993:0:16090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:174ca40a-6963-45bf-98f2-c54b8bfcdb58+9:14421:x1875706562855808:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:1.0:1788813592.846014:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813592.846031:0:16090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2c37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484261 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.846112:0:16090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2c3e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.846126:0:16090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2c3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.846137:0:16090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2c3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.846151:0:16090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb2c45 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.846158:0:16090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb2c45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.846164:0:16090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb2c45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.846336:0:16090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2c3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.846344:0:16090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2c3e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.846360:0:16090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2c3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.846366:0:16090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148d800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813592.846370:0:16090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2c3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.846377:0:16090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2c3e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.846388:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908742cc6600) 00010000:00010000:1.0:1788813592.846391:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813592.846395:0:16090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2c3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.846402:0:16090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2c3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.846414:0:16090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb2c45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.846419:0:16090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb2c45 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.846423:0:16090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb2c45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.846428:0:16090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148c400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813592.846430:0:16090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb2c45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.846444:0:16090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb2c45 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.846451:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff908742cc6900) 00010000:00010000:1.0:1788813592.846454:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813592.846456:0:16090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb2c45 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.846462:0:16090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb2c45 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.846493:0:16090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2c37 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484261 expref: 10 pid: 16090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.846501:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908742cc6600) 00010000:00010000:1.0:1788813592.846503:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813592.846506:0:16090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2c37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484261 expref: 10 pid: 16090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.846515:0:16090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148d200, rc 0) 00000100:00100000:1.0:1788813592.846803:0:16090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:174ca40a-6963-45bf-98f2-c54b8bfcdb58+9:14421:x1875706562855808:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 809us (981us total) trans 0 rc 301/301 00000100:00100000:1.0:1788813592.846810:0:16090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 18 00000100:00100000:2.0:1788813592.853596:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813592.853704:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562855936 00000100:00100000:3.0:1788813592.853715:0:14443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562855936 00000100:00100000:3.0:1788813592.853768:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 0 00000100:00100000:3.0:1788813592.853779:0:14443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+9:14421:x1875706562855936:12345-192.168.204.47@tcp:700:lfs.0 00000100:00100000:3.0:1788813592.853927:0:14443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+9:14421:x1875706562855936:12345-192.168.204.47@tcp:700:lfs.0 Request processed in 149us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813592.853934:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 0 00000100:00100000:2.0:1788813592.857015:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813592.857302:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562856192 00000100:00100000:1.0:1788813592.857312:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562856192 00000100:00100000:1.0:1788813592.857409:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 19 00000100:00100000:1.0:1788813592.857420:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+9:14421:x1875706562856192:12345-192.168.204.47@tcp:36:lfs.0 00010000:00010000:1.0:1788813592.857491:0:14432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813592.857518:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ca00/0x6d74dbab2ddb2b7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4841dc expref: 9 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.857539:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908742cc6600) 00010000:00010000:1.0:1788813592.857556:0:14432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788813592.857815:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2c4c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.857830:0:14432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369c00/0x6d74dbab2ddb2bb2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48423e expref: 5 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.857840:0:14432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2c4c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.857873:0:14432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908774369c00/0x6d74dbab2ddb2bb2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48423e expref: 5 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.857886:0:14432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369c00/0x6d74dbab2ddb2bb2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48423e expref: 5 pid: 14432 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813592.857901:0:14432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14432:1875706583819648:192.168.204.47@tcp:104: 00000100:00100000:1.0:1788813592.857982:0:14432:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876f9be900 going to sleep for 11 seconds 00000100:00100000:0.0:1788813592.861348:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813592.861420:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562856320 00000100:00100000:3.0:1788813592.861429:0:14419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562856320 00010000:00010000:3.0:1788813592.861482:0:14419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369c00/0x6d74dbab2ddb2bb2 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48423e expref: 6 pid: 14432 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813592.861527:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 9 00000100:00100000:3.0:1788813592.861537:0:14419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c86e9881-1962-411f-a069-94fc48e23217+6:2359:x1875706562856320:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813592.861566:0:14419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813592.861573:0:14419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908774369c00/0x6d74dbab2ddb2bb2 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48423e expref: 6 pid: 14432 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.861605:0:14419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908774369c00/0x6d74dbab2ddb2bb2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48423e expref: 6 pid: 14432 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.861626:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908742cc6600) 00010000:00010000:3.0:1788813592.861632:0:14419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2c4c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.861641:0:14419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2c4c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.861648:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2c4c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.861667:0:14419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813592.861721:0:14419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c86e9881-1962-411f-a069-94fc48e23217+6:2359:x1875706562856320:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 184us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813592.861728:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 9 00010000:00010000:1.0:1788813592.862948:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369c00/0x6d74dbab2ddb2bb2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48423e expref: 5 pid: 14432 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813592.862972:0:14432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908642914000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14432:1875706583819648:192.168.204.47@tcp:104: 00010000:00010000:1.0:1788813592.862995:0:14432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2c4c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.863017:0:14432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2c4c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.863023:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2c4c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.863396:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2c53 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.863410:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2c53 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.863420:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2c53 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813592.865420:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788813592.865436:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2c4c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.865448:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2c4c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.865455:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2c4c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.865462:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148cc00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813592.865467:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2c4c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.865475:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2c4c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.865504:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908742cc6600) 00010000:00010000:1.0:1788813592.865507:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813592.865513:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2c4c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.865519:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2c4c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788813592.865553:0:14432:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fde03002 reply state 00000000f87d315f transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2c53 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813592.865562:0:14432:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788813592.865751:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+10:14421:x1875706562856192:12345-192.168.204.47@tcp:36:lfs.0 Request processed in 8330us (8743us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788813592.865761:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 19 00010000:00010000:1.0:1788813592.872577:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2c53 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.872633:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2c53 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.872642:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2c53 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.872648:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148d200 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813592.872653:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2c53 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.872661:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2c53 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.872693:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff908742cc6900) 00010000:00010000:1.0:1788813592.872696:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813592.872701:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2c53 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.872708:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2c53 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813592.942101:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813592.942208:0:16611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562856448 00000100:00100000:2.0:1788813592.942218:0:16611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562856448 00000100:00100000:2.0:1788813592.942285:0:16611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 20 00000100:00100000:2.0:1788813592.942295:0:16611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+9:14429:x1875706562856448:12345-192.168.204.47@tcp:101:lctl.0 00010000:00010000:2.0:1788813592.942317:0:16611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813592.942339:0:16611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2c5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484268 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.942417:0:16611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2c61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.942431:0:16611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2c61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.942443:0:16611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2c61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813592.942498:0:16611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788813592.942502:0:16611:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788813592.942551:0:16611:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2c61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.942604:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2c5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484268 expref: 11 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.942624:0:16611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369a00/0x6d74dbab2ddb2c61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484268 expref: 10 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813592.942632:0:16611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908743ce0b00) 00010000:00010000:2.0:1788813592.942634:0:16611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813592.942637:0:16611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369a00, rc 0) 00000100:00100000:2.0:1788813592.942703:0:16611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+10:14429:x1875706562856448:12345-192.168.204.47@tcp:101:lctl.0 Request processed in 409us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813592.942710:0:16611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 20 00000100:00100000:0.0:1788813592.974288:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813592.974464:0:16090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562856576 00000100:00100000:1.0:1788813592.974476:0:16090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562856576 00000100:00100000:1.0:1788813592.974549:0:16090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 21 00000100:00100000:1.0:1788813592.974561:0:16090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c86e9881-1962-411f-a069-94fc48e23217+5:14430:x1875706562856576:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:1.0:1788813592.974622:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813592.974644:0:16090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2c68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e48426f expref: -99 pid: 16090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.974707:0:16090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ca00/0x6d74dbab2ddb2c6f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.974720:0:16090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ca00/0x6d74dbab2ddb2c6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.974733:0:16090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ca00/0x6d74dbab2ddb2c6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813592.974772:0:16090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788813592.974775:0:16090:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813592.974791:0:16090:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ca00/0x6d74dbab2ddb2c6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.974833:0:16090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2c68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48426f expref: 7 pid: 16090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.974851:0:16090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ca00/0x6d74dbab2ddb2c6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48426f expref: 6 pid: 16090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.974859:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908743ce0b00) 00010000:00010000:1.0:1788813592.974861:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813592.974865:0:16090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148ca00, rc 0) 00000100:00100000:1.0:1788813592.974920:0:16090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c86e9881-1962-411f-a069-94fc48e23217+6:14430:x1875706562856576:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 362us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813592.974927:0:16090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 21 00000100:00100000:1.0:1788813592.978660:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813592.978741:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562856704 00000100:00100000:3.0:1788813592.978751:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562856704 00000100:00100000:3.0:1788813592.978809:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 22 00000100:00100000:3.0:1788813592.978833:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c86e9881-1962-411f-a069-94fc48e23217+6:14430:x1875706562856704:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:3.0:1788813592.978853:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813592.978876:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb2c76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484276 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.978932:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb2c7d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.978946:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb2c7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.978957:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb2c7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.978969:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2c84 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.978975:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2c84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.978982:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2c84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.979229:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2c8b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.979237:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2c8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.979244:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2c8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813592.979284:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788813592.979288:0:14432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813592.979311:0:14432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2c8b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.979323:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb2c7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.979330:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb2c7d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.979337:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb2c7d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.979343:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c95400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813592.979347:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb2c7d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.979354:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb2c7d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.979366:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908743ce0b00) 00010000:00010000:3.0:1788813592.979369:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813592.979373:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb2c7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.979380:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb2c7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.979393:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2c84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.979670:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2c84 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.979677:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2c84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.979682:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c94c00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813592.979685:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2c84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.979692:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2c84 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.979701:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff908745aca400) 00010000:00010000:3.0:1788813592.979703:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813592.979706:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2c84 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.979712:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2c84 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.979748:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb2c76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484276 expref: 8 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.979763:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2c8b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484276 expref: 7 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.979771:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff908745acad00) 00010000:00010000:3.0:1788813592.979773:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788813592.979782:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c94e00, rc 0) 00000100:00100000:3.0:1788813592.979902:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c86e9881-1962-411f-a069-94fc48e23217+7:14430:x1875706562856704:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 1071us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813592.979909:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 22 00000100:00100000:0.0:1788813592.984662:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813592.984812:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562856960 00000100:00100000:1.0:1788813592.984822:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562856960 00000100:00100000:1.0:1788813592.984866:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 23 00000100:00100000:1.0:1788813592.984875:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c86e9881-1962-411f-a069-94fc48e23217+7:14430:x1875706562856960:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:1.0:1788813592.984894:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813592.984914:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2c92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e48427d expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813592.985001:0:14435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788813592.985149:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2c92 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48427d expref: 9 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.985163:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908743ce0b00) 00010000:00010000:1.0:1788813592.985179:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788813592.985185:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2c92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48427d expref: 9 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813592.985198:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148cc00, rc 0) 00000100:00100000:1.0:1788813592.985504:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c86e9881-1962-411f-a069-94fc48e23217+8:14430:x1875706562856960:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 629us (850us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788813592.985512:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 23 00000100:00100000:1.0:1788813592.994684:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813592.994770:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562857216 00000100:00100000:3.0:1788813592.994779:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562857216 00000100:00100000:3.0:1788813592.994867:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 24 00000100:00100000:3.0:1788813592.994877:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c86e9881-1962-411f-a069-94fc48e23217+8:14430:x1875706562857216:12345-192.168.204.47@tcp:36:lfs.0 00010000:00010000:3.0:1788813592.994930:0:14436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813592.994959:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2c8b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484276 expref: 8 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.994975:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff908745acad00) 00010000:00010000:3.0:1788813592.994984:0:14436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813592.995007:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb2ca0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.995021:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb2ca0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813592.995031:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb2ca0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788813592.995265:0:14436:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000035aed69c reply state 000000000328f7fe transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb2ca0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813592.995275:0:14436:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788813592.995282:0:14436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788813592.995364:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c86e9881-1962-411f-a069-94fc48e23217+9:14430:x1875706562857216:12345-192.168.204.47@tcp:36:lfs.0 Request processed in 488us (690us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788813592.995387:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 24 00000100:00100000:2.0:1788813592.998892:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813592.999776:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562857472 00000100:00100000:3.0:1788813592.999789:0:14437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562857472 00000100:00100000:3.0:1788813592.999889:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 2 00000100:00100000:3.0:1788813592.999901:0:14437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c86e9881-1962-411f-a069-94fc48e23217+9:14430:x1875706562857472:12345-192.168.204.47@tcp:35:lfs.0 00010000:00010000:0.0:1788813593.000221:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb2ca0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.000234:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb2ca0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.000243:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb2ca0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.000250:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c94800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813593.000255:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb2ca0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.000281:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb2ca0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.000298:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff908745aca400) 00010000:00010000:0.0:1788813593.000301:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788813593.000306:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb2ca0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.000313:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94800/0x6d74dbab2ddb2ca0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813593.000455:0:14437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c86e9881-1962-411f-a069-94fc48e23217+9:14430:x1875706562857472:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 555us (1575us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788813593.000464:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 2 00000100:00100000:0.0:1788813593.004381:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813593.004553:0:16611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562857728 00000100:00100000:2.0:1788813593.004563:0:16611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562857728 00000100:00100000:2.0:1788813593.004658:0:16611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 25 00000100:00100000:2.0:1788813593.004668:0:16611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c86e9881-1962-411f-a069-94fc48e23217+9:14430:x1875706562857728:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:2.0:1788813593.004695:0:16611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813593.004718:0:16611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369000/0x6d74dbab2ddb2ca7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484284 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.004795:0:16611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2cae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.004822:0:16611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2cae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.004834:0:16611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2cae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.004848:0:16611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb2cb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.004854:0:16611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb2cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.004861:0:16611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb2cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813593.004990:0:16611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788813593.005118:0:16611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2cae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.005126:0:16611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2cae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.005133:0:16611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2cae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.005140:0:16611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813593.005145:0:16611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2cae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.005154:0:16611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2cae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.005181:0:16611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908743ce0b00) 00010000:00010000:2.0:1788813593.005184:0:16611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813593.005189:0:16611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2cae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.005195:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2cae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.005210:0:16611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb2cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.005217:0:16611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb2cb5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.005222:0:16611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb2cb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.005228:0:16611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813593.005231:0:16611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb2cb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.005236:0:16611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb2cb5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.005244:0:16611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff908743ce0d00) 00010000:00010000:2.0:1788813593.005246:0:16611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813593.005249:0:16611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb2cb5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.005255:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb2cb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.005307:0:16611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369000/0x6d74dbab2ddb2ca7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484284 expref: 11 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.005316:0:16611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908743ce0b00) 00010000:00010000:2.0:1788813593.005319:0:16611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813593.005323:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369000/0x6d74dbab2ddb2ca7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484284 expref: 11 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.005332:0:16611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369000, rc 0) 00000100:00100000:2.0:1788813593.005393:0:16611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c86e9881-1962-411f-a069-94fc48e23217+10:14430:x1875706562857728:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 726us (1022us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788813593.005629:0:16611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 25 00000100:00100000:0.0:1788813593.009943:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813593.010553:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562857856 00000100:00100000:1.0:1788813593.010567:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562857856 00000100:00100000:1.0:1788813593.012500:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 26 00000100:00100000:1.0:1788813593.012515:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c86e9881-1962-411f-a069-94fc48e23217+10:14430:x1875706562857856:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:1.0:1788813593.012552:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813593.012597:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2cc3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e48428b expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813593.012684:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2cca lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813593.012700:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2cca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813593.012712:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2cca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813593.012740:0:14435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788813593.012744:0:14435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813593.012761:0:14435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2cca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813593.012802:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2cc3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48428b expref: 12 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813593.012821:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2cca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48428b expref: 11 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813593.012829:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff908742cc6900) 00010000:00010000:1.0:1788813593.012833:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788813593.012836:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148ce00, rc 0) 00000100:00100000:1.0:1788813593.012897:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c86e9881-1962-411f-a069-94fc48e23217+11:14430:x1875706562857856:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 386us (2965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813593.012903:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 26 00000100:00100000:1.0:1788813593.017468:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813593.017643:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562857984 00000100:00100000:0.0:1788813593.017653:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562857984 00000100:00100000:0.0:1788813593.017712:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 3 00000100:00100000:0.0:1788813593.017721:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c86e9881-1962-411f-a069-94fc48e23217+11:14430:x1875706562857984:12345-192.168.204.47@tcp:37:lfs.0 00000100:00100000:1.0:1788813593.023318:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c86e9881-1962-411f-a069-94fc48e23217+11:14430:x1875706562857984:12345-192.168.204.47@tcp:37:lfs.0 Request processed in 5587us (5849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813593.023331:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 3 00000100:00100000:1.0:1788813593.027505:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813593.027693:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562858240 00000100:00100000:3.0:1788813593.027703:0:14437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562858240 00000100:00100000:2.0:1788813593.027861:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 4 00000100:00100000:2.0:1788813593.027872:0:14437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9086413e5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c86e9881-1962-411f-a069-94fc48e23217+11:14430:x1875706562858240:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:2.0:1788813593.028234:0:14437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9086413e5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c86e9881-1962-411f-a069-94fc48e23217+12:14430:x1875706562858240:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 362us (736us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788813593.028242:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 4 00000100:00100000:2.0:1788813593.082269:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813593.082359:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562858368 00000100:00100000:3.0:1788813593.082370:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562858368 00000100:00100000:3.0:1788813593.082442:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 27 00000100:00100000:3.0:1788813593.082453:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+10:14436:x1875706562858368:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:3.0:1788813593.082474:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813593.082501:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2cd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484292 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.082620:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2cd8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.082634:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2cd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.082646:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2cd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.082660:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb2cdf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.082680:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb2cdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.082686:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb2cdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.082770:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb2ce6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.082789:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb2ce6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.082796:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb2ce6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813593.082827:0:14436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788813593.082830:0:14436:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813593.082869:0:14436:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb2ce6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.082881:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2cd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.082887:0:14436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2cd8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.082894:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2cd8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.082899:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c94c00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813593.082904:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2cd8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.082918:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2cd8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.082929:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908743ce0b00) 00010000:00010000:3.0:1788813593.082932:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813593.082937:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2cd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.082942:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2cd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.082955:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb2cdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.082960:0:14436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb2cdf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.082966:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb2cdf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.082970:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c95400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813593.082973:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb2cdf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.082978:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb2cdf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.082984:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff908745acad00) 00010000:00010000:3.0:1788813593.082986:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788813593.082988:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb2cdf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.083002:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb2cdf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.083030:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2cd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484292 expref: 12 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.083043:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95000/0x6d74dbab2ddb2ce6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484292 expref: 11 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.083049:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff908742cc6900) 00010000:00010000:3.0:1788813593.083051:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788813593.083054:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c95000, rc 0) 00000100:00100000:3.0:1788813593.083121:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+11:14436:x1875706562858368:12345-192.168.204.47@tcp:101:bash.0 Request processed in 669us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813593.083128:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 27 00000100:00100000:0.0:1788813593.089795:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813593.089909:0:16090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562858624 00000100:00100000:2.0:1788813593.089920:0:16090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562858624 00000100:00100000:2.0:1788813593.089981:0:16090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 28 00000100:00100000:2.0:1788813593.089991:0:16090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:174ca40a-6963-45bf-98f2-c54b8bfcdb58+11:14436:x1875706562858624:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:2.0:1788813593.090014:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813593.090044:0:16090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb2ced lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484299 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.090218:0:16090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2cf4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.090234:0:16090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2cca lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48428b expref: 11 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.090243:0:16090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2cf4 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.090283:0:16090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2cca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48428b expref: 11 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.090297:0:16090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2cca lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48428b expref: 11 pid: 14435 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813593.090311:0:16090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90876f9abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1875706583819776:192.168.204.47@tcp:104: 00000100:00100000:2.0:1788813593.090409:0:16090:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876faa0240 going to sleep for 11 seconds 00000100:00100000:1.0:1788813593.094757:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813593.095235:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562858752 00000100:00100000:0.0:1788813593.095246:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562858752 00010000:00010000:0.0:1788813593.095289:0:14420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2cca lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48428b expref: 12 pid: 14435 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813593.095339:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 10 00000100:00100000:0.0:1788813593.095349:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642914e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c86e9881-1962-411f-a069-94fc48e23217+12:2359:x1875706562858752:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813593.095367:0:14420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813593.095373:0:14420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2cca lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48428b expref: 12 pid: 14435 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.095419:0:14420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2cca lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48428b expref: 12 pid: 14435 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.095443:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff908742cc6900) 00010000:00010000:0.0:1788813593.095449:0:14420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2cf4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.095461:0:14420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2cf4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.095470:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2cf4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.095492:0:14420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813593.095561:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642914e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c86e9881-1962-411f-a069-94fc48e23217+12:2359:x1875706562858752:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 214us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813593.095569:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 10 00010000:00010000:2.0:1788813593.102502:0:16090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2cca lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48428b expref: 11 pid: 14435 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813593.102529:0:16090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90876f9abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16090:1875706583819776:192.168.204.47@tcp:104: 00010000:00010000:2.0:1788813593.102575:0:16090:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2cf4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.102617:0:16090:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2cf4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.102643:0:16090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2cf4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.102667:0:16090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369200/0x6d74dbab2ddb2cfb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.102680:0:16090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369200/0x6d74dbab2ddb2cfb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.102691:0:16090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369200/0x6d74dbab2ddb2cfb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.105385:0:16090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369000/0x6d74dbab2ddb2d02 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.105959:0:16090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369000/0x6d74dbab2ddb2d02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.105977:0:16090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369000/0x6d74dbab2ddb2d02 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813593.105990:0:16090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788813593.110729:0:16090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2cf4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.110747:0:16090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2cf4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.110756:0:16090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2cf4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.110762:0:16090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813593.110767:0:16090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2cf4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.110936:0:16090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2cf4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.110953:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff908742cc6900) 00010000:00010000:0.0:1788813593.110956:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813593.110961:0:16090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2cf4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.110968:0:16090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368000/0x6d74dbab2ddb2cf4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813593.110986:0:16090:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024b56793 reply state 000000003f87a5ac transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff908774369200/0x6d74dbab2ddb2cfb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813593.110995:0:16090:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788813593.111291:0:16090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb2ced lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484299 expref: 14 pid: 16090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.111309:0:16090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369000/0x6d74dbab2ddb2d02 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484299 expref: 13 pid: 16090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.111317:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0500) 00010000:00010000:0.0:1788813593.111320:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788813593.111322:0:16090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369000, rc 0) 00000100:00100000:0.0:1788813593.111475:0:16090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:174ca40a-6963-45bf-98f2-c54b8bfcdb58+14:14436:x1875706562858624:12345-192.168.204.47@tcp:101:bash.0 Request processed in 21485us (21700us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788813593.111485:0:16090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 28 00010000:00010000:0.0:1788813593.119276:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369200/0x6d74dbab2ddb2cfb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.119307:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369200/0x6d74dbab2ddb2cfb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.119314:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369200/0x6d74dbab2ddb2cfb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.119320:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369200 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813593.119326:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369200/0x6d74dbab2ddb2cfb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.119334:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369200/0x6d74dbab2ddb2cfb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.119350:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff908743ce0d00) 00010000:00010000:0.0:1788813593.119353:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813593.119358:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369200/0x6d74dbab2ddb2cfb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.119364:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369200/0x6d74dbab2ddb2cfb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813593.141943:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813593.142044:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562858880 00000100:00100000:3.0:1788813593.142055:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562858880 00000100:00100000:3.0:1788813593.142144:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 29 00000100:00100000:3.0:1788813593.142154:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+13:14436:x1875706562858880:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:3.0:1788813593.142184:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813593.142205:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2d10 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4842a0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.142273:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb2d17 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.142288:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb2d17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.142315:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb2d17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813593.142354:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788813593.142358:0:14432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788813593.142375:0:14432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb2d17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.142385:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb2d17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.142420:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2d10 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842a0 expref: 15 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.142438:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb2d17 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842a0 expref: 14 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.142446:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0500) 00010000:00010000:3.0:1788813593.142449:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813593.142453:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c95400, rc 0) 00000100:00100000:3.0:1788813593.142511:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+14:14436:x1875706562858880:12345-192.168.204.47@tcp:101:bash.0 Request processed in 358us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813593.142518:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 29 00000100:00100000:1.0:1788813593.147408:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813593.147655:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562859136 00000100:00100000:0.0:1788813593.147665:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562859136 00000100:00100000:0.0:1788813593.147723:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 5 00000100:00100000:0.0:1788813593.147734:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+14:14436:x1875706562859136:12345-192.168.204.47@tcp:35:bash.0 00000100:00100000:0.0:1788813593.148073:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+15:14436:x1875706562859136:12345-192.168.204.47@tcp:35:bash.0 Request processed in 332us (676us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788813593.148081:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 5 00000040:00080000:3.0:1788813593.213700:0:14468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788813593.272342:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813593.272444:0:16611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562859392 00000100:00100000:2.0:1788813593.272454:0:16611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562859392 00000100:00100000:2.0:1788813593.272513:0:16611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 30 00000100:00100000:2.0:1788813593.272524:0:16611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+15:14446:x1875706562859392:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:2.0:1788813593.272557:0:16611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813593.272602:0:16611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2d1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4842a7 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813593.272716:0:16611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788813593.272845:0:16611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2d1e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842a7 expref: 17 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.272859:0:16611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908743ce0b00) 00010000:00010000:2.0:1788813593.272862:0:16611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813593.272867:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2d1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842a7 expref: 17 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.272882:0:16611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369800, rc 0) 00000100:00100000:2.0:1788813593.272944:0:16611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+16:14446:x1875706562859392:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 422us (623us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788813593.272952:0:16611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 30 00000100:00100000:1.0:1788813593.277524:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813593.277769:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562859648 00000100:00100000:0.0:1788813593.277851:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562859648 00000100:00100000:0.0:1788813593.277943:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 6 00000100:00100000:0.0:1788813593.277956:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908642915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+16:14446:x1875706562859648:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:0.0:1788813593.278234:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908642915500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+17:14446:x1875706562859648:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 279us (1175us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788813593.278241:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 6 00000100:00100000:1.0:1788813593.323229:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813593.323347:0:16090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562859904 00000100:00100000:0.0:1788813593.323358:0:16090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562859904 00000100:00100000:0.0:1788813593.323424:0:16090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 31 00000100:00100000:0.0:1788813593.323435:0:16090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:174ca40a-6963-45bf-98f2-c54b8bfcdb58+17:14449:x1875706562859904:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:0.0:1788813593.323459:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813593.323480:0:16090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfa00/0x6d74dbab2ddb2d2c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4842ae expref: -99 pid: 16090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.323626:0:16090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfe00/0x6d74dbab2ddb2d33 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.323641:0:16090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfe00/0x6d74dbab2ddb2d33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.323654:0:16090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfe00/0x6d74dbab2ddb2d33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813593.323666:0:16090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788813593.323781:0:16090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfa00/0x6d74dbab2ddb2d2c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842ae expref: 20 pid: 16090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.323817:0:16090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfe00/0x6d74dbab2ddb2d33 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842ae expref: 19 pid: 16090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.323825:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0500) 00010000:00010000:0.0:1788813593.323828:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813593.323832:0:16090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9086425dfe00, rc 0) 00000100:00100000:0.0:1788813593.323885:0:16090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:174ca40a-6963-45bf-98f2-c54b8bfcdb58+19:14449:x1875706562859904:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 452us (664us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788813593.323893:0:16090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 31 00000100:00100000:1.0:1788813593.329266:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813593.329305:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813593.329552:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562860160 00000100:00100000:2.0:1788813593.329561:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562860160 00000100:00100000:2.0:1788813593.329643:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 0 00000100:00100000:2.0:1788813593.329653:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e927800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+19:2360:x1875706562860160:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813593.329672:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813593.329698:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfe00/0x6d74dbab2ddb2d33 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842ae expref: 19 pid: 16090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.329718:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0500) 00010000:00010000:2.0:1788813593.329722:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788813593.329905:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e927800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+18:2360:x1875706562860160:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 122us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813593.329930:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 0 00000100:00100000:3.0:1788813593.330528:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562860032 00000100:00100000:3.0:1788813593.330546:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562860032 00000100:00100000:3.0:1788813593.330617:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 32 00000100:00100000:3.0:1788813593.330625:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+18:14449:x1875706562860032:12345-192.168.204.47@tcp:54:lfs.0 00010000:00010000:3.0:1788813593.330694:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2d41 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.330709:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2d41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.330720:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2d41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.330746:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2d41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.330753:0:14436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2d41 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.330759:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2d41 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.330765:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c94e00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:3.0:1788813593.330769:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2d41 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.330905:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2d41 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.330916:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0500) 00010000:00010000:3.0:1788813593.330918:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788813593.330923:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2d41 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.330928:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2d41 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813593.330998:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+18:14449:x1875706562860032:12345-192.168.204.47@tcp:54:lfs.0 Request processed in 374us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813593.331004:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 32 00000100:00100000:1.0:1788813593.335955:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813593.336690:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562860416 00000100:00100000:2.0:1788813593.336701:0:14437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562860416 00000100:00100000:2.0:1788813593.336753:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 7 00000100:00100000:2.0:1788813593.336764:0:14437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+18:14449:x1875706562860416:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:2.0:1788813593.337027:0:14437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+19:14449:x1875706562860416:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 265us (1082us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788813593.337043:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 7 00000100:00100000:1.0:1788813593.673719:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813593.674008:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562860672 00000100:00100000:0.0:1788813593.674020:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562860672 00000100:00100000:0.0:1788813593.674093:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 33 00000100:00100000:0.0:1788813593.674103:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+19:14480:x1875706562860672:12345-192.168.204.47@tcp:101:cat.0 00010000:00010000:0.0:1788813593.674129:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813593.674151:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfa00/0x6d74dbab2ddb2d48 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4842b5 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.674256:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de600/0x6d74dbab2ddb2d4f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.674271:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de600/0x6d74dbab2ddb2d4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.674282:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de600/0x6d74dbab2ddb2d4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813593.674293:0:14435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788813593.674480:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfa00/0x6d74dbab2ddb2d48 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842b5 expref: 22 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.674501:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de600/0x6d74dbab2ddb2d4f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842b5 expref: 21 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.674510:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0500) 00010000:00010000:0.0:1788813593.674512:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813593.674516:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9086425de600, rc 0) 00000100:00100000:0.0:1788813593.675035:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+21:14480:x1875706562860672:12345-192.168.204.47@tcp:101:cat.0 Request processed in 929us (1321us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1788813593.675043:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 33 00000100:00100000:1.0:1788813593.683723:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813593.683803:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813593.683936:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562861056 00000100:00100000:3.0:1788813593.683946:0:14419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562861056 00000100:00100000:3.0:1788813593.684017:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 1 00000100:00100000:3.0:1788813593.684028:0:14419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e925880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+21:2360:x1875706562861056:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813593.684046:0:14419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813593.684082:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de600/0x6d74dbab2ddb2d4f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842b5 expref: 21 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.684104:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0500) 00010000:00010000:3.0:1788813593.684109:0:14419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813593.684176:0:14419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e925880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+20:2360:x1875706562861056:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 149us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813593.684184:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 1 00000100:00100000:2.0:1788813593.685776:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562860928 00000100:00100000:2.0:1788813593.685798:0:14437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562860928 00000100:00100000:2.0:1788813593.685850:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 8 00000100:00100000:2.0:1788813593.685859:0:14437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+20:14480:x1875706562860928:12345-192.168.204.47@tcp:35:cat.0 00000100:00100000:2.0:1788813593.686204:0:14437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+21:14480:x1875706562860928:12345-192.168.204.47@tcp:35:cat.0 Request processed in 344us (2494us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788813593.686211:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 8 00000100:00100000:1.0:1788813593.815900:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813593.815993:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562861312 00000100:00100000:3.0:1788813593.816004:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562861312 00000100:00100000:3.0:1788813593.816068:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 34 00000100:00100000:3.0:1788813593.816078:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+21:14486:x1875706562861312:12345-192.168.204.47@tcp:101:dd.0 00010000:00010000:3.0:1788813593.816104:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813593.816126:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2d5d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4842bc expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.816227:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2d64 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.816256:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2d64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.816271:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2d64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813593.816284:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788813593.816450:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2d5d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842bc expref: 24 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.816470:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2d64 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842bc expref: 23 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813593.816479:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0500) 00010000:00010000:3.0:1788813593.816481:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788813593.816485:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c94c00, rc 0) 00000100:00100000:3.0:1788813593.816564:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+23:14486:x1875706562861312:12345-192.168.204.47@tcp:101:dd.0 Request processed in 486us (673us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1788813593.816571:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 34 00000100:00100000:1.0:1788813593.819400:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813593.819576:0:16611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562861568 00000100:00100000:2.0:1788813593.819626:0:16611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562861568 00000100:00100000:2.0:1788813593.819678:0:16611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 35 00000100:00100000:2.0:1788813593.819698:0:16611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+23:14486:x1875706562861568:12345-192.168.204.47@tcp:36:dd.0 00010000:00010000:2.0:1788813593.819755:0:16611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788813593.819781:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94c00/0x6d74dbab2ddb2d64 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842bc expref: 23 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.819804:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95400/0x6d74dbab2ddb2d17 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842a0 expref: 22 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.819837:0:16611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0500) 00010000:00010000:2.0:1788813593.819842:0:16611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788813593.820038:0:16611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2d72 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.820052:0:16611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2d72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813593.820062:0:16611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2d72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788813593.820127:0:16611:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788813593.820155:0:16611:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ad748e6 reply state 00000000d2139f49 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2d72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813593.820164:0:16611:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788813593.820263:0:16611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+24:14486:x1875706562861568:12345-192.168.204.47@tcp:36:dd.0 Request processed in 565us (876us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788813593.820270:0:16611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 35 00000020:00080000:2.0:1788813593.820274:0:16611:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788813593.823065:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2d72 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813593.823082:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2d72 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813593.823089:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2d72 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813593.823096:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813593.823102:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2d72 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813593.823110:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2d72 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813593.823128:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0500) 00010000:00010000:1.0:1788813593.823131:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813593.823136:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2d72 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813593.823142:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2d72 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813593.853069:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788813593.932386:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813593.933436:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562861824 00000100:00100000:2.0:1788813593.933449:0:14437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562861824 00000100:00100000:2.0:1788813593.933532:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 9 00000100:00100000:2.0:1788813593.933546:0:14437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+23:14486:x1875706562861824:12345-192.168.204.47@tcp:35:dd.0 00000100:00100000:2.0:1788813593.933850:0:14437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+24:14486:x1875706562861824:12345-192.168.204.47@tcp:35:dd.0 Request processed in 306us (1485us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1788813593.933859:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 9 00000100:00100000:0.0:1788813594.174622:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813594.175160:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562861952 00000100:00100000:1.0:1788813594.175171:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562861952 00000100:00100000:1.0:1788813594.175256:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 36 00000100:00100000:1.0:1788813594.175268:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+24:14500:x1875706562861952:12345-192.168.204.47@tcp:101:stat.0 00010000:00010000:1.0:1788813594.175307:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813594.175328:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148da00/0x6d74dbab2ddb2d79 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4842c3 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.175408:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2d80 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.175422:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2d80 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.175433:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2d80 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.175446:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2d87 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.175454:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2d87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.175461:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2d87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788813594.175502:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788813594.175567:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb2d8e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.175575:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb2d8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.175603:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb2d8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813594.175639:0:14435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788813594.175649:0:14435:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813594.175689:0:14435:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb2d8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.175702:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb2d8e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.175710:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2d80 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.175716:0:14435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2d80 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.175722:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2d80 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.175728:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148d800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813594.175732:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2d80 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.175739:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2d80 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.175750:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff908742cc6900) 00010000:00010000:1.0:1788813594.175753:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813594.175758:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2d80 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.175764:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2d80 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.175777:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2d87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.175792:0:14435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2d87 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.175798:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2d87 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.175803:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148ce00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813594.175806:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2d87 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.177054:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2d87 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.177074:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff908742cc6600) 00010000:00010000:1.0:1788813594.177077:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813594.177082:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2d87 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.177089:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2d87 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.177160:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148da00/0x6d74dbab2ddb2d79 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842c3 expref: 26 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.177179:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb2d8e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842c3 expref: 25 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.177186:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0500) 00010000:00010000:1.0:1788813594.177188:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788813594.177204:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148d600, rc 0) 00000100:00100000:1.0:1788813594.177288:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+25:14500:x1875706562861952:12345-192.168.204.47@tcp:101:stat.0 Request processed in 2022us (2675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813594.177296:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 36 00000100:00100000:1.0:1788813594.302541:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813594.302728:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562862208 00000100:00100000:3.0:1788813594.302740:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562862208 00000100:00100000:3.0:1788813594.302822:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 37 00000100:00100000:3.0:1788813594.302833:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+25:14506:x1875706562862208:12345-192.168.204.47@tcp:36:truncate.0 00010000:00010000:3.0:1788813594.302899:0:14436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813594.302926:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb2d8e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842c3 expref: 25 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813594.302969:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0500) 00010000:00010000:3.0:1788813594.302975:0:14436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813594.303463:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2d95 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813594.303477:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2d95 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813594.303487:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2d95 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788813594.303554:0:14436:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:3.0:1788813594.303722:0:14436:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f13ee0a2 reply state 000000005d44ce2c transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2d95 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813594.303733:0:14436:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788813594.303907:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+27:14506:x1875706562862208:12345-192.168.204.47@tcp:36:truncate.0 Request processed in 1073us (1387us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1788813594.303914:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 37 00000020:00080000:3.0:1788813594.303919:0:14436:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788813594.307699:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2d95 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.307717:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2d95 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.307726:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2d95 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.307732:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c94e00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813594.307737:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2d95 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.307746:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2d95 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.307763:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0500) 00010000:00010000:0.0:1788813594.307781:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813594.307788:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2d95 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.307794:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94e00/0x6d74dbab2ddb2d95 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813594.454916:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813594.455040:0:16090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562862336 00000100:00100000:0.0:1788813594.455051:0:16090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562862336 00000100:00100000:0.0:1788813594.455113:0:16090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 38 00000100:00100000:0.0:1788813594.455134:0:16090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:174ca40a-6963-45bf-98f2-c54b8bfcdb58+26:14520:x1875706562862336:12345-192.168.204.47@tcp:101:stat.0 00010000:00010000:0.0:1788813594.455158:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788813594.455177:0:16090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de000/0x6d74dbab2ddb2d9c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4842ca expref: -99 pid: 16090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.455244:0:16090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfc00/0x6d74dbab2ddb2da3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.455262:0:16090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfc00/0x6d74dbab2ddb2da3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.455275:0:16090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfc00/0x6d74dbab2ddb2da3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.455291:0:16090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df000/0x6d74dbab2ddb2daa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.455297:0:16090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df000/0x6d74dbab2ddb2daa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.455303:0:16090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df000/0x6d74dbab2ddb2daa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.455418:0:16090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de800/0x6d74dbab2ddb2db1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.455426:0:16090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de800/0x6d74dbab2ddb2db1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.455433:0:16090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de800/0x6d74dbab2ddb2db1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788813594.455478:0:16090:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1788813594.455483:0:16090:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788813594.455507:0:16090:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de800/0x6d74dbab2ddb2db1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.455530:0:16090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de800/0x6d74dbab2ddb2db1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.455538:0:16090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfc00/0x6d74dbab2ddb2da3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.455545:0:16090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfc00/0x6d74dbab2ddb2da3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.455551:0:16090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfc00/0x6d74dbab2ddb2da3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.455557:0:16090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9086425dfc00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813594.455561:0:16090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfc00/0x6d74dbab2ddb2da3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.455568:0:16090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfc00/0x6d74dbab2ddb2da3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.455631:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff908742cc6900) 00010000:00010000:0.0:1788813594.455634:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813594.455639:0:16090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfc00/0x6d74dbab2ddb2da3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.455645:0:16090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfc00/0x6d74dbab2ddb2da3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.455659:0:16090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df000/0x6d74dbab2ddb2daa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.455664:0:16090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df000/0x6d74dbab2ddb2daa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.455669:0:16090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df000/0x6d74dbab2ddb2daa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.455673:0:16090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9086425df000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813594.455676:0:16090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df000/0x6d74dbab2ddb2daa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.455682:0:16090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df000/0x6d74dbab2ddb2daa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.455688:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff908752736900) 00010000:00010000:0.0:1788813594.455690:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813594.455693:0:16090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df000/0x6d74dbab2ddb2daa lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.455698:0:16090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df000/0x6d74dbab2ddb2daa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.455739:0:16090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de000/0x6d74dbab2ddb2d9c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842ca expref: 28 pid: 16090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.455753:0:16090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de800/0x6d74dbab2ddb2db1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842ca expref: 27 pid: 16090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.455761:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0500) 00010000:00010000:0.0:1788813594.455764:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788813594.455766:0:16090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9086425de800, rc 0) 00000100:00100000:0.0:1788813594.455830:0:16090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:174ca40a-6963-45bf-98f2-c54b8bfcdb58+27:14520:x1875706562862336:12345-192.168.204.47@tcp:101:stat.0 Request processed in 707us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813594.455838:0:16090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 38 00000100:00100000:3.0:1788813594.587424:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813594.587616:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562862592 00000100:00100000:1.0:1788813594.587627:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562862592 00000100:00100000:1.0:1788813594.587702:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 39 00000100:00100000:1.0:1788813594.587713:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+27:14530:x1875706562862592:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:1.0:1788813594.587735:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813594.587756:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2db8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4842d1 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813594.587848:0:14435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788813594.587967:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2db8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842d1 expref: 29 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.587981:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908743ce0b00) 00010000:00010000:1.0:1788813594.587984:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788813594.587990:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2db8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842d1 expref: 29 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.588004:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148d800, rc 0) 00000100:00100000:1.0:1788813594.588209:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+28:14530:x1875706562862592:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 496us (794us total) trans 8589934614 rc 301/301 00000100:00100000:1.0:1788813594.588216:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 39 00000100:00100000:1.0:1788813594.590901:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813594.591001:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562862848 00000100:00100000:3.0:1788813594.591012:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562862848 00000100:00100000:3.0:1788813594.591081:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 10 00000100:00100000:3.0:1788813594.591092:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9086413e7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+28:14530:x1875706562862848:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:3.0:1788813594.592139:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9086413e7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+29:14530:x1875706562862848:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 1041us (1241us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788813594.592150:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 10 00000100:00100000:2.0:1788813594.667625:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813594.667802:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562863104 00000100:00100000:3.0:1788813594.667815:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562863104 00000100:00100000:3.0:1788813594.667932:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 40 00000100:00100000:3.0:1788813594.667943:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+29:14536:x1875706562863104:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:3.0:1788813594.667969:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813594.667990:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb2dc6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4842d8 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813594.668125:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2dcd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813594.668141:0:14436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369000/0x6d74dbab2ddb2d02 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484299 expref: 30 pid: 16090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813594.668151:0:14436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de800/0x6d74dbab2ddb2db1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842ca expref: 30 pid: 16090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813594.668160:0:14436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2dcd lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813594.668195:0:14436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de800/0x6d74dbab2ddb2db1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842ca expref: 30 pid: 16090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813594.668209:0:14436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de800/0x6d74dbab2ddb2db1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842ca expref: 30 pid: 16090 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813594.668223:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14436:1875706583819904:192.168.204.47@tcp:104: 00010000:00010000:3.0:1788813594.668334:0:14436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908774369000/0x6d74dbab2ddb2d02 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484299 expref: 30 pid: 16090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813594.668350:0:14436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369000/0x6d74dbab2ddb2d02 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484299 expref: 30 pid: 16090 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813594.668370:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14436:1875706583820032:192.168.204.47@tcp:104: 00000100:00100000:3.0:1788813594.668396:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087586ed540 going to sleep for 11 seconds 00000100:00100000:3.0:1788813594.687981:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14436:1875706583819904:192.168.204.47@tcp:104: 00000100:00100000:3.0:1788813594.687999:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14436:1875706583820032:192.168.204.47@tcp:104: 00000100:00100000:2.0:1788813594.689757:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813594.689818:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00010000:00010000:3.0:1788813594.690024:0:14436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2dcd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813594.690099:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562863360 00000100:00100000:0.0:1788813594.690109:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562863360 00000100:00100000:2.0:1788813594.694701:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562863232 00000100:00100000:2.0:1788813594.694717:0:14419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562863232 00010000:00010000:0.0:1788813594.705866:0:14420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369000/0x6d74dbab2ddb2d02 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484299 expref: 32 pid: 16090 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813594.705920:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 11 00000100:00100000:0.0:1788813594.705940:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e37b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+32:2359:x1875706562863360:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813594.705955:0:14420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813594.705962:0:14420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff908774369000/0x6d74dbab2ddb2d02 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484299 expref: 32 pid: 16090 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.705975:0:14420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908774369000/0x6d74dbab2ddb2d02 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484299 expref: 32 pid: 16090 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.706015:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369000/0x6d74dbab2ddb2d02 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484299 expref: 32 pid: 16090 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.706191:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0500) 00010000:00010000:0.0:1788813594.706197:0:14420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2dcd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.706207:0:14420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2dcd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.706215:0:14420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813594.706284:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e37b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+31:2359:x1875706562863360:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 355us (16535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813594.706292:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 11 00010000:00010000:2.0:1788813594.707533:0:14419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de800/0x6d74dbab2ddb2db1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842ca expref: 31 pid: 16090 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813594.708208:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 12 00000100:00100000:2.0:1788813594.708233:0:14419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+31:2359:x1875706562863232:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788813594.708250:0:14419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788813594.708259:0:14419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de800/0x6d74dbab2ddb2db1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842ca expref: 31 pid: 16090 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.708273:0:14419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de800/0x6d74dbab2ddb2db1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842ca expref: 31 pid: 16090 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.708293:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de800/0x6d74dbab2ddb2db1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842ca expref: 31 pid: 16090 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.708310:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0500) 00010000:00010000:2.0:1788813594.708315:0:14419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2dcd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.708323:0:14419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2dcd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.708330:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2dcd lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.708376:0:14419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813594.708421:0:14436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2dcd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813594.708433:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2dcd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813594.708439:0:14419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+30:2359:x1875706562863232:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 218us (18617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813594.708448:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 12 00000004:00200000:3.0:1788813594.708459:0:14436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1788813594.708644:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb2dc6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842d8 expref: 31 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813594.708660:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2dcd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842d8 expref: 30 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813594.708667:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0500) 00010000:00010000:3.0:1788813594.708670:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788813594.708673:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c94000, rc 0) 00000100:00100000:3.0:1788813594.708717:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+30:14536:x1875706562863104:12345-192.168.204.47@tcp:101:bash.0 Request processed in 40777us (41104us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1788813594.708725:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 40 00000100:00100000:2.0:1788813594.720325:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813594.735535:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562863616 00000100:00100000:3.0:1788813594.735552:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562863616 00000100:00100000:1.0:1788813594.738539:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 41 00000100:00100000:1.0:1788813594.738554:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+29:14536:x1875706562863616:12345-192.168.204.47@tcp:36:bash.0 00010000:00010000:1.0:1788813594.738876:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb2ddb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.738894:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb2ddb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.738905:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb2ddb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788813594.738954:0:14432:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:1.0:1788813594.738978:0:14432:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f7b2447 reply state 0000000051270db1 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb2ddb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813594.738987:0:14432:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788813594.739110:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+32:14536:x1875706562863616:12345-192.168.204.47@tcp:36:bash.0 Request processed in 556us (18791us total) trans 8589934618 rc 0/0 00000100:00100000:1.0:1788813594.739118:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 41 00000020:00080000:1.0:1788813594.739123:0:14432:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788813594.744425:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb2ddb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.744442:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb2ddb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.744449:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb2ddb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.744455:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148d600 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813594.744461:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb2ddb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.744469:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb2ddb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.744486:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0500) 00010000:00010000:2.0:1788813594.744488:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813594.744494:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb2ddb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.744500:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb2ddb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813594.745882:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813594.745984:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562863744 00000100:00100000:2.0:1788813594.746008:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562863744 00000100:00100000:2.0:1788813594.746084:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 42 00000100:00100000:2.0:1788813594.746096:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+31:14536:x1875706562863744:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:2.0:1788813594.746122:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813594.746143:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb2de2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4842df expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.746202:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb2de2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842df expref: 32 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.746216:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb2de2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842df expref: 32 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.746234:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0500) 00010000:00010000:2.0:1788813594.746237:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788813594.746240:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368400, rc 0) 00000100:00100000:2.0:1788813594.746311:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+32:14536:x1875706562863744:12345-192.168.204.47@tcp:101:bash.0 Request processed in 218us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813594.746318:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 42 00000100:00100000:3.0:1788813594.752294:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813594.752540:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562863872 00000100:00100000:1.0:1788813594.752554:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562863872 00000100:00100000:1.0:1788813594.752660:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 43 00000100:00100000:1.0:1788813594.752672:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+32:14536:x1875706562863872:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:1.0:1788813594.752704:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813594.752729:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2de9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4842e6 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.752851:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb2df0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.752866:0:14436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2dcd lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842d8 expref: 33 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.752875:0:14436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb2df0 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.752914:0:14436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2dcd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842d8 expref: 33 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813594.752928:0:14436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2dcd lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842d8 expref: 33 pid: 14436 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813594.752941:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908774397100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14436:1875706583820160:192.168.204.47@tcp:104: 00000100:00100000:1.0:1788813594.753062:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876f9be240 going to sleep for 11 seconds 00000100:00100000:1.0:1788813594.759550:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813594.759826:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562864000 00000100:00100000:3.0:1788813594.759836:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562864000 00010000:00010000:3.0:1788813594.759880:0:14421:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2dcd lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842d8 expref: 34 pid: 14436 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813594.759915:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 13 00000100:00100000:3.0:1788813594.759925:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774396680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+34:2359:x1875706562864000:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788813594.759940:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813594.759948:0:14421:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2dcd lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842d8 expref: 34 pid: 14436 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813594.759962:0:14421:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2dcd lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842d8 expref: 34 pid: 14436 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813594.760048:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0500) 00010000:00010000:3.0:1788813594.760054:0:14421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb2df0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813594.760066:0:14421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb2df0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813594.760075:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb2df0 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813594.760113:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788813594.760174:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774396680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+34:2359:x1875706562864000:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 250us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813594.760183:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 13 00010000:00010000:2.0:1788813594.765833:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94000/0x6d74dbab2ddb2dcd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842d8 expref: 33 pid: 14436 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813594.765859:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908774397100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14436:1875706583820160:192.168.204.47@tcp:104: 00010000:00010000:2.0:1788813594.765885:0:14436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb2df0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.765895:0:14436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb2df0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.765917:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb2df0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813594.765967:0:14436:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788813594.765972:0:14436:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788813594.765994:0:14436:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb2df0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.767526:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2de9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842e6 expref: 33 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.767552:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb2df0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842e6 expref: 32 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.767562:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0500) 00010000:00010000:2.0:1788813594.767566:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813594.767569:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148c400, rc 0) 00000100:00100000:2.0:1788813594.769221:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+32:14536:x1875706562863872:12345-192.168.204.47@tcp:101:bash.0 Request processed in 16542us (16927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813594.769233:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 43 00000100:00100000:1.0:1788813594.797879:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813594.797969:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562864256 00000100:00100000:0.0:1788813594.797979:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562864256 00000100:00100000:0.0:1788813594.798121:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 2 00000100:00100000:0.0:1788813594.798132:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774394700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+32:14536:x1875706562864256:12345-192.168.204.47@tcp:103:bash.0 00010000:00010000:0.0:1788813594.798149:0:14420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788813594.798176:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148c400/0x6d74dbab2ddb2df0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842e6 expref: 32 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.798199:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb2de2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842df expref: 31 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813594.798210:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0500) 00010000:00010000:0.0:1788813594.798241:0:14420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813594.798945:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774394700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+30:14536:x1875706562864256:12345-192.168.204.47@tcp:103:bash.0 Request processed in 811us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813594.798956:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 2 00000100:00100000:1.0:1788813594.802634:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813594.802735:0:16611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562864384 00000100:00100000:2.0:1788813594.802745:0:16611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562864384 00000100:00100000:2.0:1788813594.802805:0:16611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 44 00000100:00100000:2.0:1788813594.802815:0:16611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+30:14536:x1875706562864384:12345-192.168.204.47@tcp:58:bash.0 00010000:00010000:2.0:1788813594.802920:0:16611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb2df7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.802939:0:16611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb2df7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.802969:0:16611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb2df7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788813594.804790:0:16611:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788813594.804953:0:16611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788813594.805846:0:16611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788813594.805973:0:16611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+30:14536:x1875706562864384:12345-192.168.204.47@tcp:58:bash.0 Request processed in 3154us (3391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813594.805983:0:16611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 44 00000100:00100000:1.0:1788813594.808564:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813594.809660:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562864512 00000100:00100000:2.0:1788813594.809672:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562864512 00000100:00100000:2.0:1788813594.809905:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 45 00000100:00100000:2.0:1788813594.809916:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+30:14536:x1875706562864512:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:2.0:1788813594.809937:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813594.809958:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb2dfe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4842ed expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.810801:0:14435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb2df7 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.810819:0:14435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb2dfe lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842ed expref: 31 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.810842:0:14435:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb2df7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.810857:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb2dfe lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842ed expref: 31 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.810890:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0600) 00010000:00010000:2.0:1788813594.810893:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788813594.810898:0:14435:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb2dfe lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842ed expref: 31 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813594.810906:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774368400, rc 0) 00000100:00100000:2.0:1788813594.810984:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+31:14536:x1875706562864512:12345-192.168.204.47@tcp:101:bash.0 Request processed in 1069us (2429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813594.810992:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 45 00010000:00010000:1.0:1788813594.877628:0:16096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788813595.262282:0:14468:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788813595.262294:0:14468:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788813595.262334:0:14468:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788813595.262342:0:14468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788813595.262481:0:14468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ee680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14468:1875706583820288:192.168.204.47@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788813595.262627:0:14468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087586ede40 going to sleep for 11 seconds 00000100:00100000:3.0:1788813595.267787:0:14468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ee680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14468:1875706583820288:192.168.204.47@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788813595.270485:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813595.270656:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562864640 00000100:00100000:2.0:1788813595.270666:0:14445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562864640 00000100:00100000:2.0:1788813595.270735:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 0 00000100:00100000:2.0:1788813595.270748:0:14445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+31:14537:x1875706562864640:12345-192.168.204.47@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788813595.271213:0:14445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+31:14537:x1875706562864640:12345-192.168.204.47@tcp:900:lhsmtool_posix.0 Request processed in 465us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813595.271222:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 0 00000100:00100000:1.0:1788813595.274255:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813595.274446:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562864768 00000100:00100000:2.0:1788813595.274458:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562864768 00000100:00100000:2.0:1788813595.274538:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 46 00000100:00100000:2.0:1788813595.274550:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+31:14537:x1875706562864768:12345-192.168.204.47@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788813595.274627:0:14436:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788813595.275264:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+31:14537:x1875706562864768:12345-192.168.204.47@tcp:53:lhsmtool_posix.0 Request processed in 714us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813595.275273:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 46 00000100:00100000:1.0:1788813595.293349:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813595.293858:0:16611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562864896 00000100:00100000:2.0:1788813595.293868:0:16611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562864896 00000100:00100000:2.0:1788813595.293933:0:16611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 47 00000100:00100000:2.0:1788813595.293944:0:16611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+31:14537:x1875706562864896:12345-192.168.204.47@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788813595.294028:0:16611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369000/0x6d74dbab2ddb2e05 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294046:0:16611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369000/0x6d74dbab2ddb2e05 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294059:0:16611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369000/0x6d74dbab2ddb2e05 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294127:0:16611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369c00/0x6d74dbab2ddb2e0c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294136:0:16611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369c00/0x6d74dbab2ddb2e0c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294144:0:16611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369c00/0x6d74dbab2ddb2e0c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294170:0:16611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2e13 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294179:0:16611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2e13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294185:0:16611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2e13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813595.294234:0:16611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788813595.294256:0:16611:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788813595.294272:0:16611:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2e13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294287:0:16611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369000/0x6d74dbab2ddb2e05 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294293:0:16611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369000/0x6d74dbab2ddb2e05 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294300:0:16611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369000/0x6d74dbab2ddb2e05 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294305:0:16611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369000 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813595.294310:0:16611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369000/0x6d74dbab2ddb2e05 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294317:0:16611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369000/0x6d74dbab2ddb2e05 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294328:0:16611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff908743ce0f00) 00010000:00010000:2.0:1788813595.294332:0:16611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813595.294336:0:16611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369000/0x6d74dbab2ddb2e05 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294342:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369000/0x6d74dbab2ddb2e05 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294355:0:16611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369c00/0x6d74dbab2ddb2e0c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294360:0:16611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369c00/0x6d74dbab2ddb2e0c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294375:0:16611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369c00/0x6d74dbab2ddb2e0c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294380:0:16611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369c00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813595.294382:0:16611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369c00/0x6d74dbab2ddb2e0c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294388:0:16611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369c00/0x6d74dbab2ddb2e0c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294395:0:16611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff908743ce0400) 00010000:00010000:2.0:1788813595.294397:0:16611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813595.294400:0:16611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369c00/0x6d74dbab2ddb2e0c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294406:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369c00/0x6d74dbab2ddb2e0c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294434:0:16611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2e13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294440:0:16611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2e13 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294446:0:16611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2e13 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294450:0:16611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813595.294453:0:16611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2e13 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294470:0:16611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2e13 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294479:0:16611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0600) 00010000:00010000:2.0:1788813595.294481:0:16611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788813595.294484:0:16611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2e13 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.294489:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2e13 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813595.294662:0:16611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+31:14537:x1875706562864896:12345-192.168.204.47@tcp:34:lhsmtool_posix.0 Request processed in 718us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813595.295653:0:16611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 47 00000100:00100000:1.0:1788813595.298048:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813595.298573:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562865152 00000100:00100000:2.0:1788813595.298601:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562865152 00000100:00100000:2.0:1788813595.298801:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 48 00000100:00100000:2.0:1788813595.298929:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+31:14537:x1875706562865152:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813595.298951:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813595.298973:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369200/0x6d74dbab2ddb2e1a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4842f4 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.299202:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb2e21 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.299218:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb2e21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.299229:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb2e21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788813595.299257:0:14435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788813595.299363:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb2e21 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.299372:0:14435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb2e21 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.299379:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb2e21 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.299385:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774369400 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:2.0:1788813595.299389:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb2e21 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.299396:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb2e21 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.299408:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0600) 00010000:00010000:2.0:1788813595.299411:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788813595.299416:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb2e21 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.299421:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369400/0x6d74dbab2ddb2e21 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.301216:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369200/0x6d74dbab2ddb2e1a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842f4 expref: 33 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.301234:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff908743ce0f00) 00010000:00010000:2.0:1788813595.301236:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788813595.301260:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369200/0x6d74dbab2ddb2e1a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842f4 expref: 33 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.301270:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369200, rc 0) 00000100:00100000:2.0:1788813595.301355:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+32:14537:x1875706562865152:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 2545us (3317us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1788813595.301364:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 48 00000100:00100000:0.0:1788813595.308233:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813595.308305:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562865280 00000100:00100000:2.0:1788813595.308315:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562865280 00000100:00100000:2.0:1788813595.308377:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 49 00000100:00100000:2.0:1788813595.308387:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+32:14537:x1875706562865280:12345-192.168.204.47@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788813595.308434:0:14436:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788813595.308560:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+32:14537:x1875706562865280:12345-192.168.204.47@tcp:53:lhsmtool_posix.0 Request processed in 173us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813595.308568:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 49 00000100:00100000:0.0:1788813595.316421:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813595.316553:0:16611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562865536 00000100:00100000:2.0:1788813595.316563:0:16611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562865536 00000100:00100000:2.0:1788813595.316664:0:16611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 50 00000100:00100000:2.0:1788813595.316685:0:16611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+32:14537:x1875706562865536:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788813595.316707:0:16611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788813595.316733:0:16611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2e2f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e4842fb expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788813595.319643:0:16611:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1788813595.319657:0:16611:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1788813595.319733:0:16611:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1788813595.320412:0:16611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369c00/0x6d74dbab2ddb2e36 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.320436:0:16611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774369c00/0x6d74dbab2ddb2e36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.320451:0:16611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908774369c00/0x6d74dbab2ddb2e36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.320532:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369800/0x6d74dbab2ddb2e2f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842fb expref: 35 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.320552:0:16611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908774369c00/0x6d74dbab2ddb2e36 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842fb expref: 34 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.320561:0:16611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff908743ce0400) 00010000:00010000:2.0:1788813595.320564:0:16611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788813595.320567:0:16611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908774369c00, rc 0) 00000100:00100000:2.0:1788813595.321397:0:16611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+34:14537:x1875706562865536:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 4717us (4990us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788813595.321407:0:16611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 50 00000100:00100000:2.0:1788813595.324777:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583820672:0@lo:400:kworker.0 00000100:00100000:2.0:1788813595.324861:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813595.324880:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583820800:0@lo:400:kworker.0 00000100:00100000:2.0:1788813595.324932:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908774394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583821184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813595.324940:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813595.324973:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813595.324985:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583820672 00000100:00100000:2.0:1788813595.325026:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583820544:0@lo:400:kworker.0 00000100:00100000:2.0:1788813595.325052:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813595.325072:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875706583821056:0@lo:400:kworker.0 00000100:00100000:2.0:1788813595.325093:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813595.325126:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788813595.325135:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3319:1875706583820416:0@lo:400:kworker.0 00000100:00100000:2.0:1788813595.325171:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813595.325201:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583820416 00000100:00100000:2.0:1788813595.325210:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875706583820928:0@lo:400:kworker.0 00000100:00100000:0.0:1788813595.325210:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583820416 00000100:00100000:2.0:1788813595.325242:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813595.325260:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788813595.325270:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:3319:x1875706583820416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813595.325281:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583820800 00000100:00100000:2.0:1788813595.325286:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583820800 00000100:00100000:2.0:1788813595.325317:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583821056 00000100:00100000:2.0:1788813595.325321:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583821056 00000100:00080000:2.0:1788813595.325341:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813595.325359:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583820928 00000100:00100000:2.0:1788813595.325362:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583820928 00000100:00080000:2.0:1788813595.325372:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788813595.325384:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788813595.325390:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583820800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813595.325443:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875706583820800:12345-0@lo:400:kworker.0 Request processed in 53us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813595.325449:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788813595.325467:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788813595.325473:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875706583821056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813595.328609:0:15120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583820672 00000100:00100000:1.0:1788813595.328677:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583820544 00000100:00100000:1.0:1788813595.328681:0:15121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583820544 00000100:00100000:0.0:1788813595.328985:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7dbbe9e7-bc92-4769-ab24-5734c43403ec+19:3319:x1875706583820416:12345-0@lo:400:kworker.0 Request processed in 3712us (3808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813595.328997:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788813595.329120:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875706583821056:12345-0@lo:400:kworker.0 Request processed in 3643us (4022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813595.329130:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788813595.329160:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788813595.329169:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875706583820928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788813595.329242:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875706583820928:12345-0@lo:400:kworker.0 Request processed in 76us (4001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813595.329266:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788813595.329309:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583821184 00000100:00100000:2.0:1788813595.329314:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583821184 00000100:00100000:2.0:1788813595.329342:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788813595.329347:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1875706583821184:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813595.329356:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788813595.329374:0:15121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583820544:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1788813595.329376:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788813595.329424:0:15121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875706583820544:12345-0@lo:400:kworker.0 Request processed in 56us (4371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813595.329431:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788813595.329443:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1875706583821184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (4471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813595.329450:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788813595.329455:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788813595.329460:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788813595.329511:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875706583820800:0@lo:400:kworker.0 00000100:00100000:2.0:1788813595.329524:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908774394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583821184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788813595.329567:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788813595.329575:0:15120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583820672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788813595.330157:0:15120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583820672:12345-0@lo:400:kworker.0 Request processed in 579us (5294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813595.330165:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788813595.330624:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7dbbe9e7-bc92-4769-ab24-5734c43403ec:3319:1875706583820416:0@lo:400:kworker.0 00000100:00100000:0.0:1788813595.330639:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875706583820928:0@lo:400:kworker.0 00000100:00100000:0.0:1788813595.330649:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875706583820544:0@lo:400:kworker.0 00000100:00100000:0.0:1788813595.330658:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875706583821056:0@lo:400:kworker.0 00000100:00100000:2.0:1788813595.331142:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813595.331173:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562865792 00000100:00100000:1.0:1788813595.331180:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562865792 00000100:00100000:1.0:1788813595.331221:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 51 00000100:00100000:1.0:1788813595.331231:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+34:14537:x1875706562865792:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 00000100:00100000:3.0:1788813595.331379:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583820672:0@lo:400:kworker.0 00010000:00010000:1.0:1788813595.332357:0:14436:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788813595.332392:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774369c00/0x6d74dbab2ddb2e36 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842fb expref: 34 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.332409:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff908743ce0400) 00010000:00010000:1.0:1788813595.332432:0:14436:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788813595.332460:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2e44 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.332473:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2e44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.332484:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2e44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.332515:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2e4b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6c471baa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.332522:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2e4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6c471baa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.332528:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2e4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6c471baa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.332628:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2e44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.332636:0:14436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2e44 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.332642:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2e44 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.332649:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148d200 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813595.332653:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2e44 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.332660:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2e44 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.332677:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff908742cc6900) 00010000:00010000:1.0:1788813595.332679:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813595.332684:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2e44 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.332690:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2e44 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.332698:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2e4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6c471baa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.332703:0:14436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2e4b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6c471baa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.332709:0:14436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2e4b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6c471baa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.332713:0:14436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148cc00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813595.332716:0:14436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2e4b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6c471baa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.332722:0:14436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2e4b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6c471baa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.332729:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x6c471baa (ffff908742cc6600) 00010000:00010000:1.0:1788813595.332731:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813595.332734:0:14436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2e4b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6c471baa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.332739:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2e4b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6c471baa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14436 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813595.332837:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+33:14537:x1875706562865792:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 Request processed in 1606us (1697us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788813595.332845:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 51 00000100:00100000:1.0:1788813595.346463:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813595.346506:0:16090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562865920 00000100:00100000:1.0:1788813595.346516:0:16090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562865920 00000100:00100000:1.0:1788813595.346567:0:16090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 52 00000100:00100000:1.0:1788813595.346577:0:16090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:174ca40a-6963-45bf-98f2-c54b8bfcdb58+33:14537:x1875706562865920:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788813595.346620:0:16090:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813595.346646:0:16090:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148da00/0x6d74dbab2ddb2e52 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484302 expref: -99 pid: 16090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.346690:0:16090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb2e59 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.346705:0:16090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb2e59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.346717:0:16090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb2e59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.346828:0:16090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148da00/0x6d74dbab2ddb2e52 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484302 expref: 35 pid: 16090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.346848:0:16090:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d600/0x6d74dbab2ddb2e59 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484302 expref: 34 pid: 16090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.346866:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff908742cc6d00) 00010000:00010000:1.0:1788813595.346869:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788813595.346873:0:16090:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148d600, rc 0) 00000100:00100000:1.0:1788813595.346937:0:16090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:174ca40a-6963-45bf-98f2-c54b8bfcdb58+34:14537:x1875706562865920:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 361us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813595.346944:0:16090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 52 00000100:00100000:2.0:1788813595.351626:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813595.351730:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562866176 00000100:00100000:3.0:1788813595.351743:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562866176 00000100:00100000:3.0:1788813595.351799:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 53 00000100:00100000:3.0:1788813595.351810:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+34:14537:x1875706562866176:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788813595.351914:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb2e60 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813595.351931:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb2e60 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813595.351943:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb2e60 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788813595.354384:0:14432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1788813595.354515:0:14432:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 537596933629ns, next at 538596930222ns, rc = 0 00000004:00010000:3.0:1788813595.354669:0:14432:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b2bb3fb6 reply state 000000000046da0a transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb2e60 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813595.354682:0:14432:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788813595.354808:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+36:14537:x1875706562866176:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 Request processed in 2995us (3188us total) trans 8589934621 rc 0/0 00000100:00100000:3.0:1788813595.354818:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 53 00010000:00010000:0.0:1788813595.356472:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb2e60 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.356508:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb2e60 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.356517:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb2e60 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.356523:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c95200 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813595.356542:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb2e60 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.356551:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb2e60 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.356570:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff908742cc6d00) 00010000:00010000:0.0:1788813595.356573:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788813595.356598:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb2e60 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.356605:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c95200/0x6d74dbab2ddb2e60 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813595.357804:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813595.358019:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562866304 00000100:00100000:1.0:1788813595.358030:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562866304 00000100:00100000:1.0:1788813595.358089:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 54 00000100:00100000:1.0:1788813595.358101:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+35:14537:x1875706562866304:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788813595.358201:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813595.358224:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2e67 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484309 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.358292:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2e67 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484309 expref: 36 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.358307:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2e67 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484309 expref: 36 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.358330:0:14436:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff908742cc6d00) 00010000:00010000:1.0:1788813595.358333:0:14436:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788813595.358337:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148ce00, rc 0) 00000100:00100000:1.0:1788813595.358431:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+36:14537:x1875706562866304:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 331us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813595.358456:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 54 00000100:00100000:1.0:1788813595.365954:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813595.366373:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562866432 00000100:00100000:3.0:1788813595.366384:0:15650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562866432 00000100:00100000:3.0:1788813595.366472:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 12 00000100:00100000:3.0:1788813595.366484:0:15650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+5:2359:x1875706562866432:12345-192.168.204.47@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788813595.366900:0:15650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+6:2359:x1875706562866432:12345-192.168.204.47@tcp:2:lhsmtool_posix.0 Request processed in 417us (956us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788813595.366908:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 12 00000100:00080000:1.0:1788813595.367003:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788813595.369548:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813595.372708:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562866688 00000100:00100000:0.0:1788813595.372734:0:14437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562866688 00000100:00100000:0.0:1788813595.372809:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 11 00000100:00100000:0.0:1788813595.372819:0:14437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+36:14537:x1875706562866688:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788813595.373061:0:14437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+37:14537:x1875706562866688:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 Request processed in 242us (3520us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788813595.373068:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 11 00000100:00100000:0.0:1788813595.377823:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813595.377902:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562866944 00000100:00100000:1.0:1788813595.377913:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562866944 00000100:00100000:1.0:1788813595.377976:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 55 00000100:00100000:1.0:1788813595.377987:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+37:14537:x1875706562866944:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788813595.378129:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+37:14537:x1875706562866944:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 Request processed in 141us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813595.378137:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 55 00000100:00100000:2.0:1788813595.383554:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813595.384028:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562867072 00000100:00100000:1.0:1788813595.384041:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562867072 00000100:00100000:1.0:1788813595.384121:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 56 00000100:00100000:1.0:1788813595.384131:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+37:14537:x1875706562867072:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788813595.384154:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813595.384178:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148da00/0x6d74dbab2ddb2e6e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484310 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.384255:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2e75 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.384269:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2e75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.384280:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2e75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788813595.384317:0:14432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788813595.384350:0:14432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2e75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.384378:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148da00/0x6d74dbab2ddb2e6e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484310 expref: 39 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.384396:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2e75 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484310 expref: 38 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.384404:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff908742cc6d00) 00010000:00010000:1.0:1788813595.384407:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788813595.384411:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148cc00, rc 0) 00000100:00100000:1.0:1788813595.384503:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+38:14537:x1875706562867072:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 361us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813595.384510:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 56 00000100:00100000:2.0:1788813595.393841:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813595.393926:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562867200 00000100:00100000:1.0:1788813595.393937:0:15120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562867200 00000100:00100000:1.0:1788813595.393994:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 13 00000100:00100000:1.0:1788813595.394004:0:15120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876f9a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+6:2360:x1875706562867200:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788813595.394022:0:15120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788813595.394043:0:15120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e615c858/0x6d74dbab2ddb2e7c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484317 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788813595.394070:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f211c, blocks: 0x1 00010000:00010000:1.0:1788813595.394090:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=537s v=(0 0) 00010000:00010000:1.0:1788813595.394094:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788813595.394113:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e615c858/0x6d74dbab2ddb2e7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484317 expref: 7 pid: 15120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.394150:0:15120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e615c858/0x6d74dbab2ddb2e7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484317 expref: 7 pid: 15120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.394163:0:15120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90874148da00, rc 0) 00000100:00100000:1.0:1788813595.394226:0:15120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876f9a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+7:2360:x1875706562867200:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 223us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788813595.394233:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 13 00000100:00100000:2.0:1788813595.398271:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813595.398311:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562867456 00000100:00100000:2.0:1788813595.398322:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562867456 00000100:00100000:2.0:1788813595.398372:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 57 00000100:00100000:2.0:1788813595.398380:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+38:14537:x1875706562867456:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788813595.398485:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+38:14537:x1875706562867456:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 Request processed in 104us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813595.398509:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 57 00000100:00100000:2.0:1788813595.402381:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813595.402421:0:16611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562867584 00000100:00100000:2.0:1788813595.402430:0:16611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562867584 00000100:00100000:2.0:1788813595.402473:0:16611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 58 00000100:00100000:2.0:1788813595.402488:0:16611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877405b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+38:14537:x1875706562867584:12345-192.168.204.47@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788813595.412782:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934606 is committed 00000001:00080000:0.0:1788813595.412807:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934618 is committed 00000001:00080000:0.0:1788813595.412814:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934595 is committed 00000001:00080000:0.0:1788813595.412821:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000001:00080000:0.0:1788813595.412841:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1788813595.475635:0:16611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877405b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+15:14537:x1875706562867584:12345-192.168.204.47@tcp:44:lhsmtool_posix.0 Request processed in 73136us (73251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813595.475650:0:16611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 58 00000001:00080000:0.0:1788813595.476616:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:0.0:1788813595.476639:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1788813595.476905:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788813595.476923:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908774059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583821312:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788813595.476982:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788813595.477252:0:15649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583821312 00000100:00100000:0.0:1788813595.477261:0:15649:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583821312 00000100:00100000:0.0:1788813595.477320:0:15649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788813595.477330:0:15649:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875706583821312:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788813595.477509:0:15649:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788813595.477513:0:15649:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788813595.477515:0:15649:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788813595.477517:0:15649:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788813596 -> 1788813596 00002000:00010000:0.0:1788813595.477520:0:15649:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788813595.477602:0:15649:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3320:x1875706583821312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 251us (597us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788813595.477612:0:15649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1788813595.479766:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff908774059500/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788813595.479779:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908774059500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875706583821312:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788813595.480525:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813595.480630:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562867712 00000100:00100000:3.0:1788813595.480638:0:15650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562867712 00000100:00100000:3.0:1788813595.480756:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 15 00000100:00100000:3.0:1788813595.480780:0:15650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877405ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+7:2359:x1875706562867712:12345-192.168.204.47@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788813595.480888:0:15650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877405ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+7:2359:x1875706562867712:12345-192.168.204.47@tcp:16:lhsmtool_posix.0 Request processed in 110us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813595.480895:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 15 00000100:00100000:2.0:1788813595.486669:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813595.486755:0:16090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562867968 00000100:00100000:3.0:1788813595.486765:0:16090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562867968 00000100:00100000:3.0:1788813595.486832:0:16090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 59 00000100:00100000:3.0:1788813595.486843:0:16090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774058000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:174ca40a-6963-45bf-98f2-c54b8bfcdb58+13:14537:x1875706562867968:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788813595.486897:0:16090:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788813595.486923:0:16090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148cc00/0x6d74dbab2ddb2e75 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484310 expref: 13 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813595.486940:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff908742cc6d00) 00010000:00010000:3.0:1788813595.486945:0:16090:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788813595.486982:0:16090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb2e83 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813595.487200:0:16090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb2e83 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813595.487211:0:16090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb2e83 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813595.487464:0:16090:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f759d32 reply state 00000000b3d5e391 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb2e83 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813595.487475:0:16090:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788813595.487607:0:16090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774058000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:174ca40a-6963-45bf-98f2-c54b8bfcdb58+14:14537:x1875706562867968:12345-192.168.204.47@tcp:36:lhsmtool_posix.0 Request processed in 763us (948us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1788813595.487615:0:16090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 59 00010000:00010000:1.0:1788813595.489464:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb2e83 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.489480:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb2e83 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.489488:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb2e83 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.489505:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c94600 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813595.489509:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb2e83 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.489521:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb2e83 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.489538:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff908742cc6d00) 00010000:00010000:1.0:1788813595.489540:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813595.489546:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb2e83 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.489571:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94600/0x6d74dbab2ddb2e83 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813595.497708:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813595.497792:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562868096 00000100:00100000:3.0:1788813595.497810:0:15119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562868096 00000100:00100000:3.0:1788813595.497861:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 16 00000100:00100000:3.0:1788813595.497871:0:15119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774059180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+7:14537:x1875706562868096:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788813595.497890:0:15119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813595.497921:0:15119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079e4c3bc/0x6d74dbab2ddb2e8a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e48431e expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813595.497954:0:15119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e615c858/0x6d74dbab2ddb2e7c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484317 expref: 8 pid: 15120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813595.497964:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813595.497969:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813595.497974:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079e4c3bc/0x6d74dbab2ddb2e8a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48431e expref: 8 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813595.498027:0:15119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e615c858/0x6d74dbab2ddb2e7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484317 expref: 8 pid: 15120 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813595.498042:0:15119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e615c858/0x6d74dbab2ddb2e7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484317 expref: 8 pid: 15120 timeout: 637 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813595.498056:0:15119:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15119:1875706583821440:192.168.204.47@tcp:104: 00000100:00100000:3.0:1788813595.498143:0:15119:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087586ede40 going to sleep for 11 seconds 00000100:00100000:3.0:1788813595.500355:0:15119:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15119:1875706583821440:192.168.204.47@tcp:104: 00010000:00010000:3.0:1788813595.500395:0:15119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000079e4c3bc/0x6d74dbab2ddb2e8a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48431e expref: 8 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813595.500416:0:15119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c95a00, rc 0) 00000100:00100000:3.0:1788813595.500479:0:15119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774059180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+8:14537:x1875706562868096:12345-192.168.204.47@tcp:101:lhsmtool_posix.0 Request processed in 2610us (2780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813595.500514:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 16 00000100:00100000:2.0:1788813595.501834:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813595.502161:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562868224 00000100:00100000:0.0:1788813595.502171:0:14419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562868224 00010000:00010000:0.0:1788813595.502214:0:14419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e615c858/0x6d74dbab2ddb2e7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484317 expref: 8 pid: 15120 timeout: 637 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813595.502263:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 14 00000100:00100000:0.0:1788813595.502273:0:14419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774058700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+8:2359:x1875706562868224:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813595.502288:0:14419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813595.502323:0:14419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e615c858/0x6d74dbab2ddb2e7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484317 expref: 8 pid: 15120 timeout: 637 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.502338:0:14419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e615c858/0x6d74dbab2ddb2e7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484317 expref: 8 pid: 15120 timeout: 637 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.502362:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e615c858/0x6d74dbab2ddb2e7c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484317 expref: 8 pid: 15120 timeout: 637 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.502378:0:14419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813595.502381:0:14419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788813595.502387:0:14419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000079e4c3bc/0x6d74dbab2ddb2e8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48431e expref: 7 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.502398:0:14419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079e4c3bc/0x6d74dbab2ddb2e8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48431e expref: 7 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.502436:0:14419:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000079e4c3bc/0x6d74dbab2ddb2e8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48431e expref: 7 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813595.502452:0:14419:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908643b4c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14419:1875706583821568:192.168.204.47@tcp:105: 00000100:00100000:0.0:1788813595.502547:0:14419:0:(client.c:2716:ptlrpc_set_wait()) set ffff908781f58300 going to sleep for 11 seconds 00000100:00100000:0.0:1788813595.514724:0:14419:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908643b4c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14419:1875706583821568:192.168.204.47@tcp:105: 00010000:00010000:0.0:1788813595.514751:0:14419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813595.514815:0:14419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774058700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+7:2359:x1875706562868224:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 12543us (12991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813595.514857:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 14 00000100:00100000:1.0:1788813595.515060:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813595.515253:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562868352 00000100:00100000:0.0:1788813595.515261:0:15121:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562868352 00000100:00100000:0.0:1788813595.515308:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 17 00000100:00100000:0.0:1788813595.515317:0:15121:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+7:2360:x1875706562868352:12345-192.168.204.47@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788813595.515541:0:15121:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788813595.515546:0:15121:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788813595 00002000:00010000:0.0:1788813595.515549:0:15121:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788813593 00002000:00010000:0.0:1788813595.515551:0:15121:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788813596 -> 1788813595 00002000:00010000:0.0:1788813595.515553:0:15121:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788813595.515621:0:15121:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:174ca40a-6963-45bf-98f2-c54b8bfcdb58+8:2360:x1875706562868352:12345-192.168.204.47@tcp:2:lhsmtool_posix.0 Request processed in 303us (572us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788813595.515629:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 17 00000100:00100000:2.0:1788813595.520024:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813595.520134:0:15650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562868480 00000100:00100000:3.0:1788813595.520145:0:15650:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562868480 00000100:00100000:3.0:1788813595.520208:0:15650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 18 00000100:00100000:3.0:1788813595.520219:0:15650:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877405a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+8:2362:x1875706562868480:12345-192.168.204.47@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788813595.520266:0:15650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005824d0b9/0x6d74dbab2ddb2e91 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813595.520286:0:15650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000079e4c3bc/0x6d74dbab2ddb2e8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48431e expref: 8 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813595.520294:0:15650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813595.520299:0:15650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788813595.520303:0:15650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005824d0b9/0x6d74dbab2ddb2e91 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813595.520339:0:15650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000079e4c3bc/0x6d74dbab2ddb2e8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48431e expref: 8 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813595.520353:0:15650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000079e4c3bc/0x6d74dbab2ddb2e8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48431e expref: 8 pid: 15119 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813595.520369:0:15650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90877c3ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15650:1875706583821696:192.168.204.47@tcp:104: 00000100:00100000:3.0:1788813595.520464:0:15650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9087586ede40 going to sleep for 11 seconds 00000100:00100000:2.0:1788813595.527443:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813595.527551:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562868608 00000100:00100000:0.0:1788813595.527561:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562868608 00010000:00010000:0.0:1788813595.527642:0:14420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000079e4c3bc/0x6d74dbab2ddb2e8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48431e expref: 9 pid: 15119 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813595.527643:0:15650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90877c3ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15650:1875706583821696:192.168.204.47@tcp:104: 00000100:00100000:0.0:1788813595.527684:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 15 00010000:00010000:3.0:1788813595.527686:0:15650:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005824d0b9/0x6d74dbab2ddb2e91 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813595.527697:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877405a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+9:2360:x1875706562868608:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813595.527712:0:14420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813595.527736:0:14420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000079e4c3bc/0x6d74dbab2ddb2e8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48431e expref: 9 pid: 15119 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.527751:0:14420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000079e4c3bc/0x6d74dbab2ddb2e8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48431e expref: 9 pid: 15119 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.527782:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079e4c3bc/0x6d74dbab2ddb2e8a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.47@tcp remote: 0x31ee63787e48431e expref: 9 pid: 15119 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.527800:0:14420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813595.527804:0:14420:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788813595.527810:0:14420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005824d0b9/0x6d74dbab2ddb2e91 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.527820:0:14420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005824d0b9/0x6d74dbab2ddb2e91 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.527989:0:14420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813595.528056:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877405a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+8:2360:x1875706562868608:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 361us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813595.528065:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 15 00010000:00010000:3.0:1788813595.529279:0:15650:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005824d0b9/0x6d74dbab2ddb2e91 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813595.529294:0:15650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005824d0b9/0x6d74dbab2ddb2e91 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813595.529327:0:15650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005824d0b9/0x6d74dbab2ddb2e91 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813595.529335:0:15650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005824d0b9/0x6d74dbab2ddb2e91 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813595.529344:0:15650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005824d0b9/0x6d74dbab2ddb2e91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813595.529351:0:15650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908773c94a00 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:3.0:1788813595.529355:0:15650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005824d0b9/0x6d74dbab2ddb2e91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813595.529364:0:15650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005824d0b9/0x6d74dbab2ddb2e91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813595.529380:0:15650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005824d0b9/0x6d74dbab2ddb2e91 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813595.529401:0:15650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005824d0b9/0x6d74dbab2ddb2e91 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788813595.529551:0:15650:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877405a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+7:2362:x1875706562868480:12345-192.168.204.47@tcp:1:lhsmtool_posix.0 Request processed in 9330us (9537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813595.529561:0:15650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 18 00000100:00100000:2.0:1788813595.542136:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813595.542259:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562868864 00000100:00100000:1.0:1788813595.542270:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562868864 00000100:00100000:1.0:1788813595.542321:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 60 00000100:00100000:1.0:1788813595.542332:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877405bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+13:14537:x1875706562868864:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788813595.542415:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2e98 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.542433:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2e98 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.542445:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2e98 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.542734:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2e9f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.542747:0:14435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2e67 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484309 expref: 14 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.542755:0:14435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2e9f lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.542790:0:14435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2e67 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484309 expref: 14 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.542816:0:14435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2e67 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484309 expref: 14 pid: 14436 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813595.542833:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908774397b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14435:1875706583821824:192.168.204.47@tcp:104: 00000100:00100000:1.0:1788813595.542920:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c39af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788813595.547708:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908774397b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14435:1875706583821824:192.168.204.47@tcp:104: 00010000:00010000:2.0:1788813595.547745:0:14435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2e9f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813595.548575:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813595.548685:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562868992 00000100:00100000:0.0:1788813595.548693:0:14419:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562868992 00010000:00010000:0.0:1788813595.548732:0:14419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2e67 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484309 expref: 15 pid: 14436 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813595.548771:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 16 00000100:00100000:0.0:1788813595.548781:0:14419:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774058380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+15:2359:x1875706562868992:12345-192.168.204.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788813595.548796:0:14419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788813595.548803:0:14419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2e67 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484309 expref: 15 pid: 14436 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.548835:0:14419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2e67 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484309 expref: 15 pid: 14436 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.548857:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148ce00/0x6d74dbab2ddb2e67 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.47@tcp remote: 0x31ee63787e484309 expref: 15 pid: 14436 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.548873:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff908742cc6d00) 00010000:00010000:0.0:1788813595.548878:0:14419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2e9f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.548887:0:14419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2e9f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.548895:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2e9f lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.548923:0:14419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788813595.548981:0:14419:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774058380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+14:2359:x1875706562868992:12345-192.168.204.47@tcp:103:ldlm_bl.0 Request processed in 201us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813595.548989:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 16 00010000:00010000:2.0:1788813595.549060:0:14435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2e9f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788813595.549068:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2e9f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788813595.549265:0:14435:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1788813595.549405:0:14435:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1788813595.549446:0:14435:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1788813595.549532:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908774058a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14435:1875706583821952:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788813595.549691:0:14435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813595.549716:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff90876faa0840 going to sleep for 11 seconds 00000100:00100000:0.0:1788813595.549998:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583821952 00000100:00100000:0.0:1788813595.550006:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583821952 00000100:00100000:0.0:1788813595.550054:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788813595.550063:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774059f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14435:x1875706583821952:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788813595.550216:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774059f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14435:x1875706583821952:12345-0@lo:1000:mdt00_001.0 Request processed in 154us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813595.550225:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788813595.550321:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908774058a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14435:1875706583821952:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788813595.550997:0:14435:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:1.0:1788813595.551084:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908774397b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14435:1875706583822080:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788813595.552043:0:14435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788813595.552079:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c39a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788813595.554611:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583822080 00000100:00100000:0.0:1788813595.554625:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583822080 00000100:00100000:0.0:1788813595.554678:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788813595.554689:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14435:x1875706583822080:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788813595.554987:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14435:x1875706583822080:12345-0@lo:1000:mdt00_001.0 Request processed in 300us (2947us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788813595.554995:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788813595.555644:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908774397b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14435:1875706583822080:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788813595.555690:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2e9f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.555701:0:14435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2e9f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.555708:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2e9f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.555713:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148d200 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813595.555718:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2e9f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.555726:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2e9f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.555755:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff908742cc6d00) 00010000:00010000:1.0:1788813595.555758:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788813595.555764:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2e9f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.555771:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d200/0x6d74dbab2ddb2e9f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.555805:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb2df7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.555812:0:14435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb2df7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.555817:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb2df7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.555822:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff908774368c00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813595.555824:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb2df7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.555829:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb2df7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.555835:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0600) 00010000:00010000:1.0:1788813595.555837:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788813595.555843:0:14435:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb2dfe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842ed expref: 17 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.555855:0:14435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb2dfe lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842ed expref: 17 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.555871:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb2dfe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842ed expref: 17 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.555911:0:14435:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff908774368400/0x6d74dbab2ddb2dfe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e4842ed expref: 17 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788813595.555924:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908774397100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14435:1875706583822208:192.168.204.47@tcp:105: 00000100:00100000:1.0:1788813595.556011:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff90877c39a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788813595.562701:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:1.0:1788813595.562704:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908774397100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14435:1875706583822208:192.168.204.47@tcp:105: 00010000:00010000:1.0:1788813595.562735:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb2df7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.562746:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908774368c00/0x6d74dbab2ddb2df7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 16611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.562781:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148da00/0x6d74dbab2ddb2ea6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.562795:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90874148da00/0x6d74dbab2ddb2ea6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.562809:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90874148da00/0x6d74dbab2ddb2ea6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.562820:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148da00/0x6d74dbab2ddb2ea6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.562827:0:14435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90874148da00/0x6d74dbab2ddb2ea6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.562848:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90874148da00/0x6d74dbab2ddb2ea6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.562854:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148da00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813595.562858:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148da00/0x6d74dbab2ddb2ea6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.562866:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148da00/0x6d74dbab2ddb2ea6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.562878:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0600) 00010000:00010000:1.0:1788813595.562881:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788813595.562885:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90874148da00/0x6d74dbab2ddb2ea6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.562891:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148da00/0x6d74dbab2ddb2ea6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.562902:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2e98 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.562908:0:14435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2e98 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.562914:0:14435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2e98 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.562919:0:14435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90874148d800 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:1.0:1788813595.562922:0:14435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2e98 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.562938:0:14435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2e98 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.562947:0:14435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0600) 00010000:00010000:1.0:1788813595.562949:0:14435:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788813595.562952:0:14435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2e98 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.562957:0:14435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90874148d800/0x6d74dbab2ddb2e98 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813595.563255:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562869120 00000100:00100000:0.0:1788813595.563263:0:14437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562869120 00000100:00100000:0.0:1788813595.563322:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 12 00000100:00100000:0.0:1788813595.563332:0:14437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+18:14536:x1875706562869120:12345-192.168.204.47@tcp:49:bash.0 00000100:00100000:0.0:1788813595.563464:0:14437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+18:14536:x1875706562869120:12345-192.168.204.47@tcp:49:bash.0 Request processed in 132us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813595.563472:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 12 00000100:00100000:1.0:1788813595.563643:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877405bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+17:14537:x1875706562868864:12345-192.168.204.47@tcp:57:lhsmtool_posix.0 Request processed in 21312us (21515us total) trans 8589934628 rc 0/0 00000100:00100000:1.0:1788813595.563651:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 60 00000020:00080000:1.0:1788813595.563655:0:14435:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788813595.563806:0:14468:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788813595.563811:0:14468:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788813595.563836:0:14468:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788813595.563843:0:14468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788813595.568932:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813595.569235:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562869376 00000100:00100000:0.0:1788813595.569247:0:14437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562869376 00000100:00100000:0.0:1788813595.569303:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 13 00000100:00100000:0.0:1788813595.569314:0:14437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+17:14537:x1875706562869376:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788813595.570316:0:14437:0:(mdd_object.c:4181:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788813595.570428:0:14437:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:0.0:1788813595.570479:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de600/0x6d74dbab2ddb2ead lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.570507:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de600/0x6d74dbab2ddb2ead lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.570532:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de600/0x6d74dbab2ddb2ead lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.570542:0:14437:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de600/0x6d74dbab2ddb2ead lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.570549:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de600/0x6d74dbab2ddb2ead lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.570555:0:14437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de600/0x6d74dbab2ddb2ead lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788813595.570674:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00010000:00010000:0.0:1788813595.570805:0:14437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788813595.570943:0:14437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+19:14537:x1875706562869376:12345-192.168.204.47@tcp:35:lhsmtool_posix.0 Request processed in 1629us (2019us total) trans 8589934630 rc 0/0 00000100:00100000:0.0:1788813595.570952:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 13 00000020:00080000:0.0:1788813595.570958:0:14437:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788813595.571171:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562869504 00000100:00100000:3.0:1788813595.571180:0:15119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562869504 00000100:00100000:3.0:1788813595.571233:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 19 00000100:00100000:3.0:1788813595.571243:0:15119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877405b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+7:14536:x1875706562869504:12345-192.168.204.47@tcp:101:bash.0 00010000:00010000:3.0:1788813595.571256:0:15119:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813595.571274:0:15119:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000215e2c89/0x6d74dbab2ddb2eb4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e484325 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788813595.571298:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9f211b, atime: 0x6a9f2119, ctime: 0x6a9f211b, blocks: 0x1 00010000:00010000:3.0:1788813595.571445:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=537s v=(0 0) 00010000:00010000:3.0:1788813595.571450:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788813595.571459:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000215e2c89/0x6d74dbab2ddb2eb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484325 expref: 8 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813595.571474:0:15119:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000215e2c89/0x6d74dbab2ddb2eb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e484325 expref: 8 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813595.571515:0:15119:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c95e00, rc 0) 00000100:00100000:3.0:1788813595.571544:0:15119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877405b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+8:14536:x1875706562869504:12345-192.168.204.47@tcp:101:bash.0 Request processed in 304us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788813595.571551:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 19 00010000:00010000:1.0:1788813595.576469:0:14422:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788813595.576482:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de600/0x6d74dbab2ddb2ead lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.576505:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9086425de600 already unused, calling callback (ffffffffc151a8b0) 00010000:00010000:1.0:1788813595.576509:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de600/0x6d74dbab2ddb2ead lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.576521:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de600/0x6d74dbab2ddb2ead lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.576543:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff908742cc6d00) 00010000:00010000:1.0:1788813595.576546:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788813595.576552:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de600/0x6d74dbab2ddb2ead lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788813595.576576:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de600/0x6d74dbab2ddb2ead lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.576705:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813595.576709:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788813595.576711:0:14422:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788813595.581869:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813595.581994:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562869760 00000100:00100000:0.0:1788813595.582006:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562869760 00000100:00100000:0.0:1788813595.582077:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 14 00000100:00100000:0.0:1788813595.582088:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877c3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+19:14536:x1875706562869760:12345-192.168.204.47@tcp:35:bash.0 00000001:00080000:0.0:1788813595.582530:0:14438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:0.0:1788813595.582672:0:14438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:0.0:1788813595.582775:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877c3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+22:14536:x1875706562869760:12345-192.168.204.47@tcp:35:bash.0 Request processed in 687us (915us total) trans 8589934633 rc 0/0 00000100:00100000:0.0:1788813595.582784:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 14 00000020:00080000:0.0:1788813595.582795:0:14438:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788813595.686695:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813595.686802:0:16611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562870016 00000100:00100000:3.0:1788813595.686814:0:16611:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562870016 00000100:00100000:3.0:1788813595.686880:0:16611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 61 00000100:00100000:3.0:1788813595.686894:0:16611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877405b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+22:14547:x1875706562870016:12345-192.168.204.47@tcp:101:lfs.0 00010000:00010000:3.0:1788813595.686920:0:16611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788813595.686945:0:16611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb2ebb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31ee63787e48432c expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788813595.687039:0:16611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788813595.687159:0:16611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb2ebb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48432c expref: 24 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813595.687172:0:16611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff908743ce0b00) 00010000:00010000:3.0:1788813595.687175:0:16611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788813595.687180:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff908773c94a00/0x6d74dbab2ddb2ebb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.47@tcp remote: 0x31ee63787e48432c expref: 24 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788813595.687194:0:16611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff908773c94a00, rc 0) 00000100:00100000:3.0:1788813595.687267:0:16611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877405b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:174ca40a-6963-45bf-98f2-c54b8bfcdb58+23:14547:x1875706562870016:12345-192.168.204.47@tcp:101:lfs.0 Request processed in 377us (582us total) trans 8589934634 rc 301/301 00000100:00100000:3.0:1788813595.687287:0:16611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 61 00000100:00100000:2.0:1788813595.690959:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:0.0:1788813595.691175:0:16090:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562870144 00000100:00100000:0.0:1788813595.691186:0:16090:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562870144 00000100:00100000:0.0:1788813595.691273:0:16090:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 62 00000100:00100000:0.0:1788813595.691283:0:16090:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877405aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:174ca40a-6963-45bf-98f2-c54b8bfcdb58+23:14547:x1875706562870144:12345-192.168.204.47@tcp:34:lfs.0 00010000:00010000:0.0:1788813595.691372:0:16090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df600/0x6d74dbab2ddb2ec9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.691391:0:16090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df600/0x6d74dbab2ddb2ec9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.691405:0:16090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df600/0x6d74dbab2ddb2ec9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.691420:0:16090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfe00/0x6d74dbab2ddb2ed0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.691441:0:16090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfe00/0x6d74dbab2ddb2ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.691448:0:16090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfe00/0x6d74dbab2ddb2ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.691753:0:16090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de600/0x6d74dbab2ddb2ed7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.691761:0:16090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de600/0x6d74dbab2ddb2ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.691768:0:16090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de600/0x6d74dbab2ddb2ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788813595.691813:0:16090:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de600/0x6d74dbab2ddb2ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.691833:0:16090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df600/0x6d74dbab2ddb2ec9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.691840:0:16090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df600/0x6d74dbab2ddb2ec9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.691848:0:16090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df600/0x6d74dbab2ddb2ec9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.691854:0:16090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9086425df600 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813595.691858:0:16090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df600/0x6d74dbab2ddb2ec9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.691865:0:16090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df600/0x6d74dbab2ddb2ec9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.691877:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff908742cc6900) 00010000:00010000:0.0:1788813595.691880:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813595.691885:0:16090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df600/0x6d74dbab2ddb2ec9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.691891:0:16090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9086425df600/0x6d74dbab2ddb2ec9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.691903:0:16090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfe00/0x6d74dbab2ddb2ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.691908:0:16090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfe00/0x6d74dbab2ddb2ed0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.691914:0:16090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfe00/0x6d74dbab2ddb2ed0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.691925:0:16090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9086425dfe00 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813595.691928:0:16090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfe00/0x6d74dbab2ddb2ed0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.691934:0:16090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfe00/0x6d74dbab2ddb2ed0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.691941:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff908752736000) 00010000:00010000:0.0:1788813595.691943:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813595.691946:0:16090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfe00/0x6d74dbab2ddb2ed0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.691951:0:16090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9086425dfe00/0x6d74dbab2ddb2ed0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.691965:0:16090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de600/0x6d74dbab2ddb2ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.691969:0:16090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de600/0x6d74dbab2ddb2ed7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.691974:0:16090:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de600/0x6d74dbab2ddb2ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.691978:0:16090:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9086425de600 already unused, calling callback (ffffffffc1f774f0) 00010000:00010000:0.0:1788813595.691981:0:16090:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de600/0x6d74dbab2ddb2ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.691986:0:16090:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de600/0x6d74dbab2ddb2ed7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.692004:0:16090:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff908743ce0600) 00010000:00010000:0.0:1788813595.692006:0:16090:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788813595.692009:0:16090:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de600/0x6d74dbab2ddb2ed7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788813595.692015:0:16090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9086425de600/0x6d74dbab2ddb2ed7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16090 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788813595.692107:0:16090:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877405aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:174ca40a-6963-45bf-98f2-c54b8bfcdb58+23:14547:x1875706562870144:12345-192.168.204.47@tcp:34:lfs.0 Request processed in 823us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788813595.692116:0:16090:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 62 00000100:00100000:1.0:1788813595.694483:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813595.694668:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562870400 00000100:00100000:2.0:1788813595.694678:0:14437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562870400 00000100:00100000:2.0:1788813595.694729:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 15 00000100:00100000:2.0:1788813595.694737:0:14437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+23:14547:x1875706562870400:12345-192.168.204.47@tcp:35:lfs.0 00000100:00100000:2.0:1788813595.695149:0:14437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:174ca40a-6963-45bf-98f2-c54b8bfcdb58+24:14547:x1875706562870400:12345-192.168.204.47@tcp:35:lfs.0 Request processed in 411us (671us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1788813595.695156:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 15 00010000:00010000:1.0:1788813595.901216:0:16097:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788813595.943135:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:1.0:1788813595.943156:0:7669:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000100:00100000:0.0:1788813596.351103:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff908774059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583822336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788813596.351179:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788813596.351309:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706583822336 00000100:00100000:2.0:1788813596.351316:0:15122:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706583822336 00000100:00100000:2.0:1788813596.351375:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788813596.351384:0:15122:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908643b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583822336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788813596.351420:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788813596.351472:0:15122:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908643b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875706583822336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813596.351491:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788813596.351541:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff908774059c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875706583822336:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788813596.929014:0:14423:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788813597.399779:0:16705:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:2.0:1788813597.572805:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813597.572850:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:3.0:1788813597.572859:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562870528 00000100:00100000:3.0:1788813597.572869:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562870528 00000100:00100000:2.0:1788813597.572874:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813597.572893:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813597.572913:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813597.572932:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813597.572955:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.47@tcp (source: 12345-192.168.204.47@tcp) 00000100:00100000:2.0:1788813597.572977:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562870784 00000100:00100000:2.0:1788813597.572994:0:15120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562870784 00000100:00100000:2.0:1788813597.573033:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562871296 00000100:00100000:2.0:1788813597.573036:0:15120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562871296 00000100:00100000:2.0:1788813597.573050:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562870912 00000100:00100000:2.0:1788813597.573053:0:15120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562870912 00000100:00100000:2.0:1788813597.573064:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562871168 00000100:00100000:2.0:1788813597.573066:0:15120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562871168 00000100:00100000:2.0:1788813597.573081:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 17 00000100:00100000:2.0:1788813597.573090:0:15120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774059c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+5:2361:x1875706562870784:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813597.573160:0:15120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774059c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+5:2361:x1875706562870784:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 70us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813597.573168:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 17 00000100:00100000:2.0:1788813597.573185:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 18 00000100:00100000:2.0:1788813597.573192:0:15120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774058a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c86e9881-1962-411f-a069-94fc48e23217+5:2361:x1875706562871296:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813597.573217:0:15120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774058a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c86e9881-1962-411f-a069-94fc48e23217+5:2361:x1875706562871296:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 26us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813597.573223:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 18 00000100:00100000:2.0:1788813597.573234:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 19 00000100:00100000:2.0:1788813597.573240:0:15120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+6:2361:x1875706562870912:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813597.573263:0:15120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+6:2361:x1875706562870912:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 23us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813597.573269:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 19 00000100:00100000:2.0:1788813597.573280:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 20 00000100:00100000:2.0:1788813597.573286:0:15120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c86e9881-1962-411f-a069-94fc48e23217+5:2361:x1875706562871168:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813597.573306:0:15120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c86e9881-1962-411f-a069-94fc48e23217+5:2361:x1875706562871168:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 22us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813597.573318:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 20 00000100:00100000:2.0:1788813597.573337:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562871040 00000100:00100000:2.0:1788813597.573341:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562871040 00000100:00100000:2.0:1788813597.573366:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875706562870656 00000100:00100000:2.0:1788813597.573369:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875706562870656 00000100:00100000:2.0:1788813597.573387:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 27 00000100:00100000:2.0:1788813597.573393:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff908774058e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c86e9881-1962-411f-a069-94fc48e23217+6:2361:x1875706562871040:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813597.573423:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff908774058e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c86e9881-1962-411f-a069-94fc48e23217+6:2361:x1875706562871040:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 31us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813597.573429:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 27 00000100:00100000:2.0:1788813597.573440:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 28 00000100:00100000:2.0:1788813597.573445:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90877be7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+24:2361:x1875706562870656:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813597.573483:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90877be7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:174ca40a-6963-45bf-98f2-c54b8bfcdb58+24:2361:x1875706562870656:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 37us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813597.573489:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 28 00000100:00080000:2.0:1788813597.573517:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788813597.573523:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788813597.573525:0:14429:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788813597.574216:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.47@tcp, seq: 120 00000100:00100000:2.0:1788813597.574227:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90876e5c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:764df018-de8a-4291-9451-854d34c91a19+13:2361:x1875706562870528:12345-192.168.204.47@tcp:400:kworker.0 00000100:00100000:2.0:1788813597.574303:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90876e5c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:764df018-de8a-4291-9451-854d34c91a19+13:2361:x1875706562870528:12345-192.168.204.47@tcp:400:kworker.0 Request processed in 78us (1505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788813597.574309:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.47@tcp, seq: 120 00010000:00010000:1.0:1788813597.955072:0:16096:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29752 lines, 29752 kept, 0 dropped, 0 bad.