VMCD.ORG

Architecture of data warehouse which is based on MQ

January 20, 2015 Architect, Architecture, MYSQL, rdbms, software No comments

Recently, we create a mysql data warehouse which is based on message queue.

Most companies must prepare for particular queries in their systems if they consider to split their databases or tables into many pieces.

some problems should be solved in this situation:

1. how to get correct re[……]

MHA with binlog server

December 31, 2014 Architect, Architecture, MYSQL, software No comments

In this post ,we mainly talk about MHA GTID behavior, we test different cases and find something is different from previous versions .

we have four machines for this test.

environment:


master server: 10.0.128.77
slave server : 10.0.128.110/113/114
port : 3306

———————–[……]

HBASE migrate table part 1

December 19, 2014 bigdata, hbase No comments

Copy table between different hbase clusters – Version 0.96.2-hadoop2

Create test table and initial some records.

$hbase shell
2014-12-19 15:01:36,085 INFO  [main] Configuration.deprecation: hadoop.native.lib is deprecated. Instead, use io.native.lib.available
HBase Shell; enter 'help&lt[......]Read more

MySQL-Oslayer-Performance-Optimization

December 13, 2014 Architecture, MYSQL, performance No comments architecture

upload on 2014.12

important tips of MySQL database design for better performance

Read : mysql-system-opt[……]

MySQL message subscription system

December 9, 2014 Architect, Architecture, MYSQL, replication, software No comments MQ

Introducing MQ system based on MySQL (canal + roma)
Using this system to subscribe message between different platforms.

View this PDF roma_system
Also download this PDF from slideshare[……]

MyAWR : MySQL Workload Report V3 release

December 2, 2014 Architecture, MYSQL, performance No comments mysqlawr

myawr-v3 release now !

history of myawr:

————————–
v1: create by noodba

mysql load information and system information

v2: create by louis liu

myawr_v2 add :

1 more os information module.

2 multiple instance support (extend table by db_port)

3 modified[......]Read more

webm_v2 has been released

October 21, 2014 Architect, NoSQL, rdbms, software No comments

Webm_v2 was add oracle and mongodb monitor module

webm was agent uploaded mode to save statistics

we use mysql database as monitor server

we already design tables to store these data (consider for future analysis)

you can download from github : https://github.com/ylouis83/webm[……]

Webm: MySQL database performance web monitor

September 28, 2014 Architect, MYSQL, performance No comments architecture, mysql, webm

You can download webm from github: https://github.com/ylouis83/webm

webm: mysql web key performance monitor

webm is a tool that display key value graph on website and webm was developed by javascript and mysqlmon ( mysql data collection tool wrote by AnySQL)

Environment need:

Linux vers[……]