搭建zookeeper伪集群

1.在~/cluster/zookeeper目录下,安装3份zookeeper程序副本,分别命名为server1,server2,server3
2.执行以下命令。

cp server1/conf/zoo_sample.cfg server1/conf/zoo.cfg

3.在zoo.cfg文件中添加如下命令

tickTime=2000
initLimit=10
syncLimit=5
dataDir=/home/abc/cluster/zookeeper/data/server1/data
dataLogDir=/home/abc/cluster/zookeeper/data/server1/log
clientPort=2181
server.1=localhost:2888:3888
server.2=localhost:2889:3889
server.3=localhost:2890:3890

4.因为是伪集群,故另外两份必须如下设置。

tickTime=2000
initLimit=10
syncLimit=5
dataDir=/home/abc/cluster/zookeeper/data/server2/data
dataLogDir=/home/abc/cluster/zookeeper/data/server2/log
clientPort=2182
server.1=localhost:2888:3888
server.2=localhost:2889:3889
server.3=localhost:2890:3890
tickTime=2000
initLimit=10
syncLimit=5
dataDir=/home/abc/cluster/zookeeper/data/server3/data
dataLogDir=/home/abc/cluster/zookeeper/data/server3/log
clientPort=2183
server.1=localhost:2888:3888
server.2=localhost:2889:3889
server.3=localhost:2890:3890

5.执行余下这些命令

mkdir -p /home/abc/cluster/zookeeper/data/server1/data
mkdir -p /home/abc/cluster/zookeeper/data/server2/data
mkdir -p /home/abc/cluster/zookeeper/data/server3/data
echo "1" > /home/abc/cluster/zookeeper/data/server1/data/myid
echo "2" > /home/abc/cluster/zookeeper/data/server2/data/myid
echo "3" > /home/abc/cluster/zookeeper/data/server3/data/myid

6.启动集群

cd ~/cluster/zookeeper
server1/bin/zkServer.sh start
server2/bin/zkServer.sh start
server3/bin/zkServer.sh start

原来一直误会了四层和七层的含义。

四层负载均衡指的是负载均衡设备通过报文中的目标IP地址和端口负载均衡算法,选择到达目的的内部服务器;
七层负载均衡,也被称为“内容交换”,指的是负载均衡设备通过报文中的应用层信息(URL、HTTP头部等信息)和负载均衡算法,选择到达目的的内部服务器。

在IDEA中使用Tomcat调试Web项目

1.创建项目使用org.apache.maven.archetype:maven-archetype-webapp 如下。

2.在pom.xml中加入Tomcat7的插件


   webapi
   
        
            org.apache.tomcat.maven
            tomcat7-maven-plugin
            2.1
            
                8080
                /
                UTF-8
                tomcat7
            
        
    

3.在配置中的命令行中选择,tomcat7:run项。


4.在run菜单中启用调试。

5.其它方式调试


proxy代理工具

具有MOCK数据功能的代理Proxy工具如下:
1.http://anyproxy.io/cn/这个是阿里的开源,最大特色是支持非桌面服务器部署。
2.fiddler

zkclient和curator开源

开源的两个zookeeper的客户端,简化了程序员的开发工具。

开源客户端,原生api的不足

连接的创建是异步的,需要开发人员自行编码实现等待
连接没有自动的超时重连机制
Zk本身没提供序列化机制,需要开发人员自行指定,从而实现数据的序列化和反序列化
Watcher注册一次只会生效一次,需要不断的重复注册
Watcher的使用方式不符合java本身的术语,如果采用监听器方式,更容易理解
不支持递归创建树形节点

开源客户端—ZkClient介绍

Github上一个开源的zk客户端,由datameer的工程师Stefan Groschupf和Peter Voss一起开发
– 解决session会话超时重连
– Watcher反复注册
– 简化开发api
– 还有…..
– https://github.com/sgroschupf/zkclient

开源客户端—Curator介绍
1. 使用CuratorFrameworkFactory工厂的两个静态方法创建客户端
a) static CuratorFramework newClient(String connectString, int sessionTimeoutMs, int connectionTimeoutMs,
RetryPolicy retryPolicy)
b) static CuratorFramework newClient(String connectString, RetryPolicy retryPolicy)
2. Start()方法启动
参数说明
connectString 分开的ip:port对
retryPolicy 重试策略,默认四种:Exponential BackoffRetry,RetryNTimes ,RetryOneTime,
RetryUntilElapsed
sessionTimeoutMs 会话超时时间,单位为毫秒,默认60000ms
connectionTimeoutMs 连接创建超时时间,单位为毫秒,默认是15000ms

CAP定理

2000年7月加州大学伯克利分校Eric Brewer教授首次提出了CAP猜想,并成为分布式计算领域的公认定理。该定理认为一个分布式系统不可能同时满足一致性(C:Consistency),可用性(A:Availability)和分区容错性(P:Partition Tolerance),这三个基本需求,最多只能满足其中两项。

五种一致性

推荐书籍:从PAXOS到ZOOKEEPER分布式一致性原理与实践,
链接:http://pan.baidu.com/s/1bpabUxh 密码:1v91

zookeeper的简单例子

import org.apache.zookeeper.*;
import org.apache.zookeeper.ZooDefs.Ids;
import org.apache.zookeeper.data.Stat;

import java.util.concurrent.CountDownLatch;

class DataMonitor implements Watcher, AsyncCallback.StatCallback{
    public ZooKeeper zk = null;
    private int i = 0;
    public int iexistcheck = 0;
    public DataMonitor(){

    }

    public void process(WatchedEvent event) {
        String path = event.getPath();
        System.out.println("process: iexistcheck="+iexistcheck+" - "+"i:="+i+",path:"+path+" - state:" + event.getState());
        i++;
    }

    public void processResult(int rc, String path, Object ctx, Stat stat) {
        System.out.println("processResult.1:iexistcheck="+iexistcheck+" - "+"i:="+i+",rc:" + rc + " - path:"+path+" - state:" + stat);
        try {
            System.out.println("processResult.2.getData:iexistcheck="+iexistcheck+" - "+"i:="+i+" - "+new String(zk.getData("/test", false, null)));
        }catch (Exception e){
            System.out.print("processResult.3:exception.....iexistcheck="+iexistcheck+" - "+"i:="+i);
        }finally {
            System.out.println("processResult.4:iexistcheck="+iexistcheck+" - "+"i:="+i+",end......end......end..");
        }
    }
}

public class ZooKeeperTest {

    private static CountDownLatch downLatch = new CountDownLatch(1);
    private static final int TIME_OUT = 300000;
    private static final String HOST = "localhost:2181";
    public static void main(String[] args) throws Exception{
        DataMonitor dm = new DataMonitor();
        ZooKeeper zookeeper = new ZooKeeper(HOST, TIME_OUT, dm);
        dm.zk = zookeeper;
        zookeeper.exists("/test", true, dm, dm);
        Stat stat =  null;
        for(int i = 0; i < 30; i++){
            String buf = "value="+i;
            System.out.println("loop i="+i);
            if(zookeeper.exists("/test", false) == null)
            {
                //PERSISTENT_SEQUENTIAL模式情况下,真正路径是从返回值获取。其格式为/test0000000028。
                //EPHEMERAL模式下,该节点是临时节点,当超时或session断开时,它也跟随着消失。适合检验机器岩机与否等状态。防单点或执备切换等。
                String node_real = zookeeper.create("/test", "znode1".getBytes(), Ids.OPEN_ACL_UNSAFE, CreateMode.PERSISTENT);
                System.out.println("nodename:"+node_real);
            }
            //第三个参数为版本号,当前输入的版本号与目标版本的版本号是相同的情况,才能更新到数据。否则会更新失败。
            if(stat == null){
                stat = zookeeper.setData(node_real, buf.getBytes() , -1);
            }else{
                stat = zookeeper.setData(node_real, buf.getBytes() , stat.getVersion());
            }
            System.out.println("Czxid:" + stat.getCzxid() + " - Mzxid:" + stat.getMzxid() + " - Version:" + stat.getVersion());
            if(i > 5){
                if(i % 3 == 0){
                    dm.iexistcheck = i;
                    zookeeper.exists("/test", true, dm, dm);
                }
            }
            Thread.sleep(1000);
        }
        zookeeper.delete("/test", -1);
        Thread.sleep(5000);
        zookeeper.close();
    }
}

			org.apache.zookeeper
        		zookeeper
        		3.4.8
        		
            			
                			com.sun.jmx
                			jmxri
            			
            			
					com.sun.jdmk
                			jmxtools
            			
            			
                			javax.jms
                			jms
            			
        		
        	
loop i=0
process: iexistcheck=0 - i:=0,path:null - state:SyncConnected
processResult.1:iexistcheck=0 - i:=1,rc:-101 - path:/test - state:null
processResult.3:exception.....iexistcheck=0 - i:=1processResult.4:iexistcheck=0 - i:=1,end......end......end..
process: iexistcheck=0 - i:=1,path:/test - state:SyncConnected
Czxid:1055 - Mzxid:1056 - Version:1
loop i=1
Czxid:1055 - Mzxid:1057 - Version:2
loop i=2
Czxid:1055 - Mzxid:1058 - Version:3
loop i=3
Czxid:1055 - Mzxid:1059 - Version:4
loop i=4
Czxid:1055 - Mzxid:1060 - Version:5
loop i=5
Czxid:1055 - Mzxid:1061 - Version:6
loop i=6
Czxid:1055 - Mzxid:1062 - Version:7
processResult.1:iexistcheck=6 - i:=1,rc:0 - path:/test0000000029 - state:1055,1062,1480343483194,1480343489294,7,0,0,0,7,0,1055

processResult.2.getData:iexistcheck=6 - i:=1 - value=6
processResult.4:iexistcheck=6 - i:=1,end......end......end..
loop i=7
process: iexistcheck=6 - i:=1,path:/test0000000029 - state:SyncConnected
Czxid:1055 - Mzxid:1063 - Version:8
loop i=8
Czxid:1055 - Mzxid:1064 - Version:9
loop i=9
Czxid:1055 - Mzxid:1065 - Version:10
processResult.1:iexistcheck=9 - i:=2,rc:0 - path:/test0000000029 - state:1055,1065,1480343483194,1480343492344,10,0,0,0,7,0,1055

processResult.2.getData:iexistcheck=9 - i:=2 - value=9
processResult.4:iexistcheck=9 - i:=2,end......end......end..

Log4j比较全面的配置

附:Log4j比较全面的配置

Log4j配置文件实现了输出到控制台、文件、回滚文件、发送日志邮件、输出到数据库日志表、自定义标签等全套功能。
log4j.rootLogger=DEBUG,console,dailyFile,im
log4j.additivity.org.apache=true
# 控制台(console)
log4j.appender.console=org.apache.log4j.ConsoleAppender
log4j.appender.console.Threshold=DEBUG
log4j.appender.console.ImmediateFlush=true
log4j.appender.console.Target=System.err
log4j.appender.console.layout=org.apache.log4j.PatternLayout
log4j.appender.console.layout.ConversionPattern=[%-5p] %d(%r) --> [%t] %l: %m %x %n

# 日志文件(logFile)
log4j.appender.logFile=org.apache.log4j.FileAppender
log4j.appender.logFile.Threshold=DEBUG
log4j.appender.logFile.ImmediateFlush=true
log4j.appender.logFile.Append=true
log4j.appender.logFile.File=D:/logs/log.log4j
log4j.appender.logFile.layout=org.apache.log4j.PatternLayout
log4j.appender.logFile.layout.ConversionPattern=[%-5p] %d(%r) --> [%t] %l: %m %x %n
# 回滚文件(rollingFile)
log4j.appender.rollingFile=org.apache.log4j.RollingFileAppender
log4j.appender.rollingFile.Threshold=DEBUG
log4j.appender.rollingFile.ImmediateFlush=true
log4j.appender.rollingFile.Append=true
log4j.appender.rollingFile.File=D:/logs/log.log4j
log4j.appender.rollingFile.MaxFileSize=200KB
log4j.appender.rollingFile.MaxBackupIndex=50
log4j.appender.rollingFile.layout=org.apache.log4j.PatternLayout
log4j.appender.rollingFile.layout.ConversionPattern=[%-5p] %d(%r) --> [%t] %l: %m %x %n
# 定期回滚日志文件(dailyFile)
log4j.appender.dailyFile=org.apache.log4j.DailyRollingFileAppender
log4j.appender.dailyFile.Threshold=DEBUG
log4j.appender.dailyFile.ImmediateFlush=true
log4j.appender.dailyFile.Append=true
log4j.appender.dailyFile.File=D:/logs/log.log4j
log4j.appender.dailyFile.DatePattern='.'yyyy-MM-dd
log4j.appender.dailyFile.layout=org.apache.log4j.PatternLayout
log4j.appender.dailyFile.layout.ConversionPattern=[%-5p] %d(%r) --> [%t] %l: %m %x %n
# 应用于socket
log4j.appender.socket=org.apache.log4j.RollingFileAppender
log4j.appender.socket.RemoteHost=localhost
log4j.appender.socket.Port=5001
log4j.appender.socket.LocationInfo=true
# Set up for Log Factor 5
log4j.appender.socket.layout=org.apache.log4j.PatternLayout
log4j.appender.socket.layout.ConversionPattern=[%-5p] %d(%r) --> [%t] %l: %m %x %n
# Log Factor 5 Appender
log4j.appender.LF5_APPENDER=org.apache.log4j.lf5.LF5Appender
log4j.appender.LF5_APPENDER.MaxNumberOfRecords=2000
# 发送日志到指定邮件
log4j.appender.mail=org.apache.log4j.net.SMTPAppender
log4j.appender.mail.Threshold=FATAL
log4j.appender.mail.BufferSize=10
log4j.appender.mail.From = xxx@mail.com
log4j.appender.mail.SMTPHost=mail.com
log4j.appender.mail.Subject=Log4J Message
log4j.appender.mail.To= xxx@mail.com
log4j.appender.mail.layout=org.apache.log4j.PatternLayout
log4j.appender.mail.layout.ConversionPattern=[%-5p] %d(%r) --> [%t] %l: %m %x %n
# 应用于数据库
log4j.appender.database=org.apache.log4j.jdbc.JDBCAppender
log4j.appender.database.URL=jdbc:mysql://localhost:3306/test
log4j.appender.database.driver=com.mysql.jdbc.Driver
log4j.appender.database.user=root
log4j.appender.database.password=
log4j.appender.database.sql=INSERT INTO LOG4J (Message) VALUES('=[%-5p] %d(%r) --> [%t] %l: %m %x %n')
log4j.appender.database.layout=org.apache.log4j.PatternLayout
log4j.appender.database.layout.ConversionPattern=[%-5p] %d(%r) --> [%t] %l: %m %x %n

# 自定义Appender
log4j.appender.im = net.cybercorlin.util.logger.appender.IMAppender
log4j.appender.im.host = mail.cybercorlin.net
log4j.appender.im.username = username
log4j.appender.im.password = password
log4j.appender.im.recipient = corlin@cybercorlin.net
log4j.appender.im.layout=org.apache.log4j.PatternLayout
log4j.appender.im.layout.ConversionPattern=[%-5p] %d(%r) --> [%t] %l: %m %x %n

xml配置文件读取

        String filePath = Thread.currentThread().getContextClassLoader().getResource("MemCachedConfig.xml").getPath().substring(1);
        File file = new File(filePath.replaceAll("%20"," "));
        try{
            if(file.exists()){ //如果可以成功加载配置文件
                SAXReader sr = new SAXReader();
                Document doc = sr.read(file);
                Element Root = doc.getRootElement(); //获得根节点
                Element Enabled = (Element)Root.selectSingleNode("Enabled"); //获得是否启用memcached节点
                Element Servers = (Element)Root.selectSingleNode("Servers"); //获得可用的服务器列表父节点
                Element Config = (Element)Root.selectSingleNode("Config"); //获得运行环境参数列表父节点                
            }
        }catch(Exception e){
            System.out.println(e.toString());
        }

   dom4j
   dom4j
   1.6