I have been monitoring, these middleware Zookeeper, Kafka…, usually only know a little bit of fur, they have been built and deployed, and have not been used. , Generally it is used by big data st
Category: Opensource
Open-source software (open-source) is a new term that is defined as software whose source code can be used by the public, and the use, modification, and distribution of this software are not restricted by licenses. Open source software is usually copyrighted, and its license may contain such restrictions: deliberate protection of its open source status, notice of authorship, or development control. “Open source” is being registered as a certification mark by public interest software organizations, which is also a means of creating a formal definition of open source.
High concurrent cache consistency problem
When the data is read:
Check the cache first, and the cache can’t check the database, and then put the checked results in the cache. These are basically not controversial.
But when the
[ZooKeeper_kafka] ZooKeeper and Kafka installation
1. wget https://mirrors.cnnic.cn/apache/zookeeper/stable/zookeeper-3.4.12.tar.gz
tar -zxvf zookeeper-3.4.12. tar.gz Unzip
2. cd zookeeper-3.4.12
cp -rf conf/zoo_sample.cfg conf /z
Installation deployment of Zookeeper + Kafka Cluster
Preparation work Upload zookeeper-3.4.6.tar.gz, scala-2.11.4.tgz, kafka_2.9.2-0.8.1.1.tgz, slf4j-1.7.6.zip to the /usr/local directory
Unzip the zookeeper installation package
# tar -zx
ZK small knot
One ZooKeeper function 1. File system
2. Notification mechanism
Each sub-directory item is called a znode. Like the file system, we can add and delete znodes freely. Add or delete sub-z
Springboot Series: Spring Boot Integrated Spring Cache
SVN error: [Previous Operation Has NOT Finished; Run ‘Cleanup’ IF IT WAS Interrupted]
Today, when a dozen or so class files were submitted in batches, during the code submission process to the SVN server, the computer suddenly got stuck and there was no response, so I decided to shu
ZooKeeper implements distributed lock safety
Background ConnectionLoss link is lost SessionExpired session expired Bypass zookeeper broker for status notification leader election Disconnect from zkNode Do idempotent Static expansion, dynamic
Do you know the Spring things control feature?
1. Transaction characteristics
Atomicity: Emphasizes the indivisibility of transactions
Consistency: Emphasizes that the integrity of the data must be consistent before and after the execution of t
Consistent Hachi Distribution
hash_ring
#- *- coding: utf-8 -*-
“”” hash_ring
~~~~~~~~~~~~~
Implements consistent hashing that can be used when
the number of server nodes can increase or decrease (like in memcached) .