An Research on the Reliability of a Distributed Message Queue

Donghu Yang · Computer Knowledge and Technology · 2015

Nowadays, the Internet has penetrated into every aspect of our daily lives. Every field of social life have the impact of bigdata transmission, and how to effectively use the data is particularly important. Distributed information system can effectively solvethe problem of transmission information in large scale distributed systems. So we need a high throughput, high performance and dis-tributed information system with a certain reliability. Kafka is a distributed information system with a massive data processing. Kaf-ka has efficient data transfer rate, and compared with other message queuing the system has higher performance. Using the publish/ subscribe model. This paper mainly introduces the Kafka system structure and characteristics, introduced the Kafka how to en-sure reliable transmission of messages with replica. And ensure reliability by experiments, in order to support the follow-up study.

Read the paper · More papers on PaperTik