shwq.net
ǰλãҳ >> hADoop storm kAFkA FlumE Ϊʲô >>

hADoop storm kAFkA FlumE Ϊʲô

flume-kafka-plus:https://github.com/beyondj2ee/flumeng-kafka-plugin libĿ¼µ packageµ ŵflumelibĿ¼ עflume1.6.0лҪkafka-clients-0.8.2.2.jar ޸ԭеflume-confļ ڲһflume-con...

ɼ ҪʹFlume, Kafkaּ FlumeFlume ǹܵʽṩ˺ܶĬʵ֣ûͨ𣬼չAPI. KafkaKafkaһɳ־ûķֲʽϢС Kafka һdzͨõϵͳߺͺܶ...

ǰӦûиߣflume. flumeݣkafka spark streamingΪߣʵʱĴkafkaлȡݽм㡣 redisʵʱƼʹá flume+kafka+spark+redisʵʱռһ׾ܹ...

ò岻 һ㵽ҪʵʲôĿģ aԻõݵıļ bʱݵıļ

־ɼһҪļͨsocketһϵͳ£ƶӦûȥ޸ĽӿڣֱkafkaдݡʱܾҪflumeϵͳȥ䡣 updflume source...

ɼ ҪʹFlume, Kafkaּ FlumeFlume ǹܵʽṩ˺ܶĬʵ֣ûͨ𣬼չAPI. KafkaKafkaһɳ־ûķֲʽϢС Kafka һdzͨõϵͳߺͺܶ...

־ɼһҪļͨsocketһϵͳ£ƶӦûȥ޸ĽӿڣֱkafkaдݡʱܾҪflumeϵͳȥ䡣 updflume source...

ģ avroὫ־ռŵһļУﵽ趨ĴСDzִСRenamingǿkillʱִУ 2. UNBOUNDҲһʱ䣬ҵĽǣⲻһ䱨ϸһиûСERROR֮ʾUN...

Kafkaһɳ־ûķֲʽϢ

÷ 㿴ٷ As a result the performance of linear writes on a JBOD configuration with six 7200rpm SATA RAID-5 array is about 600MB/sec but the performance of random writes is only about 100k/seca difference

վҳ | վͼ
All rights reserved Powered by www.shwq.net
copyright ©right 2010-2021
磬ַϵͷzhit325@qq.com