您能为我提供为Facebook数据流配置Flume的步骤吗。
我们已经成功地配置了从Twitter中提取数据的水槽。
请查看我们为从twitter中提取数据而创建的配置。
Twitter 的Flume配置
TwitterAgent.sources = Twitter
TwitterAgent.channels = MemChannel
TwitterAgent.sinks = HDFS
# Describing/Configuring the source
TwitterAgent.sources.Twitter.type = org.apache.flume.source.twitter.TwitterSource
TwitterAgent.sources.Twitter.consumerKey = 4ENqf3q23iwdTSDJchv7w
TwitterAgent.sources.Twitter.consumerSecret = bAPTWfbRildBMWsEHo56SmZeXkftvZNCgvjHXbcUfAKoKzQjY0VIUOftTh6c
TwitterAgent.sources.Twitter.accessToken = 736128293661855746- rQIQYZNGCh9lW8XHCkjcnvwZH1BItnGi0XJ0gHM26F
TwitterAgent.sources.Twitter.accessTokenSecret = ehTsqX7GcU1aBqmekDcwPuu1csFOnfgzxc2EPtS0kudXOADeAAI
TwitterAgent.sources.Twitter.keywords = modi, india elections, bjp, congress, tdp,jana sena, pwan kalyan, mohanlal
# Describing/Configuring the sink
TwitterAgent.sinks.HDFS.type = hdfs
TwitterAgent.sinks.HDFS.hdfs.path = hdfs://env11-hadoop- master.trv.flytxt.com:54310/user/Hadoop/twitter_data
TwitterAgent.sinks.HDFS.hdfs.fileType = DataStream
TwitterAgent.sinks.HDFS.hdfs.writeFormat = writable
TwitterAgent.sinks.HDFS.hdfs.batchSize = 1
TwitterAgent.sinks.HDFS.hdfs.rollSize = 1
TwitterAgent.sinks.HDFS.hdfs.rollCount = 1
# Describing/Configuring the channel TwitterAgent.channels.MemChannel.type = memory
TwitterAgent.channels.MemChannel.capacity = 10000
TwitterAgent.channels.MemChannel.transactionCapacity = 100
TwitterAgent.channels.MemChannel.type = file
# Binding the source and sink to the channel
TwitterAgent.sources.Twitter.channels = MemChannel
TwitterAgent.sinks.HDFS.channel=内存通道
For configuring twitter we need the following configurations
TwitterAgent.sources.Twitter.consumerKey = 4ENqf3q23iwsdfmhadfjafjkemliSYs7w
TwitterAgent.sources.Twitter.consumerSecret = bAPTWfbRildangxvasxvhaxjasbxkjtvUfAKoKzQjY0VIUOftTh6c
TwitterAgent.sources.Twitter.accessToken = 7361282936618557ZNbcvHJxjxbnH1BItnGi0XJ0gHM26F
TwitterAgent.sources.Twitter.accessTokenSecret = ehTsASNMGCxvashgvcxjAHvcSFGcjahgPuu1csFO2EPtS0kudXOADeAAI
但是，如何获得相同的脸书？或者请使用Flume 为Facebook数据流提供工作配置
是的，您当然可以在Facebook的scribe工具的帮助下以日志的形式从Facebook接收数据。
关于scribe的安装部分，您可以参考：http://blog.octo.com/en/scribe-installation/
对于工作部分，您可以参考：http://blog.octo.com/en/scribe-a-way-to-aggregate-data-and-why-not-to-directly-fill-the-hdfs/