Published : Jul 08, 2014
            
        NOT ON THE CURRENT EDITION
                
                    This blip is not on the current edition of the Radar. If it was on one of the last few editions, it is likely that it is still relevant. If the blip is older, it might no longer be relevant and our assessment might be different today. Unfortunately, we simply don't have the bandwidth to continuously review blips from previous editions of the Radar.
                    Understand more
                
            Jul 2014
                
                     Assess
                    
                        
    
                    
                    
                
                
                    
                     
                     When using techniques such as 'instrument all the things' and semantic logging, you may end up with huge amount of log data. Collecting, aggregating and moving this data can be problematic. Flume is a distributed system for exactly this purpose. It has a flexible architecture based on streaming data flows. With built-in support for HDFS, Flume can easily move multi-terabyte log data from many different sources to a centralized data store for further processing.
                
             
  
                        
                    
                    
                 
    
    
  