org.apache.hadoop.chukwa.util
Class CopySequenceFile

java.lang.Object
  extended by org.apache.hadoop.chukwa.util.CopySequenceFile

public class CopySequenceFile
extends Object

This class is used by LocalToRemoteHDFSMover to convert .chukwa files to .done before moving them. By creating a new sequence file and copying all valid chunks to it, it makes sure that no corrupt sequence files get into HDFS.


Constructor Summary
CopySequenceFile()
           
 
Method Summary
static void createValidSequenceFile(org.apache.hadoop.conf.Configuration conf, String originalFileDir, String originalFileName, org.apache.hadoop.fs.FileSystem localFs)
           
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

CopySequenceFile

public CopySequenceFile()
Method Detail

createValidSequenceFile

public static void createValidSequenceFile(org.apache.hadoop.conf.Configuration conf,
                                           String originalFileDir,
                                           String originalFileName,
                                           org.apache.hadoop.fs.FileSystem localFs)


Copyright © 2011 Apache Software Foundation. All Rights Reserved.