Skip navigation links
A B C D E F G H I K L M N O P R S T U V W 

A

AbstractAvroSerializer - Class in org.apache.storm.hdfs.avro
This abstract class can be extended to implement concrete classes capable of (de)serializing generic avro objects across a Topology.
AbstractAvroSerializer() - Constructor for class org.apache.storm.hdfs.avro.AbstractAvroSerializer
 
AbstractHdfsBolt - Class in org.apache.storm.hdfs.bolt
 
AbstractHdfsBolt() - Constructor for class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
 
ack(Object) - Method in class org.apache.storm.hdfs.spout.HdfsSpout
 
acquireOldestExpiredLock(FileSystem, Path, int, String) - Static method in class org.apache.storm.hdfs.spout.FileLock
Finds a oldest expired lock file (using modification timestamp), then takes ownership of the lock file Impt: Assumes access to lockFilesDir has been externally synchronized such that only one thread accessing the same thread
addAvroKryoSerializations(Config) - Static method in class org.apache.storm.hdfs.avro.AvroUtils
A helper method to extract avro serialization configurations from the topology configuration and register specific kryo serializers as necessary.
addRotationAction(RotationAction) - Method in class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt
 
addRotationAction(RotationAction) - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
 
addRotationAction(RotationAction) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
 
addRotationAction(RotationAction) - Method in class org.apache.storm.hdfs.trident.HdfsState.HdfsFileOptions
Deprecated.
addRotationAction(RotationAction) - Method in class org.apache.storm.hdfs.trident.HdfsState.SequenceFileOptions
 
addTokensToUGI(Subject) - Method in class org.apache.storm.hdfs.common.security.AutoHDFS
 
ARCHIVE_DIR - Static variable in class org.apache.storm.hdfs.spout.Configs
 
AutoHDFS - Class in org.apache.storm.hdfs.common.security
Automatically get HDFS delegation tokens and push it to user’s topology.
AutoHDFS() - Constructor for class org.apache.storm.hdfs.common.security.AutoHDFS
 
AvroGenericRecordBolt - Class in org.apache.storm.hdfs.bolt
 
AvroGenericRecordBolt() - Constructor for class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt
 
AvroSchemaRegistry - Interface in org.apache.storm.hdfs.avro
 
AvroUtils - Class in org.apache.storm.hdfs.avro
 
AvroUtils() - Constructor for class org.apache.storm.hdfs.avro.AvroUtils
 

B

BAD_DIR - Static variable in class org.apache.storm.hdfs.spout.Configs
 
beginCommit(Long) - Method in class org.apache.storm.hdfs.trident.HdfsState
 
BLOBSTORE_DIR_PERMISSION - Static variable in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreImpl
 
BLOBSTORE_FILE_PERMISSION - Static variable in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreFile
 
BUFFER_SIZE - Static variable in class org.apache.storm.hdfs.spout.SequenceFileReader
 
BUFFER_SIZE - Static variable in class org.apache.storm.hdfs.spout.TextFileReader
 

C

cancel() - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreFile
 
CHARSET - Static variable in class org.apache.storm.hdfs.spout.TextFileReader
 
CLOCKS_INSYNC - Static variable in class org.apache.storm.hdfs.spout.Configs
 
clone() - Method in class org.apache.storm.hdfs.spout.SequenceFileReader.Offset
 
clone() - Method in class org.apache.storm.hdfs.spout.TextFileReader.Offset
 
close() - Method in class org.apache.storm.hdfs.spout.SequenceFileReader
 
close() - Method in class org.apache.storm.hdfs.spout.TextFileReader
 
closeOutputFile() - Method in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
 
closeOutputFile() - Method in class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt
 
closeOutputFile() - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
 
closeOutputFile() - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
 
collector - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
 
commit() - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreFile
 
commit(Long) - Method in class org.apache.storm.hdfs.trident.HdfsState
 
COMMIT_FREQ_COUNT - Static variable in class org.apache.storm.hdfs.spout.Configs
 
COMMIT_FREQ_SEC - Static variable in class org.apache.storm.hdfs.spout.Configs
 
compare(FileStatus, FileStatus) - Method in class org.apache.storm.hdfs.common.ModifTimeComparator
 
compareTo(FileOffset) - Method in class org.apache.storm.hdfs.spout.SequenceFileReader.Offset
 
compareTo(FileOffset) - Method in class org.apache.storm.hdfs.spout.TextFileReader.Offset
 
componentID - Variable in class org.apache.storm.hdfs.spout.FileLock.LogEntry
 
configKey - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
 
configKey - Variable in class org.apache.storm.hdfs.trident.HdfsState.Options
 
Configs - Class in org.apache.storm.hdfs.spout
 
Configs() - Constructor for class org.apache.storm.hdfs.spout.Configs
 
ConfluentAvroSerializer - Class in org.apache.storm.hdfs.avro
This class provides a mechanism to utilize the Confluent Schema Registry (https://github.com/confluentinc/schema-registry) for Storm to (de)serialize Avro generic records across a topology.
ConfluentAvroSerializer(Kryo, Map) - Constructor for class org.apache.storm.hdfs.avro.ConfluentAvroSerializer
A constructor with a signature that Storm can locate and use with kryo registration.
CountSyncPolicy - Class in org.apache.storm.hdfs.bolt.sync
SyncPolicy implementation that will trigger a file system sync after a certain number of tuples have been processed.
CountSyncPolicy(int) - Constructor for class org.apache.storm.hdfs.bolt.sync.CountSyncPolicy
 
CountSyncPolicy - Class in org.apache.storm.hdfs.trident.sync
SyncPolicy implementation that will trigger a file system sync after a certain number of tuples have been processed.
CountSyncPolicy(int) - Constructor for class org.apache.storm.hdfs.trident.sync.CountSyncPolicy
 
createBlob(String, SettableBlobMeta, Subject) - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStore
 
createBlobToExtend(String, SettableBlobMeta) - Method in class org.apache.storm.hdfs.blobstore.HdfsClientBlobStore
 
createOutputFile() - Method in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
 
createOutputFile() - Method in class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt
 
createOutputFile() - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
 
createOutputFile() - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
 
createStateInZookeeper(String) - Method in class org.apache.storm.hdfs.blobstore.HdfsClientBlobStore
 
currentRecord - Variable in class org.apache.storm.hdfs.spout.SequenceFileReader.Offset
 

D

declareOutputFields(OutputFieldsDeclarer) - Method in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
 
declareOutputFields(OutputFieldsDeclarer) - Method in class org.apache.storm.hdfs.spout.HdfsSpout
 
DEFAULT_COMMIT_FREQ_COUNT - Static variable in class org.apache.storm.hdfs.spout.Configs
 
DEFAULT_COMMIT_FREQ_SEC - Static variable in class org.apache.storm.hdfs.spout.Configs
 
DEFAULT_FIELD_DELIMITER - Static variable in class org.apache.storm.hdfs.bolt.format.DelimitedRecordFormat
 
DEFAULT_FIELD_DELIMITER - Static variable in class org.apache.storm.hdfs.trident.format.DelimitedRecordFormat
 
DEFAULT_HDFS_CONFIG_KEY - Static variable in class org.apache.storm.hdfs.spout.Configs
 
DEFAULT_LOCK_DIR - Static variable in class org.apache.storm.hdfs.spout.Configs
 
DEFAULT_LOCK_TIMEOUT - Static variable in class org.apache.storm.hdfs.spout.Configs
 
DEFAULT_MAX_OUTSTANDING - Static variable in class org.apache.storm.hdfs.spout.Configs
 
DEFAULT_RECORD_DELIMITER - Static variable in class org.apache.storm.hdfs.bolt.format.DelimitedRecordFormat
 
DEFAULT_RECORD_DELIMITER - Static variable in class org.apache.storm.hdfs.trident.format.DelimitedRecordFormat
 
defaultFields - Static variable in class org.apache.storm.hdfs.spout.SequenceFileReader
 
defaultFields - Static variable in class org.apache.storm.hdfs.spout.TextFileReader
 
DefaultFileNameFormat - Class in org.apache.storm.hdfs.bolt.format
Creates file names with the following format:
DefaultFileNameFormat() - Constructor for class org.apache.storm.hdfs.bolt.format.DefaultFileNameFormat
 
DefaultFileNameFormat - Class in org.apache.storm.hdfs.trident.format
Creates file names with the following format:
DefaultFileNameFormat() - Constructor for class org.apache.storm.hdfs.trident.format.DefaultFileNameFormat
 
DefaultSequenceFormat - Class in org.apache.storm.hdfs.bolt.format
Basic SequenceFormat implementation that uses LongWritable for keys and Text for values.
DefaultSequenceFormat(String, String) - Constructor for class org.apache.storm.hdfs.bolt.format.DefaultSequenceFormat
 
DefaultSequenceFormat - Class in org.apache.storm.hdfs.trident.format
Basic SequenceFormat implementation that uses LongWritable for keys and Text for values.
DefaultSequenceFormat(String, String) - Constructor for class org.apache.storm.hdfs.trident.format.DefaultSequenceFormat
 
delete() - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreFile
 
delete(Path) - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreImpl
 
deleteBlob(String, Subject) - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStore
 
deleteBlob(String) - Method in class org.apache.storm.hdfs.blobstore.HdfsClientBlobStore
 
deleteKey(String) - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreImpl
Delete a key from the blob store
DelimitedRecordFormat - Class in org.apache.storm.hdfs.bolt.format
RecordFormat implementation that uses field and record delimiters.
DelimitedRecordFormat() - Constructor for class org.apache.storm.hdfs.bolt.format.DelimitedRecordFormat
 
DelimitedRecordFormat - Class in org.apache.storm.hdfs.trident.format
RecordFormat implementation that uses field and record delimiters.
DelimitedRecordFormat() - Constructor for class org.apache.storm.hdfs.trident.format.DelimitedRecordFormat
 
deserialize(String) - Static method in class org.apache.storm.hdfs.spout.FileLock.LogEntry
 
DIR_LOCK_FILE - Static variable in class org.apache.storm.hdfs.spout.DirLock
 
DirLock - Class in org.apache.storm.hdfs.spout
Facility to synchronize access to HDFS directory.
doCommit(Long) - Method in class org.apache.storm.hdfs.trident.HdfsState.HdfsFileOptions
 
doCommit(Long) - Method in class org.apache.storm.hdfs.trident.HdfsState.SequenceFileOptions
 
doPrepare(Map, TopologyContext, OutputCollector) - Method in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
 
doPrepare(Map, TopologyContext, OutputCollector) - Method in class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt
 
doPrepare(Map, TopologyContext, OutputCollector) - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
 
doPrepare(Map, TopologyContext, OutputCollector) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
 
dumpState(PrintStream) - Method in class org.apache.storm.hdfs.spout.ProgressTracker
 

E

emitData(List<Object>, HdfsSpout.MessageId) - Method in class org.apache.storm.hdfs.spout.HdfsSpout
 
equals(Object) - Method in class org.apache.storm.hdfs.spout.FileLock.LogEntry
 
equals(Object) - Method in class org.apache.storm.hdfs.spout.SequenceFileReader.Offset
 
equals(Object) - Method in class org.apache.storm.hdfs.spout.TextFileReader.Offset
 
eventTime - Variable in class org.apache.storm.hdfs.spout.FileLock.LogEntry
 
execute(Tuple) - Method in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
 
execute(FileSystem, Path) - Method in class org.apache.storm.hdfs.common.rotation.MoveFileAction
 
execute(FileSystem, Path) - Method in interface org.apache.storm.hdfs.common.rotation.RotationAction
 
execute(List<TridentTuple>) - Method in class org.apache.storm.hdfs.trident.HdfsState.HdfsFileOptions
 
execute(List<TridentTuple>) - Method in class org.apache.storm.hdfs.trident.HdfsState.SequenceFileOptions
 
exists(String) - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreImpl
Check if the key exists in the blob store.

F

fail(Object) - Method in class org.apache.storm.hdfs.spout.HdfsSpout
 
FileLock - Class in org.apache.storm.hdfs.spout
Facility to synchronize access to HDFS files.
FileLock.LogEntry - Class in org.apache.storm.hdfs.spout
 
fileNameFormat - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
 
FileNameFormat - Interface in org.apache.storm.hdfs.bolt.format
Formatter interface for determining HDFS file names.
FileNameFormat - Interface in org.apache.storm.hdfs.trident.format
Formatter interface for determining HDFS file names.
fileNameFormat - Variable in class org.apache.storm.hdfs.trident.HdfsState.Options
 
fileOffset - Variable in class org.apache.storm.hdfs.spout.FileLock.LogEntry
 
fileRetryCount - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
 
FileRotationPolicy - Interface in org.apache.storm.hdfs.bolt.rotation
Used by the HdfsBolt to decide when to rotate files.
FileRotationPolicy - Interface in org.apache.storm.hdfs.trident.rotation
Used by the HdfsBolt to decide when to rotate files.
FileSizeRotationPolicy - Class in org.apache.storm.hdfs.bolt.rotation
File rotation policy that will rotate files when a certain file size is reached.
FileSizeRotationPolicy(float, FileSizeRotationPolicy.Units) - Constructor for class org.apache.storm.hdfs.bolt.rotation.FileSizeRotationPolicy
 
FileSizeRotationPolicy - Class in org.apache.storm.hdfs.trident.rotation
File rotation policy that will rotate files when a certain file size is reached.
FileSizeRotationPolicy(float, FileSizeRotationPolicy.Units) - Constructor for class org.apache.storm.hdfs.trident.rotation.FileSizeRotationPolicy
 
FileSizeRotationPolicy.Units - Enum in org.apache.storm.hdfs.bolt.rotation
 
FileSizeRotationPolicy.Units - Enum in org.apache.storm.hdfs.trident.rotation
 
FixedAvroSerializer - Class in org.apache.storm.hdfs.avro
A class to help (de)serialize a pre-defined set of Avro schemas.
FixedAvroSerializer() - Constructor for class org.apache.storm.hdfs.avro.FixedAvroSerializer
 
format(Tuple) - Method in class org.apache.storm.hdfs.bolt.format.DelimitedRecordFormat
 
format(Tuple) - Method in interface org.apache.storm.hdfs.bolt.format.RecordFormat
 
format(TridentTuple) - Method in class org.apache.storm.hdfs.trident.format.DelimitedRecordFormat
 
format(TridentTuple) - Method in interface org.apache.storm.hdfs.trident.format.RecordFormat
 
format - Variable in class org.apache.storm.hdfs.trident.HdfsState.HdfsFileOptions
 
fs - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
 
fs - Variable in class org.apache.storm.hdfs.trident.HdfsState.Options
 
fsUrl - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
 
fsUrl - Variable in class org.apache.storm.hdfs.trident.HdfsState.Options
 
fullCleanup(long) - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStore
 
fullCleanup(long) - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreImpl
 

G

GenericAvroSerializer - Class in org.apache.storm.hdfs.avro
A default implementation of the AvroSerializer that will just pass literal schemas back and forth.
GenericAvroSerializer() - Constructor for class org.apache.storm.hdfs.avro.GenericAvroSerializer
 
getBlob(String, Subject) - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStore
 
getBlob(String) - Method in class org.apache.storm.hdfs.blobstore.HdfsClientBlobStore
 
getBlobMeta(String, Subject) - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStore
 
getBlobMeta(String) - Method in class org.apache.storm.hdfs.blobstore.HdfsClientBlobStore
 
getBlobReplication(String, Subject) - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStore
 
getBlobReplication(String) - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreImpl
 
getBlobReplication(String) - Method in class org.apache.storm.hdfs.blobstore.HdfsClientBlobStore
 
getByteCount() - Method in enum org.apache.storm.hdfs.bolt.rotation.FileSizeRotationPolicy.Units
 
getByteCount() - Method in enum org.apache.storm.hdfs.trident.rotation.FileSizeRotationPolicy.Units
 
getCollector() - Method in class org.apache.storm.hdfs.spout.HdfsSpout
 
getCommitPosition() - Method in class org.apache.storm.hdfs.spout.ProgressTracker
 
getComponentConfiguration() - Method in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
 
getCredentialKey() - Method in class org.apache.storm.hdfs.common.security.AutoHDFS
 
getCredentials(Map<String, String>) - Method in class org.apache.storm.hdfs.common.security.AutoHDFS
 
getCurrentOffset() - Method in class org.apache.storm.hdfs.trident.HdfsState.HdfsFileOptions
 
getCurrentOffset() - Method in class org.apache.storm.hdfs.trident.HdfsState.SequenceFileOptions
 
getFileLength() - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreFile
 
getFileOffset() - Method in class org.apache.storm.hdfs.spout.SequenceFileReader
 
getFileOffset() - Method in class org.apache.storm.hdfs.spout.TextFileReader
 
getFingerprint(Schema) - Method in interface org.apache.storm.hdfs.avro.AvroSchemaRegistry
 
getFingerprint(Schema) - Method in class org.apache.storm.hdfs.avro.ConfluentAvroSerializer
 
getFingerprint(Schema) - Method in class org.apache.storm.hdfs.avro.FixedAvroSerializer
 
getFingerprint(Schema) - Method in class org.apache.storm.hdfs.avro.GenericAvroSerializer
 
getHadoopCredentials(Map) - Method in class org.apache.storm.hdfs.common.security.AutoHDFS
 
getInputStream() - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreFile
 
getInterval() - Method in class org.apache.storm.hdfs.bolt.rotation.TimedRotationPolicy
 
getInterval() - Method in class org.apache.storm.hdfs.trident.rotation.TimedRotationPolicy
 
getKey() - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreFile
 
getKey() - Method in class org.apache.storm.hdfs.common.HdfsUtils.Pair
 
getKeyDir(String) - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreImpl
 
getLastEntry(FileSystem, Path) - Static method in class org.apache.storm.hdfs.spout.FileLock
returns the last log entry
getLastEntryIfStale(FileSystem, Path, long) - Static method in class org.apache.storm.hdfs.spout.FileLock
checks if lockFile is older than ‘olderThan’ UTC time by examining the modification time on file and (if necessary) the timestamp in last log entry in the file.
getLastLogEntry() - Method in class org.apache.storm.hdfs.spout.FileLock
 
getLockDirPath() - Method in class org.apache.storm.hdfs.spout.HdfsSpout
 
getLockFile() - Method in class org.apache.storm.hdfs.spout.DirLock
 
getLockFile() - Method in class org.apache.storm.hdfs.spout.FileLock
 
getMaxBytes() - Method in class org.apache.storm.hdfs.trident.rotation.FileSizeRotationPolicy
 
getMetadata() - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreFile
 
getMilliSeconds() - Method in enum org.apache.storm.hdfs.bolt.rotation.TimedRotationPolicy.TimeUnit
 
getMilliSeconds() - Method in enum org.apache.storm.hdfs.trident.rotation.TimedRotationPolicy.TimeUnit
 
getModTime() - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreFile
 
getName(long, long) - Method in class org.apache.storm.hdfs.bolt.format.DefaultFileNameFormat
 
getName(long, long) - Method in interface org.apache.storm.hdfs.bolt.format.FileNameFormat
Returns the filename the HdfsBolt will create.
getName(long, long) - Method in class org.apache.storm.hdfs.trident.format.DefaultFileNameFormat
 
getName(long, long) - Method in interface org.apache.storm.hdfs.trident.format.FileNameFormat
Returns the filename the HdfsBolt will create.
getOutputStream() - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreFile
 
getPath() - Method in class org.apache.storm.hdfs.bolt.format.DefaultFileNameFormat
 
getPath() - Method in interface org.apache.storm.hdfs.bolt.format.FileNameFormat
 
getPath() - Method in class org.apache.storm.hdfs.trident.format.DefaultFileNameFormat
 
getPath() - Method in interface org.apache.storm.hdfs.trident.format.FileNameFormat
 
getSchema(String) - Method in interface org.apache.storm.hdfs.avro.AvroSchemaRegistry
 
getSchema(String) - Method in class org.apache.storm.hdfs.avro.ConfluentAvroSerializer
 
getSchema(String) - Method in class org.apache.storm.hdfs.avro.FixedAvroSerializer
 
getSchema(String) - Method in class org.apache.storm.hdfs.avro.GenericAvroSerializer
 
getValue() - Method in class org.apache.storm.hdfs.common.HdfsUtils.Pair
 

H

hashCode() - Method in class org.apache.storm.hdfs.spout.FileLock.LogEntry
 
hashCode() - Method in class org.apache.storm.hdfs.spout.SequenceFileReader.Offset
 
hashCode() - Method in class org.apache.storm.hdfs.spout.TextFileReader.Offset
 
hasNext() - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreImpl.KeyInHashDirIterator
 
HDFS_CREDENTIALS - Static variable in class org.apache.storm.hdfs.common.security.AutoHDFS
 
HDFS_URI - Static variable in class org.apache.storm.hdfs.spout.Configs
 
HdfsBlobStore - Class in org.apache.storm.hdfs.blobstore
Provides a HDFS file system backed blob store implementation.
HdfsBlobStore() - Constructor for class org.apache.storm.hdfs.blobstore.HdfsBlobStore
 
HdfsBlobStoreFile - Class in org.apache.storm.hdfs.blobstore
 
HdfsBlobStoreFile(Path, String, Configuration) - Constructor for class org.apache.storm.hdfs.blobstore.HdfsBlobStoreFile
 
HdfsBlobStoreFile(Path, boolean, boolean, Configuration) - Constructor for class org.apache.storm.hdfs.blobstore.HdfsBlobStoreFile
 
HdfsBlobStoreImpl - Class in org.apache.storm.hdfs.blobstore
HDFS blob store impl.
HdfsBlobStoreImpl(Path, Map<String, Object>) - Constructor for class org.apache.storm.hdfs.blobstore.HdfsBlobStoreImpl
 
HdfsBlobStoreImpl(Path, Map<String, Object>, Configuration) - Constructor for class org.apache.storm.hdfs.blobstore.HdfsBlobStoreImpl
 
HdfsBlobStoreImpl.KeyInHashDirIterator - Class in org.apache.storm.hdfs.blobstore
 
HdfsBolt - Class in org.apache.storm.hdfs.bolt
 
HdfsBolt() - Constructor for class org.apache.storm.hdfs.bolt.HdfsBolt
 
HdfsClientBlobStore - Class in org.apache.storm.hdfs.blobstore
Client to access the HDFS blobStore.
HdfsClientBlobStore() - Constructor for class org.apache.storm.hdfs.blobstore.HdfsClientBlobStore
 
hdfsConfig - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
 
hdfsConfig - Variable in class org.apache.storm.hdfs.trident.HdfsState.Options
 
HdfsFileOptions() - Constructor for class org.apache.storm.hdfs.trident.HdfsState.HdfsFileOptions
 
HdfsSecurityUtil - Class in org.apache.storm.hdfs.common.security
This class provides util methods for storm-hdfs connector communicating with secured HDFS.
HdfsSecurityUtil() - Constructor for class org.apache.storm.hdfs.common.security.HdfsSecurityUtil
 
HdfsSpout - Class in org.apache.storm.hdfs.spout
 
HdfsSpout() - Constructor for class org.apache.storm.hdfs.spout.HdfsSpout
 
HdfsState - Class in org.apache.storm.hdfs.trident
 
HdfsState.HdfsFileOptions - Class in org.apache.storm.hdfs.trident
 
HdfsState.Options - Class in org.apache.storm.hdfs.trident
 
HdfsState.SequenceFileOptions - Class in org.apache.storm.hdfs.trident
 
HdfsStateFactory - Class in org.apache.storm.hdfs.trident
 
HdfsStateFactory() - Constructor for class org.apache.storm.hdfs.trident.HdfsStateFactory
 
HdfsUpdater - Class in org.apache.storm.hdfs.trident
 
HdfsUpdater() - Constructor for class org.apache.storm.hdfs.trident.HdfsUpdater
 
HdfsUtils - Class in org.apache.storm.hdfs.common
 
HdfsUtils() - Constructor for class org.apache.storm.hdfs.common.HdfsUtils
 
HdfsUtils.Pair<K,V> - Class in org.apache.storm.hdfs.common
 
heartbeat(String) - Method in class org.apache.storm.hdfs.spout.FileLock
 

I

IGNORE_SUFFIX - Static variable in class org.apache.storm.hdfs.spout.Configs
 
isNextOffset(FileOffset) - Method in class org.apache.storm.hdfs.spout.SequenceFileReader.Offset
 
isNextOffset(FileOffset) - Method in class org.apache.storm.hdfs.spout.TextFileReader.Offset
 
isTmp() - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreFile
 

K

key(Tuple) - Method in class org.apache.storm.hdfs.bolt.format.DefaultSequenceFormat
 
key(Tuple) - Method in interface org.apache.storm.hdfs.bolt.format.SequenceFormat
Given a tuple, return the key that should be written to the sequence file.
key(TridentTuple) - Method in class org.apache.storm.hdfs.trident.format.DefaultSequenceFormat
 
key(TridentTuple) - Method in interface org.apache.storm.hdfs.trident.format.SequenceFormat
Given a tuple, return the key that should be written to the sequence file.
keyClass() - Method in class org.apache.storm.hdfs.bolt.format.DefaultSequenceFormat
 
keyClass() - Method in interface org.apache.storm.hdfs.bolt.format.SequenceFormat
Key class used by implementation (e.g.
keyClass() - Method in class org.apache.storm.hdfs.trident.format.DefaultSequenceFormat
 
keyClass() - Method in interface org.apache.storm.hdfs.trident.format.SequenceFormat
Key class used by implementation (e.g.
KeyInHashDirIterator() - Constructor for class org.apache.storm.hdfs.blobstore.HdfsBlobStoreImpl.KeyInHashDirIterator
 

L

lastSyncPoint - Variable in class org.apache.storm.hdfs.spout.SequenceFileReader.Offset
 
listBlobStoreFiles(Path) - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreImpl
 
listFilesByModificationTime(FileSystem, Path, long) - Static method in class org.apache.storm.hdfs.common.HdfsUtils
list files sorted by modification time that have not been modified since ‘olderThan’.
listKeys() - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStore
 
listKeys() - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreImpl
 
listKeys(Path) - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreImpl
 
listKeys() - Method in class org.apache.storm.hdfs.blobstore.HdfsClientBlobStore
 
locateOldestExpiredLock(FileSystem, Path, int) - Static method in class org.apache.storm.hdfs.spout.FileLock
Finds oldest expired lock file (using modification timestamp), then takes ownership of the lock file Impt: Assumes access to lockFilesDir has been externally synchronized such that only one thread accessing the same thread
LOCK_DIR - Static variable in class org.apache.storm.hdfs.spout.Configs
 
LOCK_TIMEOUT - Static variable in class org.apache.storm.hdfs.spout.Configs
 
LOG - Static variable in class org.apache.storm.hdfs.blobstore.HdfsBlobStore
 
LOG - Static variable in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreFile
 
LOG - Static variable in class org.apache.storm.hdfs.trident.HdfsState
 
LogEntry(long, String, String) - Constructor for class org.apache.storm.hdfs.spout.FileLock.LogEntry
 
login(Map, Configuration) - Static method in class org.apache.storm.hdfs.common.security.HdfsSecurityUtil
 

M

main(String[]) - Static method in class org.apache.storm.hdfs.common.security.AutoHDFS
 
makeState(Map, IMetricsContext, int, int) - Method in class org.apache.storm.hdfs.trident.HdfsStateFactory
 
mark(Tuple, long) - Method in interface org.apache.storm.hdfs.bolt.rotation.FileRotationPolicy
Called for every tuple the HdfsBolt executes.
mark(Tuple, long) - Method in class org.apache.storm.hdfs.bolt.rotation.FileSizeRotationPolicy
 
mark(Tuple, long) - Method in class org.apache.storm.hdfs.bolt.rotation.NoRotationPolicy
 
mark(Tuple, long) - Method in class org.apache.storm.hdfs.bolt.rotation.TimedRotationPolicy
Called for every tuple the HdfsBolt executes.
mark(Tuple, long) - Method in class org.apache.storm.hdfs.bolt.sync.CountSyncPolicy
 
mark(Tuple, long) - Method in interface org.apache.storm.hdfs.bolt.sync.SyncPolicy
Called for every tuple the HdfsBolt executes.
mark(TridentTuple, long) - Method in interface org.apache.storm.hdfs.trident.rotation.FileRotationPolicy
Called for every tuple the HdfsBolt executes.
mark(long) - Method in interface org.apache.storm.hdfs.trident.rotation.FileRotationPolicy
Check if a file rotation should be performed based on the offset at which file is being written.
mark(TridentTuple, long) - Method in class org.apache.storm.hdfs.trident.rotation.FileSizeRotationPolicy
 
mark(long) - Method in class org.apache.storm.hdfs.trident.rotation.FileSizeRotationPolicy
 
mark(TridentTuple, long) - Method in class org.apache.storm.hdfs.trident.rotation.NoRotationPolicy
 
mark(long) - Method in class org.apache.storm.hdfs.trident.rotation.NoRotationPolicy
 
mark(TridentTuple, long) - Method in class org.apache.storm.hdfs.trident.rotation.TimedRotationPolicy
Called for every tuple the HdfsBolt executes.
mark(long) - Method in class org.apache.storm.hdfs.trident.rotation.TimedRotationPolicy
 
mark(TridentTuple, long) - Method in class org.apache.storm.hdfs.trident.sync.CountSyncPolicy
 
mark(TridentTuple, long) - Method in interface org.apache.storm.hdfs.trident.sync.SyncPolicy
Called for every tuple the HdfsBolt executes.
MAX_OUTSTANDING - Static variable in class org.apache.storm.hdfs.spout.Configs
 
ModifTimeComparator - Class in org.apache.storm.hdfs.common
 
ModifTimeComparator() - Constructor for class org.apache.storm.hdfs.common.ModifTimeComparator
 
MoveFileAction - Class in org.apache.storm.hdfs.common.rotation
 
MoveFileAction() - Constructor for class org.apache.storm.hdfs.common.rotation.MoveFileAction
 

N

next() - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreImpl.KeyInHashDirIterator
 
next() - Method in class org.apache.storm.hdfs.spout.SequenceFileReader
 
next() - Method in class org.apache.storm.hdfs.spout.TextFileReader
 
nextTuple() - Method in class org.apache.storm.hdfs.spout.HdfsSpout
 
NoRotationPolicy - Class in org.apache.storm.hdfs.bolt.rotation
File rotation policy that will never rotate… Just one big file.
NoRotationPolicy() - Constructor for class org.apache.storm.hdfs.bolt.rotation.NoRotationPolicy
 
NoRotationPolicy - Class in org.apache.storm.hdfs.trident.rotation
File rotation policy that will never rotate… Just one big file.
NoRotationPolicy() - Constructor for class org.apache.storm.hdfs.trident.rotation.NoRotationPolicy
 

O

of(K, V) - Static method in class org.apache.storm.hdfs.common.HdfsUtils.Pair
 
offset - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
 
Offset(long, long, long) - Constructor for class org.apache.storm.hdfs.spout.SequenceFileReader.Offset
 
Offset(long, long, long, long, long) - Constructor for class org.apache.storm.hdfs.spout.SequenceFileReader.Offset
 
Offset(String) - Constructor for class org.apache.storm.hdfs.spout.SequenceFileReader.Offset
 
Offset(long, long) - Constructor for class org.apache.storm.hdfs.spout.TextFileReader.Offset
 
Offset(String) - Constructor for class org.apache.storm.hdfs.spout.TextFileReader.Offset
 
open(Map, TopologyContext, SpoutOutputCollector) - Method in class org.apache.storm.hdfs.spout.HdfsSpout
 
Options() - Constructor for class org.apache.storm.hdfs.trident.HdfsState.Options
 
org.apache.storm.hdfs.avro - package org.apache.storm.hdfs.avro
 
org.apache.storm.hdfs.blobstore - package org.apache.storm.hdfs.blobstore
 
org.apache.storm.hdfs.bolt - package org.apache.storm.hdfs.bolt
 
org.apache.storm.hdfs.bolt.format - package org.apache.storm.hdfs.bolt.format
 
org.apache.storm.hdfs.bolt.rotation - package org.apache.storm.hdfs.bolt.rotation
 
org.apache.storm.hdfs.bolt.sync - package org.apache.storm.hdfs.bolt.sync
 
org.apache.storm.hdfs.common - package org.apache.storm.hdfs.common
 
org.apache.storm.hdfs.common.rotation - package org.apache.storm.hdfs.common.rotation
 
org.apache.storm.hdfs.common.security - package org.apache.storm.hdfs.common.security
 
org.apache.storm.hdfs.spout - package org.apache.storm.hdfs.spout
 
org.apache.storm.hdfs.trident - package org.apache.storm.hdfs.trident
 
org.apache.storm.hdfs.trident.format - package org.apache.storm.hdfs.trident.format
 
org.apache.storm.hdfs.trident.rotation - package org.apache.storm.hdfs.trident.rotation
 
org.apache.storm.hdfs.trident.sync - package org.apache.storm.hdfs.trident.sync
 

P

Pair(K, V) - Constructor for class org.apache.storm.hdfs.common.HdfsUtils.Pair
 
ParseException - Exception in org.apache.storm.hdfs.spout
 
ParseException(String, Throwable) - Constructor for exception org.apache.storm.hdfs.spout.ParseException
 
populateCredentials(Map<String, String>, Map) - Method in class org.apache.storm.hdfs.common.security.AutoHDFS
 
populateCredentials(Map<String, String>) - Method in class org.apache.storm.hdfs.common.security.AutoHDFS
 
populateSubject(Subject, Map<String, String>) - Method in class org.apache.storm.hdfs.common.security.AutoHDFS
prepare(Map, String, NimbusInfo) - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStore
 
prepare(Map) - Method in class org.apache.storm.hdfs.blobstore.HdfsClientBlobStore
 
prepare(Map, TopologyContext, OutputCollector) - Method in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
Marked as final to prevent override.
prepare(Map, TopologyContext) - Method in class org.apache.storm.hdfs.bolt.format.DefaultFileNameFormat
 
prepare(Map, TopologyContext) - Method in interface org.apache.storm.hdfs.bolt.format.FileNameFormat
 
prepare(Map) - Method in class org.apache.storm.hdfs.common.security.AutoHDFS
 
prepare(Map, int, int) - Method in class org.apache.storm.hdfs.trident.format.DefaultFileNameFormat
 
prepare(Map, int, int) - Method in interface org.apache.storm.hdfs.trident.format.FileNameFormat
 
prepareInternal(Map, String, Configuration) - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStore
Allow a Hadoop Configuration to be passed for testing.
ProgressTracker - Class in org.apache.storm.hdfs.spout
 
ProgressTracker() - Constructor for class org.apache.storm.hdfs.spout.ProgressTracker
 

R

read(Kryo, Input, Class<GenericContainer>) - Method in class org.apache.storm.hdfs.avro.AbstractAvroSerializer
 
read(String) - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreImpl
Get an input stream for reading a part.
READER_TYPE - Static variable in class org.apache.storm.hdfs.spout.Configs
 
recordAckedOffset(FileOffset) - Method in class org.apache.storm.hdfs.spout.ProgressTracker
 
RecordFormat - Interface in org.apache.storm.hdfs.bolt.format
Formats a Tuple object into a byte array that will be written to HDFS.
RecordFormat - Interface in org.apache.storm.hdfs.trident.format
Formats a Tuple object into a byte array that will be written to HDFS.
recordsSinceLastSync - Variable in class org.apache.storm.hdfs.spout.SequenceFileReader.Offset
 
release() - Method in class org.apache.storm.hdfs.spout.DirLock
Release lock on dir by deleting the lock file
release() - Method in class org.apache.storm.hdfs.spout.FileLock
Release lock by deleting file
remove() - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreImpl.KeyInHashDirIterator
 
renew(Map<String, String>, Map) - Method in class org.apache.storm.hdfs.common.security.AutoHDFS
reset() - Method in interface org.apache.storm.hdfs.bolt.rotation.FileRotationPolicy
Called after the HdfsBolt rotates a file.
reset() - Method in class org.apache.storm.hdfs.bolt.rotation.FileSizeRotationPolicy
 
reset() - Method in class org.apache.storm.hdfs.bolt.rotation.NoRotationPolicy
 
reset() - Method in class org.apache.storm.hdfs.bolt.rotation.TimedRotationPolicy
Called after the HdfsBolt rotates a file.
reset() - Method in class org.apache.storm.hdfs.bolt.sync.CountSyncPolicy
 
reset() - Method in interface org.apache.storm.hdfs.bolt.sync.SyncPolicy
Called after the HdfsBolt performs a sync.
reset() - Method in interface org.apache.storm.hdfs.trident.rotation.FileRotationPolicy
Called after the HdfsBolt rotates a file.
reset() - Method in class org.apache.storm.hdfs.trident.rotation.FileSizeRotationPolicy
 
reset() - Method in class org.apache.storm.hdfs.trident.rotation.NoRotationPolicy
 
reset() - Method in class org.apache.storm.hdfs.trident.rotation.TimedRotationPolicy
Called after the HdfsBolt rotates a file.
reset() - Method in class org.apache.storm.hdfs.trident.sync.CountSyncPolicy
 
reset() - Method in interface org.apache.storm.hdfs.trident.sync.SyncPolicy
Called after the HdfsBolt performs a sync.
rotateOutputFile() - Method in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
 
rotateOutputFile(boolean) - Method in class org.apache.storm.hdfs.trident.HdfsState.Options
 
rotateOutputFile() - Method in class org.apache.storm.hdfs.trident.HdfsState.Options
 
rotation - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
 
rotation - Variable in class org.apache.storm.hdfs.trident.HdfsState.Options
 
RotationAction - Interface in org.apache.storm.hdfs.common.rotation
 
rotationActions - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
 
rotationActions - Variable in class org.apache.storm.hdfs.trident.HdfsState.Options
 
rotationPolicy - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
 
rotationPolicy - Variable in class org.apache.storm.hdfs.trident.HdfsState.Options
 
rotationTimer - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
 

S

SEQ - Static variable in class org.apache.storm.hdfs.spout.Configs
 
SequenceFileBolt - Class in org.apache.storm.hdfs.bolt
 
SequenceFileBolt() - Constructor for class org.apache.storm.hdfs.bolt.SequenceFileBolt
 
SequenceFileOptions() - Constructor for class org.apache.storm.hdfs.trident.HdfsState.SequenceFileOptions
 
SequenceFileReader<Key extends org.apache.hadoop.io.Writable,Value extends org.apache.hadoop.io.Writable> - Class in org.apache.storm.hdfs.spout
 
SequenceFileReader(FileSystem, Path, Map) - Constructor for class org.apache.storm.hdfs.spout.SequenceFileReader
 
SequenceFileReader(FileSystem, Path, Map, String) - Constructor for class org.apache.storm.hdfs.spout.SequenceFileReader
 
SequenceFileReader.Offset - Class in org.apache.storm.hdfs.spout
 
SequenceFormat - Interface in org.apache.storm.hdfs.bolt.format
Interface for converting Tuple objects to HDFS sequence file key-value pairs.
SequenceFormat - Interface in org.apache.storm.hdfs.trident.format
Interface for converting TridentTuple objects to HDFS sequence file key-value pairs.
setBlobMeta(String, SettableBlobMeta, Subject) - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStore
 
setBlobMetaToExtend(String, SettableBlobMeta) - Method in class org.apache.storm.hdfs.blobstore.HdfsClientBlobStore
 
setClient(Map, NimbusClient) - Method in class org.apache.storm.hdfs.blobstore.HdfsClientBlobStore
 
setMetadata(SettableBlobMeta) - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreFile
 
shutdown() - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStore
 
shutdown() - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreImpl
 
shutdown() - Method in class org.apache.storm.hdfs.blobstore.HdfsClientBlobStore
 
shutdown() - Method in class org.apache.storm.hdfs.common.security.AutoHDFS
 
size() - Method in class org.apache.storm.hdfs.spout.ProgressTracker
 
SOURCE_DIR - Static variable in class org.apache.storm.hdfs.spout.Configs
 
start() - Method in interface org.apache.storm.hdfs.trident.rotation.FileRotationPolicy
Start the policy.
start() - Method in class org.apache.storm.hdfs.trident.rotation.FileSizeRotationPolicy
 
start() - Method in class org.apache.storm.hdfs.trident.rotation.NoRotationPolicy
 
start() - Method in class org.apache.storm.hdfs.trident.rotation.TimedRotationPolicy
Start the timer to run at fixed intervals.
STORM_KEYTAB_FILE_KEY - Static variable in class org.apache.storm.hdfs.common.security.HdfsSecurityUtil
 
STORM_USER_NAME_KEY - Static variable in class org.apache.storm.hdfs.common.security.HdfsSecurityUtil
 
syncPolicy - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
 
SyncPolicy - Interface in org.apache.storm.hdfs.bolt.sync
Interface for controlling when the HdfsBolt syncs and flushes the filesystem.
SyncPolicy - Interface in org.apache.storm.hdfs.trident.sync
Interface for controlling when the HdfsBolt syncs and flushes the filesystem.
syncTuples() - Method in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
Make the best effort to sync written data to the underlying file system.
syncTuples() - Method in class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt
 
syncTuples() - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
 
syncTuples() - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
 

T

takeOwnership(FileSystem, Path, FileLock.LogEntry, String) - Static method in class org.apache.storm.hdfs.spout.FileLock
Takes ownership of the lock file if possible.
takeOwnershipIfStale(FileSystem, Path, int) - Static method in class org.apache.storm.hdfs.spout.DirLock
if the lock on the directory is stale, take ownership
TEXT - Static variable in class org.apache.storm.hdfs.spout.Configs
 
TextFileReader - Class in org.apache.storm.hdfs.spout
 
TextFileReader(FileSystem, Path, Map) - Constructor for class org.apache.storm.hdfs.spout.TextFileReader
 
TextFileReader(FileSystem, Path, Map, String) - Constructor for class org.apache.storm.hdfs.spout.TextFileReader
 
TextFileReader.Offset - Class in org.apache.storm.hdfs.spout
 
tickTupleInterval - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
 
TimedRotationPolicy - Class in org.apache.storm.hdfs.bolt.rotation
 
TimedRotationPolicy(float, TimedRotationPolicy.TimeUnit) - Constructor for class org.apache.storm.hdfs.bolt.rotation.TimedRotationPolicy
 
TimedRotationPolicy - Class in org.apache.storm.hdfs.trident.rotation
 
TimedRotationPolicy(float, TimedRotationPolicy.TimeUnit) - Constructor for class org.apache.storm.hdfs.trident.rotation.TimedRotationPolicy
 
TimedRotationPolicy.TimeUnit - Enum in org.apache.storm.hdfs.bolt.rotation
 
TimedRotationPolicy.TimeUnit - Enum in org.apache.storm.hdfs.trident.rotation
 
toDestination(String) - Method in class org.apache.storm.hdfs.common.rotation.MoveFileAction
 
TOPOLOGY_HDFS_URI - Static variable in class org.apache.storm.hdfs.common.security.AutoHDFS
 
toString() - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreFile
 
toString() - Method in class org.apache.storm.hdfs.spout.FileLock.LogEntry
 
toString() - Method in class org.apache.storm.hdfs.spout.SequenceFileReader.Offset
 
toString() - Method in class org.apache.storm.hdfs.spout.TextFileReader.Offset
 
tryCreateFile(FileSystem, Path) - Static method in class org.apache.storm.hdfs.common.HdfsUtils
Returns null if file already exists.
tryLock(FileSystem, Path) - Static method in class org.apache.storm.hdfs.spout.DirLock
Get a lock on file if not already locked
tryLock(FileSystem, Path, Path, String) - Static method in class org.apache.storm.hdfs.spout.FileLock
returns lock on file or null if file is already locked.

U

updateBlob(String, Subject) - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStore
 
updateBlob(String) - Method in class org.apache.storm.hdfs.blobstore.HdfsClientBlobStore
 
updateBlobReplication(String, int, Subject) - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStore
 
updateBlobReplication(String, int) - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreImpl
 
updateBlobReplication(String, int) - Method in class org.apache.storm.hdfs.blobstore.HdfsClientBlobStore
 
updateState(List<TridentTuple>, TridentCollector) - Method in class org.apache.storm.hdfs.trident.HdfsState
 
updateState(HdfsState, List<TridentTuple>, TridentCollector) - Method in class org.apache.storm.hdfs.trident.HdfsUpdater
 
updateSubject(Subject, Map<String, String>) - Method in class org.apache.storm.hdfs.common.security.AutoHDFS

V

value(Tuple) - Method in class org.apache.storm.hdfs.bolt.format.DefaultSequenceFormat
 
value(Tuple) - Method in interface org.apache.storm.hdfs.bolt.format.SequenceFormat
Given a tuple, return the value that should be written to the sequence file.
value(TridentTuple) - Method in class org.apache.storm.hdfs.trident.format.DefaultSequenceFormat
 
value(TridentTuple) - Method in interface org.apache.storm.hdfs.trident.format.SequenceFormat
Given a tuple, return the value that should be written to the sequence file.
valueClass() - Method in class org.apache.storm.hdfs.bolt.format.DefaultSequenceFormat
 
valueClass() - Method in interface org.apache.storm.hdfs.bolt.format.SequenceFormat
Value class used by implementation (e.g.
valueClass() - Method in class org.apache.storm.hdfs.trident.format.DefaultSequenceFormat
 
valueClass() - Method in interface org.apache.storm.hdfs.trident.format.SequenceFormat
Value class used by implementation (e.g.
valueOf(String) - Static method in enum org.apache.storm.hdfs.bolt.rotation.FileSizeRotationPolicy.Units
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum org.apache.storm.hdfs.bolt.rotation.TimedRotationPolicy.TimeUnit
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum org.apache.storm.hdfs.trident.rotation.FileSizeRotationPolicy.Units
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum org.apache.storm.hdfs.trident.rotation.TimedRotationPolicy.TimeUnit
Returns the enum constant of this type with the specified name.
values() - Static method in enum org.apache.storm.hdfs.bolt.rotation.FileSizeRotationPolicy.Units
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum org.apache.storm.hdfs.bolt.rotation.TimedRotationPolicy.TimeUnit
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum org.apache.storm.hdfs.trident.rotation.FileSizeRotationPolicy.Units
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum org.apache.storm.hdfs.trident.rotation.TimedRotationPolicy.TimeUnit
Returns an array containing the constants of this enum type, in the order they are declared.

W

withBufferSize(int) - Method in class org.apache.storm.hdfs.trident.HdfsState.HdfsFileOptions
Set the size of the buffer used for hdfs file copy in case of recovery.
withCompressionCodec(String) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
 
withCompressionCodec(String) - Method in class org.apache.storm.hdfs.trident.HdfsState.SequenceFileOptions
 
withCompressionType(SequenceFile.CompressionType) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
 
withCompressionType(SequenceFile.CompressionType) - Method in class org.apache.storm.hdfs.trident.HdfsState.SequenceFileOptions
 
withConfigKey(String) - Method in class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt
 
withConfigKey(String) - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
 
withConfigKey(String) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
 
withConfigKey(String) - Method in class org.apache.storm.hdfs.spout.HdfsSpout
set key name under which HDFS options are placed.
withConfigKey(String) - Method in class org.apache.storm.hdfs.trident.HdfsState.HdfsFileOptions
 
withConfigKey(String) - Method in class org.apache.storm.hdfs.trident.HdfsState.SequenceFileOptions
 
withExtension(String) - Method in class org.apache.storm.hdfs.bolt.format.DefaultFileNameFormat
Overrides the default file extension.
withExtension(String) - Method in class org.apache.storm.hdfs.trident.format.DefaultFileNameFormat
Overrides the default file extension.
withFieldDelimiter(String) - Method in class org.apache.storm.hdfs.bolt.format.DelimitedRecordFormat
Overrides the default field delimiter.
withFieldDelimiter(String) - Method in class org.apache.storm.hdfs.trident.format.DelimitedRecordFormat
Overrides the default field delimiter.
withFields(Fields) - Method in class org.apache.storm.hdfs.bolt.format.DelimitedRecordFormat
Only output the specified fields.
withFields(Fields) - Method in class org.apache.storm.hdfs.trident.format.DelimitedRecordFormat
Only output the specified fields.
withFileNameFormat(FileNameFormat) - Method in class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt
 
withFileNameFormat(FileNameFormat) - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
 
withFileNameFormat(FileNameFormat) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
 
withFileNameFormat(FileNameFormat) - Method in class org.apache.storm.hdfs.trident.HdfsState.HdfsFileOptions
 
withFileNameFormat(FileNameFormat) - Method in class org.apache.storm.hdfs.trident.HdfsState.SequenceFileOptions
 
withFsUrl(String) - Method in class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt
 
withFsUrl(String) - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
 
withFsUrl(String) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
 
withFsUrl(String) - Method in class org.apache.storm.hdfs.trident.HdfsState.HdfsFileOptions
 
withFsUrl(String) - Method in class org.apache.storm.hdfs.trident.HdfsState.SequenceFileOptions
 
withOptions(HdfsState.Options) - Method in class org.apache.storm.hdfs.trident.HdfsStateFactory
 
withOutputFields(String...) - Method in class org.apache.storm.hdfs.spout.HdfsSpout
Name of the output field names.
withPath(String) - Method in class org.apache.storm.hdfs.bolt.format.DefaultFileNameFormat
 
withPath(String) - Method in class org.apache.storm.hdfs.trident.format.DefaultFileNameFormat
 
withPrefix(String) - Method in class org.apache.storm.hdfs.bolt.format.DefaultFileNameFormat
Overrides the default prefix.
withPrefix(String) - Method in class org.apache.storm.hdfs.trident.format.DefaultFileNameFormat
Overrides the default prefix.
withRecordDelimiter(String) - Method in class org.apache.storm.hdfs.bolt.format.DelimitedRecordFormat
Overrides the default record delimiter.
withRecordDelimiter(String) - Method in class org.apache.storm.hdfs.trident.format.DelimitedRecordFormat
Overrides the default record delimiter.
withRecordFormat(RecordFormat) - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
 
withRecordFormat(RecordFormat) - Method in class org.apache.storm.hdfs.trident.HdfsState.HdfsFileOptions
 
withRetryCount(int) - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
 
withRetryCount(int) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
 
withRotationPolicy(FileRotationPolicy) - Method in class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt
 
withRotationPolicy(FileRotationPolicy) - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
 
withRotationPolicy(FileRotationPolicy) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
 
withRotationPolicy(FileRotationPolicy) - Method in class org.apache.storm.hdfs.trident.HdfsState.HdfsFileOptions
 
withRotationPolicy(FileRotationPolicy) - Method in class org.apache.storm.hdfs.trident.HdfsState.SequenceFileOptions
 
withSchemaAsString(String) - Method in class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt
 
withSequenceFormat(SequenceFormat) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
 
withSequenceFormat(SequenceFormat) - Method in class org.apache.storm.hdfs.trident.HdfsState.SequenceFileOptions
 
withSyncPolicy(SyncPolicy) - Method in class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt
 
withSyncPolicy(SyncPolicy) - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
 
withSyncPolicy(SyncPolicy) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
 
withTickTupleIntervalSeconds(int) - Method in class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt
 
withTickTupleIntervalSeconds(int) - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
 
withTickTupleIntervalSeconds(int) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
 
write(Kryo, Output, GenericContainer) - Method in class org.apache.storm.hdfs.avro.AbstractAvroSerializer
 
write(String, boolean) - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStoreImpl
Get an object tied to writing the data.
writeLock - Variable in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
 
writeMetadata(String, SettableBlobMeta) - Method in class org.apache.storm.hdfs.blobstore.HdfsBlobStore
 
writeTuple(Tuple) - Method in class org.apache.storm.hdfs.bolt.AbstractHdfsBolt
writes a tuple to the underlying filesystem but makes no guarantees about syncing data.
writeTuple(Tuple) - Method in class org.apache.storm.hdfs.bolt.AvroGenericRecordBolt
 
writeTuple(Tuple) - Method in class org.apache.storm.hdfs.bolt.HdfsBolt
 
writeTuple(Tuple) - Method in class org.apache.storm.hdfs.bolt.SequenceFileBolt
 
A B C D E F G H I K L M N O P R S T U V W 
Skip navigation links

Copyright © 2016 The Apache Software Foundation. All Rights Reserved.