| Package | Description |
|---|---|
| org.apache.hadoop.conf |
Configuration of system parameters.
|
| org.apache.hadoop.crypto.key.kms | |
| org.apache.hadoop.fs |
An abstract file system API.
|
| org.apache.hadoop.fs.permission |
This package provides support for HDFS permission and ACL.
|
| org.apache.hadoop.fs.store |
This package is for classes to be shared across object stores; for internal
use within the hadoop-* modules only.
|
| org.apache.hadoop.io |
Generic i/o code for use when reading and writing data to the network,
to databases, and to files.
|
| org.apache.hadoop.io.serializer |
This package provides a mechanism for using different serialization frameworks
in Hadoop.
|
| org.apache.hadoop.ipc |
Tools to help define network clients and servers.
|
| org.apache.hadoop.security | |
| org.apache.hadoop.security.authorize |
Support for service-level authorization.
|
| org.apache.hadoop.security.token |
Support for delegation tokens.
|
| org.apache.hadoop.security.token.delegation |
ZooKeeper secret manager for TokenIdentifiers and DelegationKeys.
|
| org.apache.hadoop.security.token.delegation.web | |
| org.apache.hadoop.util |
Common utilities.
|
| org.apache.hadoop.util.bloom |
| Modifier and Type | Class | Description |
|---|---|---|
class |
Configuration |
Provides access to configuration parameters.
|
class |
ConfigurationWithLogging |
Logs access to
Configuration. |
| Modifier and Type | Class | Description |
|---|---|---|
static class |
KMSDelegationToken.KMSDelegationTokenIdentifier |
DelegationTokenIdentifier used for the KMS.
|
| Modifier and Type | Class | Description |
|---|---|---|
class |
CompositeCrcFileChecksum |
Composite CRC.
|
class |
ContentSummary |
Store the summary of a content (a directory or a file).
|
class |
FileChecksum |
An abstract class representing file checksums for files.
|
class |
FileStatus |
Interface that represents the client side information for a file.
|
class |
FsServerDefaults |
Provides server default configuration values to clients.
|
class |
FsStatus |
This class is used to represent the capacity, free and used space on a
FileSystem. |
class |
LocatedFileStatus |
This class defines a FileStatus that includes a file's block locations.
|
class |
MD5MD5CRC32CastagnoliFileChecksum |
For CRC32 with the Castagnoli polynomial
|
class |
MD5MD5CRC32FileChecksum |
MD5 of MD5 of CRC32.
|
class |
MD5MD5CRC32GzipFileChecksum |
For CRC32 with the Gzip polynomial
|
| Modifier and Type | Class | Description |
|---|---|---|
class |
FsCreateModes |
A class that stores both masked and unmasked create modes
and is a drop-in replacement for masked permission.
|
class |
FsPermission |
A class for file/directory permissions.
|
class |
PermissionStatus |
Store permission related information.
|
| Modifier and Type | Class | Description |
|---|---|---|
class |
EtagChecksum |
An etag as a checksum.
|
| Modifier and Type | Interface | Description |
|---|---|---|
interface |
WritableComparable<T> |
A
Writable which is also Comparable. |
| Modifier and Type | Class | Description |
|---|---|---|
class |
AbstractMapWritable |
Abstract base class for MapWritable and SortedMapWritable
Unlike org.apache.nutch.crawl.MapWritable, this class allows creation of
MapWritable<Writable, MapWritable> so the CLASS_TO_ID and ID_TO_CLASS
maps travel with the class instead of being static.
|
class |
ArrayPrimitiveWritable |
This is a wrapper class.
|
class |
ArrayWritable |
A Writable for arrays containing instances of a class.
|
class |
BooleanWritable |
A WritableComparable for booleans.
|
class |
BytesWritable |
A byte sequence that is usable as a key or value.
|
class |
ByteWritable |
A WritableComparable for a single byte.
|
class |
CompressedWritable |
A base-class for Writables which store themselves compressed and lazily
inflate on field access.
|
class |
DoubleWritable |
Writable for Double values.
|
class |
EnumSetWritable<E extends java.lang.Enum<E>> |
A Writable wrapper for EnumSet.
|
class |
FloatWritable |
A WritableComparable for floats.
|
class |
GenericWritable |
A wrapper for Writable instances.
|
class |
IntWritable |
A WritableComparable for ints.
|
class |
LongWritable |
A WritableComparable for longs.
|
class |
MapWritable |
A Writable Map.
|
class |
MD5Hash |
A Writable for MD5 hash values.
|
class |
NullWritable |
Singleton Writable with no data.
|
class |
ObjectWritable |
A polymorphic Writable that writes an instance with it's class name.
|
static class |
SequenceFile.Metadata |
The class encapsulating with the metadata of a file.
|
class |
ShortWritable |
A WritableComparable for shorts.
|
class |
SortedMapWritable<K extends WritableComparable<? super K>> |
A Writable SortedMap.
|
class |
Text |
This class stores text using standard UTF8 encoding.
|
class |
TwoDArrayWritable |
A Writable for 2D arrays containing a matrix of instances of a class.
|
class |
UTF8 |
Deprecated.
replaced by Text
|
class |
VersionedWritable |
A base class for Writables that provides version checking.
|
class |
VIntWritable |
A WritableComparable for integer values stored in variable-length format.
|
class |
VLongWritable |
A WritableComparable for longs in a variable-length format.
|
| Modifier and Type | Method | Description |
|---|---|---|
static <T extends Writable> |
WritableUtils.clone(T orig,
Configuration conf) |
Make a copy of a writable object using serialization to a buffer.
|
| Modifier and Type | Method | Description |
|---|---|---|
Writable |
ArrayFile.Reader.get(long n,
Writable value) |
Return the
nth value in the file. |
Writable[] |
ArrayWritable.get() |
|
Writable |
BloomMapFile.Reader.get(WritableComparable key,
Writable val) |
Fast version of the
MapFile.Reader.get(WritableComparable, Writable) method. |
Writable |
GenericWritable.get() |
Return the wrapped instance.
|
Writable |
MapFile.Reader.get(WritableComparable key,
Writable val) |
Return the value for the named key, or null if none exists.
|
Writable |
MapWritable.get(java.lang.Object key) |
|
Writable |
SortedMapWritable.get(java.lang.Object key) |
|
Writable[][] |
TwoDArrayWritable.get() |
|
static Writable |
WritableFactories.newInstance(java.lang.Class<? extends Writable> c) |
Create a new instance of a class with a defined factory.
|
static Writable |
WritableFactories.newInstance(java.lang.Class<? extends Writable> c,
Configuration conf) |
Create a new instance of a class with a defined factory.
|
Writable |
WritableFactory.newInstance() |
|
Writable |
ArrayFile.Reader.next(Writable value) |
Read and return the next value in the file.
|
Writable |
MapWritable.put(Writable key,
Writable value) |
|
Writable |
SortedMapWritable.put(K key,
Writable value) |
|
Writable |
MapWritable.remove(java.lang.Object key) |
|
Writable |
SortedMapWritable.remove(java.lang.Object key) |
| Modifier and Type | Method | Description |
|---|---|---|
java.util.Set<java.util.Map.Entry<Writable,Writable>> |
MapWritable.entrySet() |
|
java.util.Set<java.util.Map.Entry<Writable,Writable>> |
MapWritable.entrySet() |
|
java.util.Set<java.util.Map.Entry<K,Writable>> |
SortedMapWritable.entrySet() |
|
protected abstract java.lang.Class<? extends Writable>[] |
GenericWritable.getTypes() |
Return all classes that may be wrapped.
|
java.lang.Class<? extends Writable> |
ArrayWritable.getValueClass() |
|
java.util.SortedMap<K,Writable> |
SortedMapWritable.headMap(K toKey) |
|
java.util.Set<Writable> |
MapWritable.keySet() |
|
java.util.SortedMap<K,Writable> |
SortedMapWritable.subMap(K fromKey,
K toKey) |
|
java.util.SortedMap<K,Writable> |
SortedMapWritable.tailMap(K fromKey) |
|
java.util.Collection<Writable> |
MapWritable.values() |
|
java.util.Collection<Writable> |
SortedMapWritable.values() |
| Modifier and Type | Method | Description |
|---|---|---|
void |
ArrayFile.Writer.append(Writable value) |
Append a value to the file.
|
void |
BloomMapFile.Writer.append(WritableComparable key,
Writable val) |
|
void |
MapFile.Writer.append(WritableComparable key,
Writable val) |
Append a key/value pair to the map.
|
void |
SequenceFile.Writer.append(Writable key,
Writable val) |
Append a key/value pair.
|
static void |
WritableUtils.cloneInto(Writable dst,
Writable src) |
Deprecated.
use ReflectionUtils.cloneInto instead.
|
protected void |
AbstractMapWritable.copy(Writable other) |
Used by child copy constructors.
|
Writable |
ArrayFile.Reader.get(long n,
Writable value) |
Return the
nth value in the file. |
Writable |
BloomMapFile.Reader.get(WritableComparable key,
Writable val) |
Fast version of the
MapFile.Reader.get(WritableComparable, Writable) method. |
Writable |
MapFile.Reader.get(WritableComparable key,
Writable val) |
Return the value for the named key, or null if none exists.
|
WritableComparable |
MapFile.Reader.getClosest(WritableComparable key,
Writable val) |
Finds the record that is the closest match to the specified key.
|
WritableComparable |
MapFile.Reader.getClosest(WritableComparable key,
Writable val,
boolean before) |
Finds the record that is the closest match to the specified key.
|
void |
SequenceFile.Reader.getCurrentValue(Writable val) |
Get the 'value' corresponding to the last read 'key'.
|
Writable |
ArrayFile.Reader.next(Writable value) |
Read and return the next value in the file.
|
boolean |
MapFile.Reader.next(WritableComparable key,
Writable val) |
Read the next key/value pair in the map into
key and
val. |
boolean |
SequenceFile.Reader.next(Writable key) |
|
boolean |
SequenceFile.Reader.next(Writable key,
Writable val) |
Read the next key/value pair in the file into
key and
val. |
Writable |
MapWritable.put(Writable key,
Writable value) |
|
Writable |
SortedMapWritable.put(K key,
Writable value) |
|
void |
ArrayWritable.set(Writable[] values) |
|
void |
GenericWritable.set(Writable obj) |
Set the instance that is wrapped.
|
void |
TwoDArrayWritable.set(Writable[][] values) |
|
static byte[] |
WritableUtils.toByteArray(Writable... writables) |
Convert writables to a byte array.
|
| Modifier and Type | Method | Description |
|---|---|---|
static long |
MapFile.fix(FileSystem fs,
Path dir,
java.lang.Class<? extends Writable> keyClass,
java.lang.Class<? extends Writable> valueClass,
boolean dryrun,
Configuration conf) |
This method attempts to fix a corrupt MapFile by re-creating its index.
|
static Writable |
WritableFactories.newInstance(java.lang.Class<? extends Writable> c) |
Create a new instance of a class with a defined factory.
|
static Writable |
WritableFactories.newInstance(java.lang.Class<? extends Writable> c,
Configuration conf) |
Create a new instance of a class with a defined factory.
|
void |
MapWritable.putAll(java.util.Map<? extends Writable,? extends Writable> t) |
|
void |
MapWritable.putAll(java.util.Map<? extends Writable,? extends Writable> t) |
|
void |
SortedMapWritable.putAll(java.util.Map<? extends K,? extends Writable> t) |
| Constructor | Description |
|---|---|
ArrayWritable(java.lang.Class<? extends Writable> valueClass,
Writable[] values) |
|
TwoDArrayWritable(java.lang.Class valueClass,
Writable[][] values) |
| Constructor | Description |
|---|---|
ArrayWritable(java.lang.Class<? extends Writable> valueClass) |
|
ArrayWritable(java.lang.Class<? extends Writable> valueClass,
Writable[] values) |
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String file,
java.lang.Class<? extends Writable> valClass) |
Create the named file for values of the named class.
|
Writer(Configuration conf,
FileSystem fs,
java.lang.String file,
java.lang.Class<? extends Writable> valClass,
SequenceFile.CompressionType compress,
Progressable progress) |
Create the named file for values of the named class.
|
| Modifier and Type | Method | Description |
|---|---|---|
Deserializer<Writable> |
WritableSerialization.getDeserializer(java.lang.Class<Writable> c) |
|
Serializer<Writable> |
WritableSerialization.getSerializer(java.lang.Class<Writable> c) |
| Modifier and Type | Method | Description |
|---|---|---|
Deserializer<Writable> |
WritableSerialization.getDeserializer(java.lang.Class<Writable> c) |
|
Serializer<Writable> |
WritableSerialization.getSerializer(java.lang.Class<Writable> c) |
| Modifier and Type | Class | Description |
|---|---|---|
class |
ProtobufWrapperLegacy |
A RpcWritable wrapper for unshaded protobuf messages.
|
class |
ProtocolSignature |
|
class |
RpcWritable |
|
static class |
RpcWritable.Buffer |
adapter to allow decoding of writables and protobufs from a byte buffer.
|
| Modifier and Type | Method | Description |
|---|---|---|
static <T extends Writable> |
Client.getAsyncRpcResponse() |
| Modifier and Type | Method | Description |
|---|---|---|
Writable |
Client.call(RPC.RpcKind rpcKind,
Writable rpcRequest,
Client.ConnectionId remoteId,
java.util.concurrent.atomic.AtomicBoolean fallbackToSimpleAuth) |
Make a call, passing
rpcRequest, to the IPC server defined by
remoteId, returning the rpc respond. |
Writable |
Client.call(RPC.RpcKind rpcKind,
Writable rpcRequest,
Client.ConnectionId remoteId,
java.util.concurrent.atomic.AtomicBoolean fallbackToSimpleAuth,
AlignmentContext alignmentContext) |
|
Writable |
RPC.Server.call(RPC.RpcKind rpcKind,
java.lang.String protocol,
Writable rpcRequest,
long receiveTime) |
|
Writable |
Server.call(Writable param,
long receiveTime) |
Deprecated.
Use
Server.call(RPC.RpcKind, String,
Writable, long) instead |
abstract Writable |
Server.call(RPC.RpcKind rpcKind,
java.lang.String protocol,
Writable param,
long receiveTime) |
Called for each call.
|
protected Writable |
ProtobufRpcEngine.Invoker.constructRpcRequest(java.lang.reflect.Method method,
com.google.protobuf.Message theRequest) |
|
protected Writable |
ProtobufRpcEngine2.Invoker.constructRpcRequest(java.lang.reflect.Method method,
org.apache.hadoop.thirdparty.protobuf.Message theRequest) |
| Modifier and Type | Method | Description |
|---|---|---|
java.lang.Class<? extends Writable> |
Server.getRpcRequestWrapper(org.apache.hadoop.ipc.protobuf.RpcHeaderProtos.RpcKindProto rpcKind) |
| Modifier and Type | Method | Description |
|---|---|---|
Writable |
Client.call(RPC.RpcKind rpcKind,
Writable rpcRequest,
Client.ConnectionId remoteId,
java.util.concurrent.atomic.AtomicBoolean fallbackToSimpleAuth) |
Make a call, passing
rpcRequest, to the IPC server defined by
remoteId, returning the rpc respond. |
Writable |
Client.call(RPC.RpcKind rpcKind,
Writable rpcRequest,
Client.ConnectionId remoteId,
java.util.concurrent.atomic.AtomicBoolean fallbackToSimpleAuth,
AlignmentContext alignmentContext) |
|
Writable |
RPC.Server.call(RPC.RpcKind rpcKind,
java.lang.String protocol,
Writable rpcRequest,
long receiveTime) |
|
Writable |
Server.call(Writable param,
long receiveTime) |
Deprecated.
Use
Server.call(RPC.RpcKind, String,
Writable, long) instead |
abstract Writable |
Server.call(RPC.RpcKind rpcKind,
java.lang.String protocol,
Writable param,
long receiveTime) |
Called for each call.
|
void |
Server.Call.setDeferredResponse(Writable response) |
| Modifier and Type | Method | Description |
|---|---|---|
Client |
ClientCache.getClient(Configuration conf,
javax.net.SocketFactory factory,
java.lang.Class<? extends Writable> valueClass) |
Construct & cache an IPC client with the user-provided SocketFactory
if no cached client exists.
|
static void |
Server.registerProtocolEngine(RPC.RpcKind rpcKind,
java.lang.Class<? extends Writable> rpcRequestWrapperClass,
org.apache.hadoop.ipc.RPC.RpcInvoker rpcInvoker) |
Register a RPC kind and the class to deserialize the rpc request.
|
| Constructor | Description |
|---|---|
Client(java.lang.Class<? extends Writable> valueClass,
Configuration conf) |
Construct an IPC client with the default SocketFactory.
|
Client(java.lang.Class<? extends Writable> valueClass,
Configuration conf,
javax.net.SocketFactory factory) |
Construct an IPC client whose values are of the given
Writable
class. |
Server(java.lang.String bindAddress,
int port,
java.lang.Class<? extends Writable> paramClass,
int handlerCount,
int numReaders,
int queueSizePerHandler,
Configuration conf,
java.lang.String serverName,
SecretManager<? extends TokenIdentifier> secretManager,
java.lang.String portRangeConfig) |
|
Server(java.lang.String bindAddress,
int port,
java.lang.Class<? extends Writable> rpcRequestClass,
int handlerCount,
int numReaders,
int queueSizePerHandler,
Configuration conf,
java.lang.String serverName,
SecretManager<? extends TokenIdentifier> secretManager) |
|
Server(java.lang.String bindAddress,
int port,
java.lang.Class<? extends Writable> rpcRequestClass,
int handlerCount,
int numReaders,
int queueSizePerHandler,
Configuration conf,
java.lang.String serverName,
SecretManager<? extends TokenIdentifier> secretManager,
java.lang.String portRangeConfig) |
Constructs a server listening on the named port and address.
|
Server(java.lang.String bindAddress,
int port,
java.lang.Class<? extends Writable> paramClass,
int handlerCount,
Configuration conf) |
| Modifier and Type | Class | Description |
|---|---|---|
class |
Credentials |
A class that provides the facilities of reading and writing
secret keys and Tokens.
|
| Modifier and Type | Class | Description |
|---|---|---|
class |
AccessControlList |
Class representing a configured access control list.
|
| Modifier and Type | Class | Description |
|---|---|---|
class |
Token<T extends TokenIdentifier> |
The client-side form of the token.
|
class |
TokenIdentifier |
An identifier that identifies a token, may contain public information
about a token, including its kind (or type).
|
| Modifier and Type | Class | Description |
|---|---|---|
class |
AbstractDelegationTokenIdentifier |
|
static class |
AbstractDelegationTokenSecretManager.DelegationTokenInformation |
Class to encapsulate a token's renew date and password.
|
class |
DelegationKey |
Key used for generating and verifying delegation tokens
|
| Modifier and Type | Class | Description |
|---|---|---|
class |
DelegationTokenIdentifier |
Concrete delegation token identifier used by
DelegationTokenManager,
KerberosDelegationTokenAuthenticationHandler and
DelegationTokenAuthenticationFilter. |
| Modifier and Type | Method | Description |
|---|---|---|
static void |
ReflectionUtils.cloneWritableInto(Writable dst,
Writable src) |
Deprecated.
|
| Modifier and Type | Class | Description |
|---|---|---|
class |
BloomFilter |
Implements a Bloom filter, as defined by Bloom in 1970.
|
class |
CountingBloomFilter |
Implements a counting Bloom filter, as defined by Fan et al.
|
class |
DynamicBloomFilter |
Implements a dynamic Bloom filter, as defined in the INFOCOM 2006 paper.
|
class |
Filter |
Defines the general behavior of a filter.
|
class |
Key |
The general behavior of a key that must be stored in a filter.
|
class |
RetouchedBloomFilter |
Implements a retouched Bloom filter, as defined in the CoNEXT 2006 paper.
|
Copyright © 2008–2025 Apache Software Foundation. All rights reserved.