Package org.apache.hadoop.fs.adl

Class AdlFsInputStream

java.lang.Object

java.io.InputStream

org.apache.hadoop.fs.FSInputStream

org.apache.hadoop.fs.adl.AdlFsInputStream

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable, org.apache.hadoop.fs.PositionedReadable, org.apache.hadoop.fs.Seekable

@Private
@Evolving
public final class AdlFsInputStream
extends org.apache.hadoop.fs.FSInputStream

Wraps ADLFileInputStream implementation.

Constructor Summary

Constructors

Constructor	Description
AdlFsInputStream(com.microsoft.azure.datalake.store.ADLFileInputStream inputStream, org.apache.hadoop.fs.FileSystem.Statistics statistics, org.apache.hadoop.conf.Configuration conf)

Method Summary

Modifier and Type	Method	Description
int	available()	This method returns the remaining bytes in the stream, rather than the expected Java interpretation of InputStream.available(), which expects the number of remaining bytes in the local buffer.
void	close()
long	getPos()	Return the current offset from the start of the file.
int	read()
int	read(byte[] buffer, int offset, int length)
int	read(long position, byte[] buffer, int offset, int length)
void	seek(long pos)
boolean	seekToNewSource(long l)
long	skip(long pos)

Methods inherited from class org.apache.hadoop.fs.FSInputStream

readFully, readFully, toString, validatePositionedReadArgs

Methods inherited from class java.io.InputStream

mark, markSupported, nullInputStream, read, readAllBytes, readNBytes, readNBytes, reset, transferTo

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.hadoop.fs.PositionedReadable

maxReadSizeForVectorReads, minSeekForVectorReads, readVectored

Constructor Detail

AdlFsInputStream

public AdlFsInputStream(com.microsoft.azure.datalake.store.ADLFileInputStream inputStream,
                        org.apache.hadoop.fs.FileSystem.Statistics statistics,
                        org.apache.hadoop.conf.Configuration conf)
                 throws java.io.IOException

Throws:

java.io.IOException

Method Detail

seek

public void seek(long pos)
          throws java.io.IOException

Specified by:

seek in interface org.apache.hadoop.fs.Seekable

Specified by:

seek in class org.apache.hadoop.fs.FSInputStream

Throws:

java.io.IOException

getPos

public long getPos()
            throws java.io.IOException

Return the current offset from the start of the file.

Specified by:

getPos in interface org.apache.hadoop.fs.Seekable

Specified by:

getPos in class org.apache.hadoop.fs.FSInputStream

Throws:

java.io.IOException

seekToNewSource

public boolean seekToNewSource(long l)
                        throws java.io.IOException

Specified by:

seekToNewSource in interface org.apache.hadoop.fs.Seekable

Specified by:

seekToNewSource in class org.apache.hadoop.fs.FSInputStream

Throws:

java.io.IOException

read

public int read()
         throws java.io.IOException

Specified by:

read in class java.io.InputStream

Throws:

java.io.IOException

read

public int read(long position,
                byte[] buffer,
                int offset,
                int length)
         throws java.io.IOException

Specified by:

read in interface org.apache.hadoop.fs.PositionedReadable

Overrides:

read in class org.apache.hadoop.fs.FSInputStream

Throws:

java.io.IOException

read

public int read(byte[] buffer,
                int offset,
                int length)
         throws java.io.IOException

Overrides:

read in class java.io.InputStream

Throws:

java.io.IOException

available

public int available()
              throws java.io.IOException

This method returns the remaining bytes in the stream, rather than the expected Java interpretation of InputStream.available(), which expects the number of remaining bytes in the local buffer. Moreover, it caps the value returned to a maximum of Integer.MAX_VALUE. These changed behaviors are to ensure compatibility with the expectations of HBase WAL reader, which depends on available() returning the number of bytes in stream. Given all other FileSystems in the hadoop ecosystem (especially HDFS) do this, it is possible other apps other than HBase would also pick up expectation of this behavior based on HDFS implementation. Therefore keeping this quirky behavior here, to ensure compatibility.

Overrides:

available in class java.io.InputStream

Returns:

remaining bytes in the stream, with maximum of Integer.MAX_VALUE.

Throws:

java.io.IOException - If fails to get the position or file length from SDK.

close

public void close()
           throws java.io.IOException

Specified by:

close in interface java.lang.AutoCloseable

Specified by:

close in interface java.io.Closeable

Overrides:

close in class java.io.InputStream

Throws:

java.io.IOException

skip

public long skip(long pos)
          throws java.io.IOException

Overrides:

skip in class java.io.InputStream

Throws:

java.io.IOException