org.apache.hadoop.streaming
Class UTF8ByteArrayUtils

java.lang.Object
  org.apache.hadoop.streaming.UTF8ByteArrayUtils

public class UTF8ByteArrayUtils
extends Object

General utils for byte array containing UTF-8 encoded strings

Constructor Summary

UTF8ByteArrayUtils()

Method Summary

static int	findByte(byte[] utf, int start, int end, byte b) Find the first occurrence of the given byte b in a UTF-8 encoded string
static int	findNthByte(byte[] utf, byte b, int n) Find the nth occurrence of the given byte b in a UTF-8 encoded string
static int	findNthByte(byte[] utf, int start, int length, byte b, int n) Find the nth occurrence of the given byte b in a UTF-8 encoded string
static int	findTab(byte[] utf) Find the first occured tab in a UTF-8 encoded string
static int	findTab(byte[] utf, int start, int length) Find the first occured tab in a UTF-8 encoded string
static int	readLine(LineRecordReader.LineReader lineReader, Text out) Read a utf8 encoded line from a data input stream.
static void	splitKeyVal(byte[] utf, int start, int length, Text key, Text val, int splitPos) split a UTF-8 byte array into key and value assuming that the delimilator is at splitpos.
static void	splitKeyVal(byte[] utf, Text key, Text val, int splitPos) split a UTF-8 byte array into key and value assuming that the delimilator is at splitpos.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

UTF8ByteArrayUtils

public UTF8ByteArrayUtils()

Method Detail

findTab

public static int findTab(byte[] utf,
                          int start,
                          int length)

Find the first occured tab in a UTF-8 encoded string

Parameters:

utf - a byte array containing a UTF-8 encoded string

start - starting offset

length - no. of bytes

Returns:

position that first tab occures otherwise -1

findByte

public static int findByte(byte[] utf,
                           int start,
                           int end,
                           byte b)

Find the first occurrence of the given byte b in a UTF-8 encoded string

Parameters:

utf - a byte array containing a UTF-8 encoded string

start - starting offset

end - ending position

b - the byte to find

Returns:

position that first byte occures otherwise -1

findNthByte

public static int findNthByte(byte[] utf,
                              int start,
                              int length,
                              byte b,
                              int n)

Find the nth occurrence of the given byte b in a UTF-8 encoded string

Parameters:

utf - a byte array containing a UTF-8 encoded string

start - starting offset

length - the length of byte array

b - the byte to find

n - the desired occurrence of the given byte

Returns:

position that nth occurrence of the given byte if exists; otherwise -1

findNthByte

public static int findNthByte(byte[] utf,
                              byte b,
                              int n)

Find the nth occurrence of the given byte b in a UTF-8 encoded string

Parameters:

utf - a byte array containing a UTF-8 encoded string

b - the byte to find

n - the desired occurrence of the given byte

Returns:

position that nth occurrence of the given byte if exists; otherwise -1

findTab

public static int findTab(byte[] utf)

Find the first occured tab in a UTF-8 encoded string

Parameters:

utf - a byte array containing a UTF-8 encoded string

Returns:

position that first tab occures otherwise -1

splitKeyVal

public static void splitKeyVal(byte[] utf,
                               int start,
                               int length,
                               Text key,
                               Text val,
                               int splitPos)
                        throws IOException

split a UTF-8 byte array into key and value assuming that the delimilator is at splitpos.

Parameters:

utf - utf-8 encoded string

start - starting offset

length - no. of bytes

key - contains key upon the method is returned

val - contains value upon the method is returned

splitPos - the split pos

Throws:

IOException

splitKeyVal

public static void splitKeyVal(byte[] utf,
                               Text key,
                               Text val,
                               int splitPos)
                        throws IOException

split a UTF-8 byte array into key and value assuming that the delimilator is at splitpos.

Parameters:

utf - utf-8 encoded string

key - contains key upon the method is returned

val - contains value upon the method is returned

splitPos - the split pos

Throws:

IOException

readLine

public static int readLine(LineRecordReader.LineReader lineReader,
                           Text out)
                    throws IOException

Read a utf8 encoded line from a data input stream.

Parameters:

lineReader - LineReader to read the line from.

out - Text to read into

Returns:

number of bytes read

Throws:

IOException