org.apache.reef.experimental.parquet

Class ParquetReader

java.lang.Object

org.apache.reef.experimental.parquet.ParquetReader

public final class ParquetReader
extends Object

A reader for Parquet files that can serialize data to local disk and return Avro schema and Avro reader. The intent is not to build a general parquet reader, but to consume data with table-like property.

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.avro.Schema	createAvroSchema() Retrieve avro schema from parquet file.
ByteBuffer	serializeToByteBuffer() Serialize Avro data to a in-memory ByteBuffer.
void	serializeToDisk(File file) Serialize Avro data to a local file.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

createAvroSchema

public org.apache.avro.Schema createAvroSchema()
                                        throws IOException

Retrieve avro schema from parquet file.

Returns:

avro schema from parquet file.

Throws:

IOException - if the Avro schema couldn't be parsed from the parquet file.

serializeToDisk

public void serializeToDisk(File file)
                     throws IOException

Serialize Avro data to a local file.

Parameters:

file - Local destination file for serialization.

Throws:

IOException - if the parquet file couldn't be parsed correctly.

serializeToByteBuffer

public ByteBuffer serializeToByteBuffer()
                                 throws IOException

Serialize Avro data to a in-memory ByteBuffer.

Returns:

A ByteBuffer that contains avro data.

Throws:

IOException - if the parquet file couldn't be parsed correctly.