| Package | Description |
|---|---|
| org.apache.parquet.hadoop |
Provides classes to store use Parquet files in Hadoop
In a map reduce job:
|
| org.apache.parquet.hadoop.mapred |
| Modifier and Type | Method and Description |
|---|---|
List<Footer> |
ParquetInputFormat.getFooters(org.apache.hadoop.conf.Configuration configuration,
Collection<org.apache.hadoop.fs.FileStatus> statuses)
the footers for the files
|
List<Footer> |
ParquetInputFormat.getFooters(org.apache.hadoop.conf.Configuration configuration,
List<org.apache.hadoop.fs.FileStatus> statuses) |
List<Footer> |
ParquetInputFormat.getFooters(org.apache.hadoop.mapreduce.JobContext jobContext) |
static List<Footer> |
ParquetFileReader.readAllFootersInParallel(org.apache.hadoop.conf.Configuration configuration,
org.apache.hadoop.fs.FileStatus fileStatus)
Deprecated.
will be removed in 2.0.0;
use
ParquetFileReader.open(InputFile, ParquetReadOptions) |
static List<Footer> |
ParquetFileReader.readAllFootersInParallel(org.apache.hadoop.conf.Configuration configuration,
org.apache.hadoop.fs.FileStatus fileStatus,
boolean skipRowGroups)
Deprecated.
will be removed in 2.0.0;
use
ParquetFileReader.open(InputFile, ParquetReadOptions) |
static List<Footer> |
ParquetFileReader.readAllFootersInParallel(org.apache.hadoop.conf.Configuration configuration,
List<org.apache.hadoop.fs.FileStatus> partFiles)
Deprecated.
metadata files are not recommended and will be removed in 2.0.0
|
static List<Footer> |
ParquetFileReader.readAllFootersInParallel(org.apache.hadoop.conf.Configuration configuration,
List<org.apache.hadoop.fs.FileStatus> partFiles,
boolean skipRowGroups)
Deprecated.
will be removed in 2.0.0;
use
ParquetFileReader.open(InputFile, ParquetReadOptions) |
static List<Footer> |
ParquetFileReader.readAllFootersInParallelUsingSummaryFiles(org.apache.hadoop.conf.Configuration configuration,
Collection<org.apache.hadoop.fs.FileStatus> partFiles,
boolean skipRowGroups)
Deprecated.
metadata files are not recommended and will be removed in 2.0.0
|
static List<Footer> |
ParquetFileReader.readAllFootersInParallelUsingSummaryFiles(org.apache.hadoop.conf.Configuration configuration,
List<org.apache.hadoop.fs.FileStatus> partFiles)
Deprecated.
metadata files are not recommended and will be removed in 2.0.0
|
static List<Footer> |
ParquetFileReader.readFooters(org.apache.hadoop.conf.Configuration configuration,
org.apache.hadoop.fs.FileStatus pathStatus)
Deprecated.
will be removed in 2.0.0;
use
ParquetFileReader.open(InputFile, ParquetReadOptions) |
static List<Footer> |
ParquetFileReader.readFooters(org.apache.hadoop.conf.Configuration configuration,
org.apache.hadoop.fs.FileStatus pathStatus,
boolean skipRowGroups)
Deprecated.
will be removed in 2.0.0;
use
ParquetFileReader.open(InputFile, ParquetReadOptions) |
static List<Footer> |
ParquetFileReader.readFooters(org.apache.hadoop.conf.Configuration configuration,
org.apache.hadoop.fs.Path path)
Deprecated.
will be removed in 2.0.0;
use
ParquetFileReader.open(InputFile, ParquetReadOptions) |
static List<Footer> |
ParquetFileReader.readSummaryFile(org.apache.hadoop.conf.Configuration configuration,
org.apache.hadoop.fs.FileStatus summaryStatus)
Deprecated.
metadata files are not recommended and will be removed in 2.0.0
|
| Modifier and Type | Method and Description |
|---|---|
List<ParquetInputSplit> |
ParquetInputFormat.getSplits(org.apache.hadoop.conf.Configuration configuration,
List<Footer> footers)
Deprecated.
split planning using file footers will be removed
|
static void |
ParquetFileWriter.writeMetadataFile(org.apache.hadoop.conf.Configuration configuration,
org.apache.hadoop.fs.Path outputPath,
List<Footer> footers)
Deprecated.
metadata files are not recommended and will be removed in 2.0.0
|
static void |
ParquetFileWriter.writeMetadataFile(org.apache.hadoop.conf.Configuration configuration,
org.apache.hadoop.fs.Path outputPath,
List<Footer> footers,
ParquetOutputFormat.JobSummaryLevel level)
Deprecated.
metadata files are not recommended and will be removed in 2.0.0
|
| Modifier and Type | Method and Description |
|---|---|
List<Footer> |
DeprecatedParquetInputFormat.getFooters(org.apache.hadoop.mapred.JobConf job) |
Copyright © 2019 The Apache Software Foundation. All rights reserved.