org.apache.spark.sql.parquet

Class FileSystemHelper

Object

org.apache.spark.sql.parquet.FileSystemHelper

public class FileSystemHelper
extends Object

Constructor Summary

Constructors

Constructor and Description
FileSystemHelper()

Method Summary

Methods

Modifier and Type	Method and Description
static int	findMaxTaskId(String pathStr, org.apache.hadoop.conf.Configuration conf) Finds the maximum taskid in the output file names at the given path.
static scala.collection.Seq<org.apache.hadoop.fs.Path>	listFiles(String pathStr, org.apache.hadoop.conf.Configuration conf)

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FileSystemHelper

public FileSystemHelper()

Method Detail

listFiles

public static scala.collection.Seq<org.apache.hadoop.fs.Path> listFiles(String pathStr,
                                                        org.apache.hadoop.conf.Configuration conf)

findMaxTaskId

public static int findMaxTaskId(String pathStr,
                org.apache.hadoop.conf.Configuration conf)

Finds the maximum taskid in the output file names at the given path.