Package org.apache.parquet.filter2.statisticslevel

Class StatisticsFilter

  • All Implemented Interfaces:
    org.apache.parquet.filter2.predicate.FilterPredicate.Visitor<Boolean>
    public class StatisticsFilter
extends Object
implements org.apache.parquet.filter2.predicate.FilterPredicate.Visitor<Boolean>
    Applies a FilterPredicate to statistics about a group of records. Note: the supplied predicate must not contain any instances of the not() operator as this is not supported by this filter. the supplied predicate should first be run through LogicalInverseRewriter to rewrite it in a form that doesn't make use of the not() operator. the supplied predicate should also have already been run through SchemaCompatibilityValidator to make sure it is compatible with the schema of this file. Returns true if all the records represented by the statistics in the provided column metadata can be dropped. false otherwise (including when it is not known, which is often the case).

    • Method Detail

      • canDrop

        public static boolean canDrop​(org.apache.parquet.filter2.predicate.FilterPredicate pred,
                              List<ColumnChunkMetaData> columns)

      • visit

        public <T extends Comparable<T>> Boolean visit​(org.apache.parquet.filter2.predicate.Operators.Eq<T> eq)
        Specified by:
        visit in interface org.apache.parquet.filter2.predicate.FilterPredicate.Visitor<Boolean>

      • visit

        public <T extends Comparable<T>> Boolean visit​(org.apache.parquet.filter2.predicate.Operators.In<T> in)
        Specified by:
        visit in interface org.apache.parquet.filter2.predicate.FilterPredicate.Visitor<Boolean>

      • visit

        public <T extends Comparable<T>> Boolean visit​(org.apache.parquet.filter2.predicate.Operators.NotIn<T> notIn)
        Specified by:
        visit in interface org.apache.parquet.filter2.predicate.FilterPredicate.Visitor<Boolean>

      • visit

        public <T extends Comparable<T>> Boolean visit​(org.apache.parquet.filter2.predicate.Operators.NotEq<T> notEq)
        Specified by:
        visit in interface org.apache.parquet.filter2.predicate.FilterPredicate.Visitor<Boolean>

      • visit

        public <T extends Comparable<T>> Boolean visit​(org.apache.parquet.filter2.predicate.Operators.Lt<T> lt)
        Specified by:
        visit in interface org.apache.parquet.filter2.predicate.FilterPredicate.Visitor<Boolean>

      • visit

        public <T extends Comparable<T>> Boolean visit​(org.apache.parquet.filter2.predicate.Operators.LtEq<T> ltEq)
        Specified by:
        visit in interface org.apache.parquet.filter2.predicate.FilterPredicate.Visitor<Boolean>

      • visit

        public <T extends Comparable<T>> Boolean visit​(org.apache.parquet.filter2.predicate.Operators.Gt<T> gt)
        Specified by:
        visit in interface org.apache.parquet.filter2.predicate.FilterPredicate.Visitor<Boolean>

      • visit

        public <T extends Comparable<T>> Boolean visit​(org.apache.parquet.filter2.predicate.Operators.GtEq<T> gtEq)
        Specified by:
        visit in interface org.apache.parquet.filter2.predicate.FilterPredicate.Visitor<Boolean>

      • visit

        public Boolean visit​(org.apache.parquet.filter2.predicate.Operators.And and)
        Specified by:
        visit in interface org.apache.parquet.filter2.predicate.FilterPredicate.Visitor<Boolean>

      • visit

        public Boolean visit​(org.apache.parquet.filter2.predicate.Operators.Or or)
        Specified by:
        visit in interface org.apache.parquet.filter2.predicate.FilterPredicate.Visitor<Boolean>

      • visit

        public Boolean visit​(org.apache.parquet.filter2.predicate.Operators.Not not)
        Specified by:
        visit in interface org.apache.parquet.filter2.predicate.FilterPredicate.Visitor<Boolean>

      • visit

        public <T extends Comparable<T>,​U extends org.apache.parquet.filter2.predicate.UserDefinedPredicate<T>> Boolean visit​(org.apache.parquet.filter2.predicate.Operators.UserDefined<T,​U> ud)
        Specified by:
        visit in interface org.apache.parquet.filter2.predicate.FilterPredicate.Visitor<Boolean>

      • visit

        public <T extends Comparable<T>,​U extends org.apache.parquet.filter2.predicate.UserDefinedPredicate<T>> Boolean visit​(org.apache.parquet.filter2.predicate.Operators.LogicalNotUserDefined<T,​U> lnud)
        Specified by:
        visit in interface org.apache.parquet.filter2.predicate.FilterPredicate.Visitor<Boolean>