Class DataTableParquetArtifactReader

A Artifact Reader for DataTables that reads a series of partitioned parquet files into a single DataTable.

Namespace: Workspace.XBR.Xperiflow.Routines.Io

Assembly: Xperiflow.dll

Declaration

public class DataTableParquetArtifactReader : IArtifactReader<DataTable>

Remarks

It is expected that the parquet files have the same column schema.

Implements: Workspace.XBR.Xperiflow.Routines.Io.IArtifactReader<System.Data.DataTable> Workspace.XBR.Xperiflow.Routines.Io.IArtifactReader<System.Data.DataTable>

Methods

IsApplicable(List<ArtifactFileAnnotation>)

Determines whether the artifact is applicable for reading as a DataTable from parquet files.

Declaration

public bool IsApplicable(List<ArtifactFileAnnotation> artifactFileAnnotations)

Returns

System.Boolean

Parameters

Type	Name
System.Collections.Generic.List< Workspace.XBR.Xperiflow.Routines.Artifacts.ArtifactFileAnnotation >	artifactFileAnnotations

Read(IMetaFileSystemClient, string, List<ArtifactFileAnnotation>)

Reads a series of partitioned parquet files into a single DataTable based on a directory path that exists in the Workspace.XBR.Xperiflow.MetaFileSystem.IMetaFileSystemClient. Note the parquet files must have the same schema. Additionally, the parquet files must all exist within the dirpath directory.

Declaration

public DataTable Read(IMetaFileSystemClient metaFileSystemClient, string dirpath, List<ArtifactFileAnnotation> artifactFileAnnotations)

Returns

System.Data.DataTable

A DataTable that contains the data from all the parquet files. System.Data.DataTable

A DataTable that contains the data from all the parquet files.

Parameters

Type	Name	Description
Workspace.XBR.Xperiflow.MetaFileSystem.IMetaFileSystemClient	metaFileSystemClient	The MetaFileSystemClient to use to read the parquet files.
System.String	dirpath	The directory path to read the parquet files from. The parquet files to read are expected to all exists within the directory specified for this parameter.
System.Collections.Generic.List< Workspace.XBR.Xperiflow.Routines.Artifacts.ArtifactFileAnnotation >	artifactFileAnnotations	The annotations from the Routine system that describe the artifact files to read. This is used to validate if the artifact is applicable for reading as a DataTable.

Implements

• Workspace.XBR.Xperiflow.Routines.Io.IArtifactReader<System.Data.DataTable>

Inherited Members

• System.Object.Equals(System.Object)
• System.Object.Equals(System.Object,System.Object)
• System.Object.GetHashCode
• System.Object.GetType
• System.Object.MemberwiseClone
• System.Object.ReferenceEquals(System.Object,System.Object)
• System.Object.ToString