Class DataTableParquetArtifactWriter

The Artifact Writer for DataTables that writes a DataTable to a series of partitioned parquet files.

Namespace: Workspace.XBR.Xperiflow.Routines.Io

Assembly: Xperiflow.dll

Declaration

public class DataTableParquetArtifactWriter : IArtifactWriter<DataTable>

Implements: Workspace.XBR.Xperiflow.Routines.Io.IArtifactWriter<System.Data.DataTable> Workspace.XBR.Xperiflow.Routines.Io.IArtifactWriter<System.Data.DataTable>

Properties

ArtifactFileAnnotations

The artifact file annotations to be written to storage. This provides runtime information on how to read back the data from the corresponding artifact reader. Please ensure that your File Annotations leverage the proper syntax for the artifact reader to work with.

Declaration

public List<ArtifactFileAnnotation> ArtifactFileAnnotations { get; }

Methods

Write(IMetaFileSystemClient, string, DataTable)

Writes a DataTable to a series of partitioned parquet files based on a directory path that exists in the Workspace.XBR.Xperiflow.MetaFileSystem.IMetaFileSystemClient. The DataTable is broken up into partitions of size Workspace.XBR.Xperiflow.Routines.Io.DataTableParquetArtifactWriter._partitionSize before being written to a parquet file. Additionally, the parquet files will be named data_0.parquet, data_1.parquet, etc.

Declaration

public void Write(IMetaFileSystemClient metaFileSystemClient, string dirpath, DataTable data)

Parameters

Type	Name	Description
Workspace.XBR.Xperiflow.MetaFileSystem.IMetaFileSystemClient	metaFileSystemClient	The MetaFileSystemClient to use to write the parquet files.
System.String	dirpath	The directory path to write the parquet files to.
System.Data.DataTable	data	The DataTable to write to the parquet files.

Implements

• Workspace.XBR.Xperiflow.Routines.Io.IArtifactWriter<System.Data.DataTable>

Inherited Members

• System.Object.Equals(System.Object)
• System.Object.Equals(System.Object,System.Object)
• System.Object.GetHashCode
• System.Object.GetType
• System.Object.MemberwiseClone
• System.Object.ReferenceEquals(System.Object,System.Object)
• System.Object.ToString