Namespace Workspace.XBR.Xperiflow.Etl.Tabular

Classes

AbstractFileSystemTabularExtractor

A concrete implementation of Workspace.XBR.Xperiflow.Etl.Tabular.ITabularExtractor that extracts tabular data from an abstract file system.

CompatibleParquetDataReader

Uses the native Parquet.Net reader first and falls back to DuckDB for parquet writer features Parquet.Net cannot decode.

CompositeDataReader

Chains multiple IDataReader instances into one forward-only reader so bulk loaders and file writers can process many source files without first merging them into a DataTable.

The CsvDataReader class enables forward-only reading of data from a CSV file, implementing the System.Data.IDataReader interface. If you need to interact with a CsvDataReader directly, you can process all the data from a Csv File using a while loop like this:

var reader = new CsvDataReader(stream); while (reader.Read()) { // Process the data }

CsvDataWriter

A concrete implementation of the Workspace.XBR.Xperiflow.Etl.Tabular.IDataWriter interface that writes CSV data to an output stream.

DuckDbParquetDataReader

Reads Parquet files through DuckDB for files that Parquet.Net cannot decode.

FileDataReaderFactory

The FileDataReaderFactory class is used to provide a factory method to instantiate an IDataReader based on the provided Workspace.XBR.Xperiflow.Etl.IDataFormat.

FileDataWriterFactory

The FileDataWriterFactory class is used to provide a factory method to instantiate an IDataWriter based on the provided Workspace.XBR.Xperiflow.Etl.IDataFormat.

MetaFileSystemTabularExtractor

A concrete implementation of Workspace.XBR.Xperiflow.Etl.Tabular.ITabularExtractor that extracts tabular data from a MetaFileSystem.

MetaFileSystemTabularLoader

A concrete implementation of Workspace.XBR.Xperiflow.Etl.Tabular.ITabularLoader that loads tabular data to a MetaFileSystem.

OneStreamFileSystemTabularExtractor

A concrete implementation of Workspace.XBR.Xperiflow.Etl.Tabular.ITabularExtractor that extracts tabular data from a OneStream file system.

OneStreamFileSystemTabularLoader

A concrete implementation of Workspace.XBR.Xperiflow.Etl.Tabular.ITabularLoader that loads tabular data to a OneStream FileSystem.

OneStreamSqlDataWriter

A concrete implementation of the Workspace.XBR.Xperiflow.Etl.Tabular.IDataWriter interface that writes data to a OneStream SQL Database table.

OneStreamSqlTabularExtractor

A concrete implementation of Workspace.XBR.Xperiflow.Etl.Tabular.ITabularExtractor that extracts tabular data from a OneStream SQL database.

OneStreamSqlTabularLoader

A concrete implementation of Workspace.XBR.Xperiflow.Etl.Tabular.ITabularLoader that loads tabular data into a OneStream SQL Database. The OneStreamSqlTabularLoader uses a Workspace.XBR.Xperiflow.Etl.OneStreamSqlConnectionContext and Workspace.XBR.Xperiflow.Etl.TableDataContainerContext to create and load data into a SQL table.

ParquetCompatibilityException

Indicates that a Parquet file could not be read by the available compatibility readers.

ParquetDataReader

The ParquetDataReader class enables forward-only reading of data from a Parquet file, implementing the System.Data.IDataReader interface. If you need to interact with a ParquetDataReader directly, you can process all the data from a Parquet File using a while loop like this:

var reader = new ParquetDataReader(stream); while (reader.Read()) { // Process the data }

ParquetDataWriter

A concrete implementation of the Workspace.XBR.Xperiflow.Etl.Tabular.IDataWriter interface that writes Parquet data to an output stream.

ParquetReaderCompatibility

SqlTableWriter

A concrete implementation of the Workspace.XBR.Xperiflow.Etl.Tabular.IDataWriter interface that writes data to a SQL table.

TabularEtlManager

The TabularEtlManager class is used to manage the extraction and loading of tabular data. Implements the Workspace.XBR.Xperiflow.Etl.Tabular.ITabularEtlManager interface.

Using a Workspace.XBR.Xperiflow.Etl.Tabular.TabularEtlManager, you can extract data from a source and load it into a destination in separate steps, or with a call to ExtractAndLoad(). Use the XBRApi to instantiate an Workspace.XBR.Xperiflow.Etl.Tabular.ITabularEtlManager. For example:

var etlManager = XBRApi.Etl.GetTabularEtlManager(si);
var dataReader = etlManager.ExtractDataReader(sourceData);
etlManager.Load(destinationData, dataReader)

OR more simply-

etlManager.ExtractAndLoad(sourceDataDefinition, destinationDataDefinition);

TabularExtractorFactory

A concrete implementation of Workspace.XBR.Xperiflow.Etl.Tabular.ITabularExtractorFactory that creates instances of Workspace.XBR.Xperiflow.Etl.Tabular.ITabularExtractor to extract tabular data.

TabularLoaderFactory

A concrete implementation of Workspace.XBR.Xperiflow.Etl.Tabular.ITabularLoaderFactory that creates instances of Workspace.XBR.Xperiflow.Etl.Tabular.ITabularLoader to load tabular data.

Structs

SqlTableIdentifier

Represents a SQL Server table identifier with separate schema and table parts.

Interfaces

IDataWriter

Defines a contract for writing data to a destination with a call to Write(IDataReader).

IFileDataReaderFactory

Defines a contract for a factory that creates an System.Data.IDataReader based on the provided Workspace.XBR.Xperiflow.Etl.IDataFormat. The FileDataReaderFactory class is used to provide a factory method to instantiate an IDataReader based on the provided Workspace.XBR.Xperiflow.Etl.IDataFormat.

You can get an IDataReader instance when you have an IFileDataReaderFactory like so:

IDataFormat dataFormat = new CsvDataFormat(); IFileDataReaderFactory factory = new FileDataReaderFactory(); var reader = factory.CreateDataReader(stream, dataFormat);

IFileDataWriterFactory

Defines a contract for a factory that creates an Workspace.XBR.Xperiflow.Etl.Tabular.IDataWriter based on the provided Workspace.XBR.Xperiflow.Etl.IDataFormat.

You can get an IDataWriter instance when you have an IFileDataWriterFactory like so:

IDataFormat dataFormat = new CsvDataFormat(); IFileDataWriterFactory factory = new FileDataWriterFactory(); var writer = factory.CreateDataWriter(stream, dataFormat);

ITabularEtlManager

Defines a contract for managing the extraction and loading of tabular data.

Using an Workspace.XBR.Xperiflow.Etl.Tabular.ITabularEtlManager, you can extract data from a source and load it into a destination in separate steps, or with a call to ExtractAndLoad(). Use the XBRApi to instantiate a Workspace.XBR.Xperiflow.Etl.Tabular.ITabularEtlManager. For example:

var etlManager = XBRApi.Etl.GetTabularEtlManager(si);
var dataReader = etlManager.ExtractDataReader(sourceData);
etlManager.Load(destinationData, dataReader)

OR more simply -

etlManager.ExtractAndLoad(sourceDataDefinition, destinationDataDefinition);

Classes​

Structs​

Interfaces​

Classes

Structs

Interfaces