Namespace Workspace.XBR.Xperiflow.Etl.Tabular
Classes
AbstractFileSystemTabularExtractor
A concrete implementation of Workspace.XBR.Xperiflow.Etl.Tabular.ITabularExtractor that extracts tabular data from an abstract file system.
ColumnMetadata
CsvDataReader
The CsvDataReader
class enables forward-only reading of data from a CSV file, implementing the System.Data.IDataReader
interface.
If you need to interact with a CsvDataReader directly, you can process all the data from a Csv File using a while loop like this:
var reader = new CsvDataReader(stream); while (reader.Read()) { // Process the data }
CsvDataWriter
A concrete implementation of the [Workspace.XBR.Xperiflow.Etl.Tabular.IDataWriter](../Xperiflow.Etl.Tabular/IDataWriter.md)
interface that writes CSV data to an output stream.
FileDataReaderFactory
The FileDataReaderFactory
class is used to provide a factory method to instantiate an IDataReader
based on the provided [Workspace.XBR.Xperiflow.Etl.IDataFormat](../Xperiflow.Etl/IDataFormat.md)
.
FileDataWriterFactory
The FileDataWriterFactory
class is used to provide a factory method to instantiate an IDataWriter
based on the provided [Workspace.XBR.Xperiflow.Etl.IDataFormat](../Xperiflow.Etl/IDataFormat.md)
.
MetaFileSystemTabularExtractor
A concrete implementation of Workspace.XBR.Xperiflow.Etl.Tabular.ITabularExtractor that extracts tabular data from a MetaFileSystem.
MetaFileSystemTabularLoader
A concrete implementation of Workspace.XBR.Xperiflow.Etl.Tabular.ITabularLoader that loads tabular data to a MetaFileSystem.
OneStreamFileSystemTabularExtractor
A concrete implementation of Workspace.XBR.Xperiflow.Etl.Tabular.ITabularExtractor that extracts tabular data from a OneStream file system.
OneStreamFileSystemTabularLoader
A concrete implementation of Workspace.XBR.Xperiflow.Etl.Tabular.ITabularLoader that loads tabular data to a OneStream FileSystem.
OneStreamSqlDataWriter
A concrete implementation of the [Workspace.XBR.Xperiflow.Etl.Tabular.IDataWriter](../Xperiflow.Etl.Tabular/IDataWriter.md)
interface that writes data to a OneStream SQL Database table.
OneStreamSqlTabularExtractor
A concrete implementation of Workspace.XBR.Xperiflow.Etl.Tabular.ITabularExtractor that extracts tabular data from a OneStream SQL database.
OneStreamSqlTabularLoader
A concrete implementation of Workspace.XBR.Xperiflow.Etl.Tabular.ITabularLoader that loads tabular data into a OneStream SQL Database.
The OneStreamSqlTabularLoader
uses a [Workspace.XBR.Xperiflow.Etl.OneStreamSqlConnectionContext](../Xperiflow.Etl/OneStreamSqlConnectionContext.md)
and [Workspace.XBR.Xperiflow.Etl.TableDataContainerContext](../Xperiflow.Etl/TableDataContainerContext.md)
to create and load data into a SQL table.
ParquetDataReader
The ParquetDataReader
class enables forward-only reading of data from a Parquet file, implementing the System.Data.IDataReader
interface.
If you need to interact with a ParquetDataReader directly, you can process all the data from a Parquet File using a while loop like this:
var reader = new ParquetDataReader(stream); while (reader.Read()) { // Process the data }
ParquetDataWriter
A concrete implementation of the [Workspace.XBR.Xperiflow.Etl.Tabular.IDataWriter](../Xperiflow.Etl.Tabular/IDataWriter.md)
interface that writes Parquet data to an output stream.
SqlTableWriter
A concrete implementation of the [Workspace.XBR.Xperiflow.Etl.Tabular.IDataWriter](../Xperiflow.Etl.Tabular/IDataWriter.md)
interface that writes data to a SQL table.
TabularEtlManager
The TabularEtlManager
class is used to manage the extraction and loading of tabular data.
Implements the [Workspace.XBR.Xperiflow.Etl.Tabular.ITabularEtlManager](../Xperiflow.Etl.Tabular/ITabularEtlManager.md)
interface.
Using a [Workspace.XBR.Xperiflow.Etl.Tabular.TabularEtlManager](../Xperiflow.Etl.Tabular/TabularEtlManager.md)
, you can extract data from a source
and load it into a destination in separate steps, or with a call to ExtractAndLoad()
.
Use the XBRApi to instantiate an [Workspace.XBR.Xperiflow.Etl.Tabular.ITabularEtlManager](../Xperiflow.Etl.Tabular/ITabularEtlManager.md)
.
For example:
Example:
` var etlManager = XBRApi.Etl.GetTabularEtlManager(si); `
Example:
` var dataReader = etlManager.ExtractDataReader(sourceData); `
Example:
` etlManager.Load(destinationData, dataReader) `
- OR more simply-
Example:
` etlManager.ExtractAndLoad(sourceDataDefinition, destinationDataDefinition); `
TabularExtractorFactory
A concrete implementation of Workspace.XBR.Xperiflow.Etl.Tabular.ITabularExtractorFactory that creates instances of Workspace.XBR.Xperiflow.Etl.Tabular.ITabularExtractor to extract tabular data.
TabularLoaderFactory
A concrete implementation of Workspace.XBR.Xperiflow.Etl.Tabular.ITabularLoaderFactory that creates instances of Workspace.XBR.Xperiflow.Etl.Tabular.ITabularLoader to load tabular data.
Interfaces
IDataWriter
Defines a contract for writing data to a destination with a call to Write(IDataReader)
.
IFileDataReaderFactory
Defines a contract for a factory that creates an System.Data.IDataReader
based on the provided Workspace.XBR.Xperiflow.Etl.IDataFormat.
The FileDataReaderFactory
class is used to provide a factory method to instantiate an IDataReader
based on the provided [Workspace.XBR.Xperiflow.Etl.IDataFormat](../Xperiflow.Etl/IDataFormat.md)
.
You can get an IDataReader instance when you have an IFileDataReaderFactory like so:
IDataFormat dataFormat = new CsvDataFormat(); IFileDataReaderFactory factory = new FileDataReaderFactory(); var reader = factory.CreateDataReader(stream, dataFormat);
IFileDataWriterFactory
Defines a contract for a factory that creates an Workspace.XBR.Xperiflow.Etl.Tabular.IDataWriter based on the provided Workspace.XBR.Xperiflow.Etl.IDataFormat.
You can get an IDataWriter instance when you have an IFileDataWriterFactory like so:
IDataFormat dataFormat = new CsvDataFormat(); IFileDataWriterFactory factory = new FileDataWriterFactory(); var writer = factory.CreateDataWriter(stream, dataFormat);
ITabularEtlManager
Defines a contract for managing the extraction and loading of tabular data.
Using an [Workspace.XBR.Xperiflow.Etl.Tabular.ITabularEtlManager](../Xperiflow.Etl.Tabular/ITabularEtlManager.md)
, you can extract data from a source
and load it into a destination in separate steps, or with a call to ExtractAndLoad()
.
Use the XBRApi to instantiate a [Workspace.XBR.Xperiflow.Etl.Tabular.ITabularEtlManager](../Xperiflow.Etl.Tabular/ITabularEtlManager.md)
.
For example:
Example:
` var etlManager = XBRApi.Etl.GetTabularEtlManager(si); `
Example:
` var dataReader = etlManager.ExtractDataReader(sourceData); `
Example:
` etlManager.Load(destinationData, dataReader) `
- OR more simply -
Example:
` etlManager.ExtractAndLoad(sourceDataDefinition, destinationDataDefinition); `
ITabularExtractor
Defines a contract for extracting tabular data from a source. Implements Workspace.XBR.Xperiflow.Etl.IExtractor%601
.
ITabularExtractorFactory
Defines a contract for a factory that creates an Workspace.XBR.Xperiflow.Etl.Tabular.ITabularExtractor based on the provided [Workspace.XBR.Xperiflow.Etl.DataDefinition](../Xperiflow.Etl/DataDefinition.md)
components.
ITabularLoader
Defines a contract for loading tabular data into a destination. Implements Workspace.XBR.Xperiflow.Etl.ILoader%601
.
ITabularLoaderFactory
Defines a contract for a factory that creates an Workspace.XBR.Xperiflow.Etl.Tabular.ITabularLoader based on the provided Workspace.XBR.Xperiflow.Etl.DataDefinition components.