Interface IUnstructuredEtlManager

The Unstructured ETL Manager. This is used to extract and load data from unstructured sources and data formats (.json, .xml, .png, .docx, .pdf, etc. ). This interface leverages the Stream objects as its primary data transfer mechanism.

Note that this does not support SQL based connection contexts, containers, and data formats.

Use the XBRApi to instantiate an [Workspace.XBR.Xperiflow.Etl.Unstructured.IUnstructuredEtlManager](../Xperiflow.Etl.Unstructured/IUnstructuredEtlManager.md). For example:

Example:

` var etlManager = XBRApi.Etl.GetUnstructuredEtlManager(si); `

Example:

` var stream = etlManager.Extract(sourceData); `

Example:

` etlManager.Load(destinationData, stream) `

• OR more simply-

Example:

` etlManager.ExtractAndLoad(sourceDataDefinition, destinationDataDefinition); `

Namespace: Workspace.XBR.Xperiflow.Etl.Unstructured

Assembly: Xperiflow.dll

Declaration

public interface IUnstructuredEtlManager

Methods

Extract(DataDefinition)

Extracts the data from the source data definition and returns the data as a Stream object.

Declaration

Stream Extract(DataDefinition sourceDataDefinition)

Returns

System.IO.Stream

Parameters

Type	Name	Description
Workspace.XBR.Xperiflow.Etl.DataDefinition	sourceDataDefinition	The source data definition that is used to extract the data.

Extract(string)

Extracts the data from the source data definition and returns the data as a Stream object.

Declaration

Stream Extract(string sourceDataDefinition)

Returns

System.IO.Stream

Parameters

Type	Name	Description
System.String	sourceDataDefinition	The source data definition represented as a json string that is used to extract the data.

Load(DataDefinition, Stream)

Loads the data from the stream into the destination data definition.

Declaration

void Load(DataDefinition destinationDataDefinition, Stream stream)

Remarks

Note that you can only load data into a destination that does not already have data.

Parameters

Type	Name	Description
Workspace.XBR.Xperiflow.Etl.DataDefinition	destinationDataDefinition	The destination data definition that is used to load the data.
System.IO.Stream	stream	The stream that contains the data to be loaded.

Load(string, Stream)

Loads the data from the stream into the destination data definition.

Declaration

void Load(string destinationDataDefinition, Stream stream)

Remarks

Note that you can only load data into a destination that does not already have data.

Parameters

Type	Name	Description
System.String	destinationDataDefinition	The destination data definition represented as a json string that is used to load the data.
System.IO.Stream	stream	The stream that contains the data to be loaded.

ExtractAndLoad(DataDefinition, DataDefinition)

Extracts the data from the source data definition and immediatly loads the data into the destination data definition.

Declaration

void ExtractAndLoad(DataDefinition sourceDataDefinition, DataDefinition destinationDataDefinition)

Remarks

Note that you can only load data into a destination that does not already have data.

Parameters

Type	Name	Description
Workspace.XBR.Xperiflow.Etl.DataDefinition	sourceDataDefinition	The source data definition that is used to extract the data.
Workspace.XBR.Xperiflow.Etl.DataDefinition	destinationDataDefinition	The destination data definition that is used to load the data.