Skip to main content
insightsoftware Docs insightsoftware Docs
{%article.title%}
Published:
Was this article helpful?
0 out of 0 found this helpful

Batch Data Cleansing

Overview

The Jet Data Manager has the ability to split an INSERT statement up in batches during data cleansing (such as when copying data from the transformation view to the valid table).

This saves log space on the SQL Server which gives you better performance on large tables with millions of rows.

Process

Enabling Batch Data Cleansing

To enable batch data cleansing, follow the steps below.

  1. In your Business Unit or Data Warehouse right-click on the table for which you want to use batch data cleansing and click on TableSettings .

    mceclip1.png

  2. Click on the Performance tab and select Enable batch data cleansing .

    mceclip2.png

  3. (Optional) Enter the number of records you would like each batch to contain in Batch size . The default is 100,000.
  4. Click on OK .

Published:

Batch Data Cleansing

Overview

The Jet Data Manager has the ability to split an INSERT statement up in batches during data cleansing (such as when copying data from the transformation view to the valid table).

This saves log space on the SQL Server which gives you better performance on large tables with millions of rows.

Process

Enabling Batch Data Cleansing

To enable batch data cleansing, follow the steps below.

  1. In your Business Unit or Data Warehouse right-click on the table for which you want to use batch data cleansing and click on TableSettings .

    mceclip1.png

  2. Click on the Performance tab and select Enable batch data cleansing .

    mceclip2.png

  3. (Optional) Enter the number of records you would like each batch to contain in Batch size . The default is 100,000.
  4. Click on OK .

For an optimal Community experience, Please view on Desktop