Batch Data Cleansing

Overview

The Jet Data Manager has the ability to split an INSERT statement up in batches during data cleansing (such as when copying data from the transformation view to the valid table).

This saves log space on the SQL Server which gives you better performance on large tables with millions of rows.

Enabling Batch Data Cleansing

To enable batch data cleansing, perform the following:

1. In your Business Unit or Data Warehouse right-click the table for which you want to use batch data cleansing and click Table> Settings.

   

2. Click the Performance tab and select Enable batch data cleansing.

   

3. Optionally, enter the number of records you would like each batch to contain in Batch size. The default is 100,000.
4. Click OK.