Creating Data Preparation Procedures in DIAdem

Use data preparation procedures to harmonize disparate measurement data from different sources. In data preparation procedures, you specify the original property identifiers and values, units, and data file format and their target equivalent.

1. Launch DIAdem and open the SCRIPT panel.
2. Select Settings»SystemLink TDM»Data Preparation Procedure.
3. Click New Data Preparation Procedure.
4. Enter the name of the new data preparation procedure, a description, and the author. Click OK.
5. On the Replace Identifiers tab, specify how the Data Preprocessor instance replaces property labels. The example in the following table shows labels from 3 different sources. The data preparation process replaces the different property identifiers from the 3 data sources with the newly defined identifier Engine_Fuel_Type in the harmonized target file.

   	Source 1	Source 2	Source 3	Harmonized Identifier
   Property Identifier	Engine	Engine_Type	Fuel	Engine_Fuel_Type

6. On the Replace Values tab, specify how the Data Preprocessor instance replaces property values. The example in the following table shows values from 3 different sources. The data preparation process replaces the different property values from the 3 data sources with the newly defined value Diesel in the harmonized target file.

   	Source 1	Source 2	Source 3	Harmonized Value
   Property Value	Diesel	D	Fuel_Diesel	Diesel

   The data preparation process creates data with comparable identifiers, values, and units.

   Harmonized Identifier	Harmonized Value
   Engine_Fuel_Type	Diesel

7. Optional: Further configure this procedure in any of the following ways:

   Tab	Configuration
   Convert Units	Specify the engineering unit to convert data to. For example, if temperatures were measured in °F and °C and you want to evaluate them in the unit K, specify that the process converts and saves all temperatures in the unit K.
   Statistics	Calculate characteristic statistical values, such as mean, quantile, or dispersion. The process saves the statistical results as custom properties in the target files.
   V&V	Check whether the data is plausible and complete. For validation and verification, create a script that checks whether the data adheres to a limit. Refer to the DIAdem help under Programming Reference»Object-Oriented Script Interface»SystemLink for more information about which objects to use from the SystemLink API.
   Convert File	Specify the file format to which the process saves the target files.

8. Click Save Data Preparation Procedure As, enter a name, and click Save.

After you have created the data preparation procedure, upload the data preparation procedure (*.dpp) to a Data Preprocessor instance in the SystemLink Data Preparation application.