Table Of Contents

Creating Data Preparation Procedures in DIAdem

Last Modified: August 28, 2020

Use data preparation procedures to harmonize disparate measurement data from different sources. In data preparation procedures, you specify the original property identifiers and values, units, and data file format and their target equivalent.

  1. Launch DIAdem and open the SCRIPT panel.
  2. Select Settings»SystemLink TDM»Data Preparation Procedure.
  3. Click New Data Preparation Procedure.
  4. Enter the name of the new data preparation procedure, a description, and the author. Click OK.
  5. On the Replace Identifiers tab, specify how the Data Preprocessor instance replaces property labels. The example in the following table shows labels from 3 different sources. The data preparation process replaces the different property identifiers from the 3 data sources with the newly defined identifier Engine_Fuel_Type in the harmonized target file.
    Source 1 Source 2 Source 3 Harmonized Identifier
    Property Identifier Engine Engine_Type Fuel Engine_Fuel_Type
  6. On the Replace Values tab, specify how the Data Preprocessor instance replaces property values. The example in the following table shows values from 3 different sources. The data preparation process replaces the different property values from the 3 data sources with the newly defined value Diesel in the harmonized target file.
    Source 1 Source 2 Source 3 Harmonized Value
    Property Value Diesel D Fuel_Diesel Diesel
    The data preparation process creates data with comparable identifiers, values, and units.
    Harmonized Identifier Harmonized Value
    Engine_Fuel_Type Diesel
  7. Optional: Further configure this procedure in any of the following ways:
    Tab Configuration
    Convert Units Specify the engineering unit to convert data to. For example, if temperatures were measured in °F and °C and you want to evaluate them in the unit K, specify that the process converts and saves all temperatures in the unit K.
    Statistics Calculate characteristic statistical values, such as mean, quantile, or dispersion. The process saves the statistical results as custom properties in the target files.
    V&V Check whether the data is plausible and complete. For validation and verification, create a script that checks whether the data adheres to a limit. Refer to the DIAdem help under Programming Reference»Object-Oriented Script Interface»SystemLink for more information about which objects to use from the SystemLink API.
    Convert File Specify the file format to which the process saves the target files.
  8. Click Save Data Preparation Procedure As, enter a name, and click Save.
After you have created the data preparation procedure, upload the data preparation procedure (*.dpp) to a Data Preprocessor instance in the SystemLink Data Preparation application.

Recently Viewed Topics