Creating Data Preparation Procedures in DIAdem
- Updated2025-10-28
- 2 minute(s) read
Harmonize disparate measurement data from different sources with data preparation procedures. In data preparation procedures, you specify the original property identifiers and values, units, and data file format and their target equivalent.
- Launch DIAdem and open the SCRIPT panel.
- Select .
- Click New Data Preparation Procedure.
- Enter the name of the new data preparation procedure, a description, and the author. Click OK.
-
On the Replace Identifiers tab, specify how the Data
Preprocessor instance replaces property labels. The example in the following
table shows labels from 3 different sources. The data preparation process
replaces the different property identifiers from the 3 data sources with the
newly defined identifier Engine_Fuel_Type in the harmonized
target file.
Source 1 Source 2 Source 3 Harmonized Identifier Property Identifier Engine Engine_Type Fuel Engine_Fuel_Type -
On the Replace Values tab, specify how the Data
Preprocessor instance replaces property values. The example in the following
table shows values from 3 different sources. The data preparation process
replaces the different property values from the 3 data sources with the newly
defined value Diesel in the harmonized target file.
Source 1 Source 2 Source 3 Harmonized Value Property Value Diesel D Fuel_Diesel Diesel The data preparation process creates data with comparable identifiers, values, and units.Harmonized Identifier Harmonized Value Engine_Fuel_Type Diesel - Optional:
Further configure this procedure in any of the following
ways:
Tab Configuration Convert Units Specify the engineering unit to convert data to. For example, if temperatures were measured in °F and °C and you want to evaluate them in the unit K, specify that the process converts and saves all temperatures in the unit K. Statistics Calculate characteristic statistical values, such as mean, quantile, or dispersion. The process saves the statistical results as custom properties in the target files. V&V Check whether the data is plausible and complete. For validation and verification, create a script that checks whether the data adheres to a limit. Refer to the DIAdem help under for more information about which objects to use from the SystemLink API. Convert File Specify the file format to which the process saves the target files. - Click Save Data Preparation Procedure As, enter a name, and click Save.
Related Information
- Updating Data Preparation Procedures
Upload a new data preparation procedure to replace the existing one. Data preparation procedures define how the Data Preprocessor instance harmonizes your raw data from various data formats and sources.