Data Preparation Procedure: General

Data Preparation Procedure: General

Use Data Preparation to harmonize measurement data from different file formats from different sources. Specify harmonization in a procedure you create under Settings»SystemLink TDM»Data Preparation in DIAdem SCRIPT. Configure the settings in a process chain which transforms your data into a unified format, so that this data can be, for example, compared at a glance.

Note  You can load and edit data preparation procedures (*.dpp) from older DIAdem versions in DIAdem 2019. Data preparation procedures created or edited in DIAdem 2019 can be used in SystemLink TDM 2019 or later.

Identifiers

If, for example, the files are from different sources in which the identifiers for the test engine are saved differently, such as source 1: "Engine", source 2: "Engine_Type", source 3: "Fuel", you can specify "Engine_Fuel_Type" as the harmonized identifier. Data Preparation assigns the identifier "Engine_Fuel_Type" to the different sources of the respective property.

Values

If the files from the different sources also contain different values for the name of the engine to be tested, for example, source 1: "Diesel", source 2: "D", source 3: "Fuel_Diesel", you can specify "Diesel" as the default value. Data Preparation now assigns the value "Diesel" to the various properties from the different sources.

Following the replacement, all sources have the property with the identifier "Engine_Fuel_Type" and the value "Diesel":

Harmonizing Units

You can harmonize units in Data Preparation in a similar way. If a file uses, for example, the unit km/h, this unit cannot be compared to the unit mph of another file. In order to harmonize these units, you can specify in Data Preparation that the unit mph is converted to km/h and is displayed as km/h in the processed TDM or TDMS files.

Calculating Statistical Data

With Data Preparation you can also calculate the statistical values, as minimum value, maximum value, or the standard deviation from the data of individual files and display them in the converted TDM or TDMS file as properties.

Verification and Validation

Create a script to check the harmonized data for plausibility and completeness before you finally save the data. This can also include validation and verification of limit values.

Use the created data preparation procedure (*.dpp) to process your data on the Data Preparation web interface. Before loading this procedure onto the web interface of Data Preparation in SystemLink Server and executing it there, you should test the prepared data with the respective functions in the DIAdem dialog box.

Convert File

Saves the data preparation procedure with the TDM, TDMS or another DataPlugin that DIAdem can use to save data. After saving this configuration file, load it into the Data Preparation application in SystemLink Server, which uses the configuration you defined to edit the data and to save it in the raw data area for further analysis. The DataPlugin used in the configuration must also be installed and activated on SystemLink Server.

Identifier

Is used to view and edit the descriptive information in the data preparation procedure.

Related Topics

Buttons

Replace Identifier | Replace Values | Convert Units | Statistics | V&V | Convert File | Identifier

Procedures

Define Data Preparation Procedure for TDMS Files | Define Data Preparation Procedure for XLSX Files | Defining the Configuration of an Analysis Automation Procedure | Definition of a SystemLink TDM Process Chain | Exploring Indexed Data with a Different Hierarchy View