DIALOGSoftware

DIALOG Plus: batch processing, merging and conversion scripts

Updated

Use DIALOG Plus batch processing and file merging to convert many REBEL recordings in one pass. Put channels on a fixed time grid, decode them with a DBC file and merge recordings. You can also export reports, cut out the data around triggers and save the whole job as a script.

Before you start

The videos in this guide show an earlier version of DIALOG (formerly DiaLog), so some menus look slightly different.

The Export data window

Every task in this guide starts in the Export data window. To open it, select Batch Processing in the Analysis window. The tabs down the left take you through a conversion:

  • General
  • Input files
  • File channels
  • DBC signals
  • Trigger data filters (when the recording holds triggers)
  • Converting rules
  • Shell help

Every section below builds on these common steps.

  1. Set the output on the General tab. Tick Convert files and choose the output format, for example Comma delimited (CSV format). Tick Convert each input file to separate output file. Select Browse to choose the output folder, or Make New Folder to create one.
  2. Add the recordings on the Input files tab. Select Add file(s) for conversion, choose the IVD files and select Open.
  3. Set the task options. Each section below describes the options for one task.
  4. Process the files. Select Process and wait for it to finish. Then select Close and OK. The converted files are in the output folder.

The General tab can also merge files as it converts them. Merge all input files into single output file writes one output file. Concatenate all input files (merging IVD files) joins the recordings end to end.

Watch: How to convert IVD files to other formats using Batch Processing (1:26)

Interpolate or resample to a fixed rate

CAN messages arrive at different rates, so a CSV export has gaps. On the Converting rules tab, you can put every channel on one time grid.

  1. Enable the conversion. Tick Change each item sampling rate using and choose a method.
    • interpolation calculates the value at each timestamp from the straight line between the previous and the next sample.
    • resampling uses the last known value. A channel keeps its value until the next sample arrives.
  2. Choose the grid. Select Use fixed rate when processing samples at and enter the interval in milliseconds, or select Combine sampling rates from all items.
  3. Align the ends if needed. Align beginning of file time range adds samples from 0 ms. Align ending of file time range adds samples after the last ones, so every channel covers the same span.
The Converting rules tab with Change each item sampling rate using ticked, the interpolation and resampling choices, the fixed rate option and the two align options ticked
The Converting rules tab sets the method, the grid and the alignment.
Linear interpolation against last-value resampling DATA · RESAMPLING Linear interpolation against last-value resampling 1. Recorded samples at irregular times 2. Linear interpolation onto a fixed 1 s grid 3.75 3.5 4.75 2.07 2.73 Grid value 3. Last-value resampling onto the same grid 2 3 3 2 2 Grid value 0 s 1 s 2 s 3 s 4 s 5 s 6 s Recorded sample Value written on the fixed grid Interpolation draws a straight line between neighbouring samples. Last-value resampling holds the most recent sample until the next one arrives, so it never shows a value the signal did not have.
Interpolation draws between samples, and resampling holds the last value.

Watch: How to interpolate or resample while exporting data (2:08)

Decode many recordings with a DBC file

  1. Load the DBC file. On the DBC signals tab, select the DBC+ button, choose the DBC file and select Open. Its messages and signals appear in the Message/Signal list.
  2. Choose the signals. Select signals one at a time and use the single arrow, or select them all and use the double arrow.
  3. Process the files. Select Process. DIALOG decodes every input file with the same signals.
The DBC signals tab of the Export data window with the Load DBC files dialog open on a folder of DBC files
Load the DBC file once and it applies to every input file.

Watch: How to import DBC signals to multiple log data using Batch Processing (2:09)

Merge recordings

  1. Select the recordings. In the Analysis window, select the IVD files to merge and choose Merge and Import File(s).
  2. Choose how to merge. In the Merge options window, choose one of the three methods below and select OK.
  3. Save the merged file. Enter a name and a location and select Save, then wait for the processing to finish.
  4. Show the merged file. In the Analysis window, select the merged file's tabs to show it on the oscilloscope and select OK.
The three merge methods
Option in Merge options What you get
Merge data into a IVD file with separate charts One IVD file with each recording on its own chart.
Concatenate recording to a single chart with time axis One chart with the recordings one after another on the time axis, with an automatic offset between them.
Merge data to a single chart with fixed offset between the recordings One chart with the recordings separated by the offset you enter in milliseconds, for example 100 ms.

To start a new chart wherever the data has a long gap, tick Create a new chart when no data for periods longer than and enter a time in milliseconds.

The Merge options window with the three merge methods, the fixed offset field in milliseconds and the option to create a new chart after a long gap
The Merge options window.
Three ways to merge two IVD recordings DIALOG · MERGE RECORDINGS Three ways to merge two IVD recordings 1 Merge data into a IVD file with separate charts Chart 1 Recording A time Chart 2 Recording B time 2 Concatenate recording to a single chart with time axis One chart Recording A Recording B time automatic offset 3 Merge data to a single chart with fixed offset between the recordings One chart Recording A Recording B time offset, ms 100 ms in the manual's example Not to scale. Each title is the option's name in the Merge options window. Tick Create a new chart when no data for periods longer than, with a time in milliseconds, to start a new chart wherever the data has a long gap.
Separate charts, automatic offset and fixed offset.

Watch: How to merge multiple log data from existing IVD files (2:45)

Export CAN trace, EOBD data and reports

One pass can write the CAN trace, the EOBD data and two reports for every recording.

  1. Add the recording. In the Analysis window, select the IVD file that holds the data and select Batch Processing. On the Input files tab, add the IVD file.
  2. Choose the outputs. On the General tab, tick Convert files and Convert each input file to separate output file and choose the format. Then tick DTC report, Statistical report, EOBD data and CAN trace data.
  3. Choose the trace format. Under CAN trace data, choose CSV, Binary logging (BLF) or Vector ASCII (ASC).
  4. Process the files. Select Browse to choose the output folder. Select Process, then Close and OK. Each output is saved as its own file.
The General tab of the Export data window with DTC report, Statistical report, EOBD data and CAN trace data ticked and the trace format list showing CSV, BLF and ASC
Reports and the CAN trace on the General tab.

Watch: How to export CAN trace, EOBD, statistical report and DTC data using batch processing (1:58)

Extract the data around triggers

When the configuration defines triggers, you can export only the data around each trigger event instead of the whole recording.

  1. Enable trigger extraction. On the General tab, set the usual output options and tick Extract only data around specific triggers.
  2. Add the recording. Add the IVD file on the Input files tab.
  3. Set the windows. On the Trigger data filters tab, tick the triggers and enter the PreTrigger time (sec) and PostTrigger time (sec) for each.
  4. Process the files. Select Process. Each trigger event is saved as its own output file.
The Trigger data filters tab listing one trigger with a pre-trigger time of 10 seconds and a post-trigger time of 10 seconds
Each trigger has its own pre-trigger and post-trigger time.
One file per trigger event TRIGGERS · EXTRACTION One file per trigger event Pre-trigger Post-trigger Pre-trigger Post-trigger Event 1 Event 2 0 time File 1 pre + post, event 1 File 2 pre + post, event 2 Each trigger event writes its own file holding the pre-trigger and post-trigger windows around it. Data outside the windows is not extracted.
Each event becomes a file holding its pre-trigger and post-trigger windows.

Watch: Extracting data around specific trigger using Batch Processing (1:51)

Create a conversion script

Save a conversion as a Windows batch file to run it again on new recordings without opening DIALOG.

  1. Set up the conversion. Fill in the General and Input files tabs as usual. If you need a fixed grid, choose interpolation and a processing rate on the Converting rules tab.
  2. Create the script. Select Create shell script at the bottom left, choose a location and a name and select Save.
  3. Run it. Double-click the saved .bat file and wait for the processing to finish.
  4. Edit it. Right-click the file and select Edit to change its options, for example the output format.

A script made by an earlier version of DIALOG looks like this (folder paths shortened). The PATH line points at your DIALOG installation folder and -f:csv sets the output format.

@ECHO OFF
REM DiaLOG batch convert script
REM Created by DiaLOG v5.4.4.0
REM Type "dialog batch /help" for more information

REM Configuring DiaLog path
PATH = "C:\Program Files (x86)\Influx Technology\DiaLog5.3.0.0\"

REM Configuring batch options
dialog batch /convert -tp:microsec -f:csv -i:100000 -o:"C:\Data\Output\" -s:"C:\Data\Recordings\" -si:"AAT" -si:"Acceleration X" -si:"Acceleration Y"
dialog batch /showreports

The Shell help tab of the Export data window and the DIALOG Help section list every option. Running dialog batch /help lists them too.

Watch: How to create a shell script for converting files (2:22)

Next: DIALOG Remote: install it, prepare the SD card and maintain a REBEL.

Products in this guide

DIALOG

CAN analysis & diagnostics

View DIALOG Ask an engineer

Still stuck?

Our engineers answer support questions on every Influx Technology product.