Join this online group to communicate across IBM product users and experts by sharing advice and best practices with peers and staying up to date regarding product enhancements.
This Library Entry is a new version (v2) from my previous one: Collect real Internet Metrics (Speedtest) into SevOne
Now ingesting data faster and without the need of files.
Highlights:
I have removed the need to handle any kind of file (.csv or .xlsx on my entry) to ingest the data from Speedtest to SevOne.
Time efficiency: Removing the need of files, allows to have metrics on SevOne within seconds of delay VS hours, because I was scheduling the execution and data append (more rows to import on every job).
Removing Single Point of Failure: Another benefit with this approach, is to remove a point of failure on a file writing/reading process, because if for some reason the file gets corrupted/lost, this can be translated to data loss.
The test result comes to SANO in a JSON format with the ability to manipulate data (add/remove/change).
Original workflow:
The host using Speedtest CLI runs the tests and saves the multiple results into a CSV or XLSX file.
This process is repeated multiple times, to collect multiple data points in rows.
The metric manipulating happens here, where you select what data to keep from each test result then copy that to the file.
If for some reason, the result file gets corrupted, data will be lost.
At the IBM side, I have generated a workflow with SANO (part 1) to go and read that file from the host every few hours (6).
You can use the frequency you want.
SANO respects the file structure, with the data already there, and doesn't have any way to collect extra metrics.
Continuing in the same workflow, part 2. SANO inserts all these metrics previously collected into SevOne.
If for some reason, there is missing data or this doesn't work. We don't have visibility into what happened, you need to go to the origin of the file and see if the host hast any logs.
New workflow (V2):
IBM SANO has full control of the workflow, triggering whenever you decide in your schedule to be executed and collect/insert data into SevOne. 3 simple steps are detailed below, no files required.
The SANO workflow connects to the Host (SSH) with Speedtest CLI installed and executes the application.
The results come back to SANO in a JSON format, with the ability to select the internet metrics needed for your purpose.
In the second part of the same flow, these metrics are inserted into SevOne.
List of requirements:
SETUP:
Expected results: