Does EDI-Net support my data format?

Data formats

The EDI-Net system gets data via data files. It can receive files either by manual or automated upload or by downloading them automatically from an external system.

Data files can come in many shapes and sizes. EDI-Net is designed to work with your data format. We can easily develop customised data adapters for most sensible file formats. We generally prefer human-readable formats such as csv and json. An example csv file format is shown below.

datetime identifier value
01-03-2016 00:00 486020677320 15.3
01-03-2016 00:30 486020677320 12.7
01-03-2016 01:00 486020677320 21.3
01-03-2016 01:30 486020677320 17.7
01-03-2016 02:00 486020677320 17.9
01-03-2016 02:30 486020677320 22.2
01-03-2016 03:00 486020677320 19.4
01-03-2016 03:30 486020677320 15.1

The file contains three key elements which are absolutely essential.

  1. A timestamp (e.g. 01-03-2016 01:00)
  2. A unique identifier (486020677320) indicating to which dataset the data belong
  3. A value, in this case the format always includes kWh values.

There are other things a file may want to include. For example, the units may be specified in some kind of header or as an extra column. The type of commodity being measured e.g. gas, water, electricity etc. may also be included. In the case of the file format above, these aspects are either fixed (i.e. the same for every file) or are missing and need to be applied manually in a post-processing step using the user interface. In either case, an assumption must be made about the units and commodity.

We are very happy to work with your format. Send us an example file and we will do our best to work with it.

1 Like

hi Graeme,

I would like to upload the half-hourly data manually whilst we are waiting for the data suppliers to sort out the API upload…

Would you be able to create a new adapter for a *.csv data file that looks like this:

MPAN/MPRN Date 00:30 01:00 01:30 02:00 02:30 … 20:00 20:30 21:00 21:30 22:00 22:30 23:00 23:30 00:00
9095071806 01/03/2018 0 49.371 26.93 25.807 24.685 … 0 0 0 0 0 0 0 0 0
9095071806 02/03/2018 0 51.354 26.793 27.91 25.677 … 0 0 0 0 0 0 0 0 0
9095071806 03/03/2018 0 0 0 0 0 … 0 0 0 0 0 6.698 0 0 0
9095071806 04/03/2018 0 0 0 0 0 … 0 0 0 0 0 0 0 0 0
9095071806 05/03/2018 0 52.603 29.1 26.861 25.742 … 0 0 0 0 0 0 0 0 0

Also, I’m not sure if you could make some sample files available for the data formats that are already compatible with the Edi-net system?

Many thanks,
Istvan

1 Like

Hi @IstvanSereg,

Thanks for the query. I will start working on an adapter for your format straight away. The format looks fine to me (it includes the unique identifier, timestamp and value). Though it doesn’t include the units or utility. Can I assume this is kWh and electricity for example?

@Graeme

It is kWh indeed but this particular sample is gas data.

Although we store other data as well (CV, corr factor, etc.) I can easily extract kWh figures from our data management system and prepare it in a format as discussed above.

1 Like

It is not essential for us to know that the consumption is gas at import time. This can be set in the user interface. Just be aware that the system won’t know. This doesn’t matter really, as long as you know which MPAN/MPRN relates to what then the configuration can be done once and everything will “just work”.

1 Like

magic… :slight_smile:

1 Like

@IstvanSereg, is the format from a specific system? Will other users potentially have that system?

The reason I ask is because I need to give the format a name and a description. I can either name it the “NottsHealthcare” format or I can name it after the system from which it is extracted.

It is specific to us Graeme…

But if the name or description can describe the data format then perhaps other users will realise that they can produce a data file in that format, and will not come up with a new one for which you have to develop a new adapter…

1 Like