Octopus Energy - My energy insights missing zeros on CSV files

UncleK

I am a bit of a nerd and carry an Excel spreadsheet where I take the date from Octopus's "My energy insights" for both energy consumption and export back to them and put it on my spreadsheet to see how we're doing. For a while, there seemed to be no communication and the geezer came out and moved the antenna up a bit and now it works fine. Even now, occasionally Octopus don't provide any data for the odd day. Ho hum.
However, as I get to the point of my post, for the last two days, the export csv file has been fine as before, giving half-hourly readings, even when the export is zero. But the consumption csv file appears to have changed its format, so the csv file only has entries when there is consumption, whereas there used to be zeros at times when there there was no consumption that half hour.
So the csv file is 51 lines long for export (heading plus 50 half hours - if likes to provide the first hour of the next day).
Whereas today the csv file for consumption yesterday is 33 lines long.
Anyone else getting this? (I appreciate many people won't care or know!)

MattMattMattUK

Not an issue I can simulate, Octopus data goes down to .001 of a kWh and I have no period where it is below that (effectively zero) as there is always at least something on in the background, with my lowest half an hour period being 0.019kWh.

UncleK

Yes, I guess that will apply to most people with fridges, etc. I have batteries as part of my solar panel system, so they provide power and drive import to zero. Thanks for comment. 

prowla

You could knock up a relatively simple script to insert the extra lines into the csv file before importing it.

Ildhund

... or do a simple lookup to match consumption to timings after import.

Qyburn

I'm not sure I see any actual zeros either in import or export. But quite a lot of times the figure is given as "0E-20" what ever that means ..

UncleK

I'm pretty sure 0E-20 does in fact mean zero, - is that in export or consumption?

pete-20-11

That is an exponential number format. I'd say treat that as a zero, don't need that many decimal places to be reasonably accurate! 

Qyburn

UncleK said:

I'm pretty sure 0E-20 does in fact mean zero, - is that in export or consumption?

It appears in both. By the way that's the actual text "CSV" file, exactly what Octopus provides.

Qyburn

UncleK said:

However, as I get to the point of my post, for the last two days, the export csv file has been fine as before, giving half-hourly readings, even when the export is zero. But the consumption csv file appears to have changed its format, so the csv file only has entries when there is consumption, whereas there used to be zeros at times when there there was no consumption that half hour.

Actually checking literally the last two days as the OP said, starting on the 20th there are no zeros or "0E-20"s in the import data, but a scattering of gaps. For example..

MeteredOut

I've seen this "missing entries when 0" reported on Facebook too - i think it was on the Octo-Aid FB group.