GEM, btmon, InfluxDB and Grafana - Weird gaps

Ask questions about the GEM here.
Post Reply
G550_Pilot
Posts: 61
Joined: Sun Apr 17, 2016 1:25 am

GEM, btmon, InfluxDB and Grafana - Weird gaps

Post by G550_Pilot » Sun Apr 01, 2018 10:24 pm

I am running the latest version of the Gem firmware, the latest version of btmon the latest version of InfluxDB and Grafana.

I have the influx upload period set to 10 (which I assume means 10 seconds) and yet I am getting a ton empty areas in my graphs. I am hoping someone can point me in the right direction.

Looks great if you zoom all the way out to day view:
Image

Looks horrible when you zoom in to get a closer look....
Image
Top
ben
Site Admin
Posts: 4269
Joined: Fri Jun 04, 2010 9:39 am

Re: GEM, btmon, InfluxDB and Grafana - Weird gaps

Post by ben » Mon Apr 02, 2018 11:02 am

Are those 0W records or are they missing all together?
Ben
Brultech Research Inc.
E: ben(at)brultech.com
Top
G550_Pilot
Posts: 61
Joined: Sun Apr 17, 2016 1:25 am

Re: GEM, btmon, InfluxDB and Grafana - Weird gaps

Post by G550_Pilot » Mon Apr 02, 2018 4:31 pm

ben wrote:Are those 0W records or are they missing all together?
I assume they are missing since we didn't drop utilization to 0 watts in those missing spots.
Top
Teken
Posts: 2700
Joined: Wed Dec 15, 2010 4:09 pm
Location: The Bad Lands

Re: GEM, btmon, InfluxDB and Grafana - Weird gaps

Post by Teken » Mon Apr 02, 2018 4:35 pm

G550_Pilot wrote:
ben wrote:Are those 0W records or are they missing all together?
I assume they are missing since we didn't drop utilization to 0 watts in those missing spots.
Is the GEM data stored anywhere else besides Influx / Grafana? I ask because if there are no other data gaps in the other system(s) you need to focus in this area.

What is the send frequency from GEM to X?
Teken . . .

My ongoing projects thread: http://www.brultech.com/community/viewt ... ?f=2&t=929
Buy me a cup of coffee: https://www.paypal.me/Teken https://gfinotify.com/ Discount Code: PC10
Top
G550_Pilot
Posts: 61
Joined: Sun Apr 17, 2016 1:25 am

Re: GEM, btmon, InfluxDB and Grafana - Weird gaps

Post by G550_Pilot » Mon Apr 02, 2018 4:46 pm

I also have it posting to EmonCMS but there do not appear to be the same gaps. The Emon server is in a datacenter the InfluxDB / Grafana server is local to the Gem.

Image

Image
Top
Teken
Posts: 2700
Joined: Wed Dec 15, 2010 4:09 pm
Location: The Bad Lands

Re: GEM, btmon, InfluxDB and Grafana - Weird gaps

Post by Teken » Mon Apr 02, 2018 5:48 pm

Do these drop outs appear in any other channels besides the solar?
Teken . . .

My ongoing projects thread: http://www.brultech.com/community/viewt ... ?f=2&t=929
Buy me a cup of coffee: https://www.paypal.me/Teken https://gfinotify.com/ Discount Code: PC10
Top
G550_Pilot
Posts: 61
Joined: Sun Apr 17, 2016 1:25 am

Re: GEM, btmon, InfluxDB and Grafana - Weird gaps

Post by G550_Pilot » Mon Apr 02, 2018 6:58 pm

Teken wrote:Do these drop outs appear in any other channels besides the solar?
Hi Teken -

I'm not sure - those are the only channels that I am tracking in Grafana, but let me add a couple of more and let you know tomorrow if it is the same.
Top
ben
Site Admin
Posts: 4269
Joined: Fri Jun 04, 2010 9:39 am

Re: GEM, btmon, InfluxDB and Grafana - Weird gaps

Post by ben » Tue Apr 03, 2018 9:40 am

Looking at the advice here:

https://github.com/grafana/grafana/issues/2125

Try torkelos post:

do you use influxdb? If that is the case you need to add fill(null) to your query, and a group by time lower limit (set by the group by time under your queries), for example set it to >10s if you write data every 10s, that way influxdb will insert nulls for missing intevals
Ben
Brultech Research Inc.
E: ben(at)brultech.com
Top
G550_Pilot
Posts: 61
Joined: Sun Apr 17, 2016 1:25 am

Re: GEM, btmon, InfluxDB and Grafana - Weird gaps

Post by G550_Pilot » Tue Apr 03, 2018 10:43 am

OK, I already had the fill(null) enabled and changing the time interval from 10s to 1m fixed the missing gaps!!

Thanks Everyone!!
Top
Post Reply

Return to “GEM Support”