Hello All, I just recently received the GEM module and the physical install has been completed. I am currently stuck on the software portion to obtain the data that is being captured by the GEM. I have been able to initiate the IP link to the EtherX tool, along with IA software. The Engine G software has also been installed on the local computer. So far I am lost on the part / steps to record, track, and view all of the captured data from this device. The end goal is to either have the data pushed to one of the many hosting sites, or at least remote in and view the data at my convenience. Any insight and step by step instructions on getting this device up and running would be greatly appreciated. As a FYI: Brultech has stated using all of the above software from the ECM-1240 was possible. Teken . . .

Supposedly discovery might work, but this is what I did:

Step 1) Create a site

Step 2) Create a device (call it GreenEye)

Step 3) Create 32 streams for power (Watts)

name - user friendly name... like Kitchen Lights

type - Power, W

units - none

offset - none

calibration - 1

technical stream name: p_#

(replace # for each stream name,  p_1, p_2, p_3, etc.)

Step 4:

Same as step 3 except for Energy (Whr)

technical stream name: e_#

(replace # with the chanel number for each, e_1, e_2, e_3, etc)

calibration = 0.00027777

(1/3600 because it's in wattseconds rather than watthours and there's 3600 seconds in an hour)

Step 5) Get your site token

click on tools and then my account settings and then on my keys

it's just under the  name of your site

Step 6) configure the greeneye with EtherX to point at your PC to configure with GEM Setup

6.1) run EtherX tool and Search

6.2) click on the MAC address of your GreenEye (should only be one)

6.3) set the server ip address to be your PC's server ip and pick an unused port (say 8080)

Step 7) UseGEM Setup to configure to point at your site

7.1) Click HTTP Packets

7.2) Click Smart Energy Groups

7.3) enter your site key (from step 5)

7.4) enter your device name (from step 2)

7.5) hit save

7.6) you can verify packets are being sent in the right format in the debug tab. they should look something like:

(site 1234567890 (node greeneye ? (e_1 2630)(p_1 526)(e_2 0)(p_2 0)(e_3 0)(p_3 0)(e_4 0)(p_4 0)(e_5 0)(p_5 0)(e_6 0)(p_6 0)(e_7 0)(p_7 0)(e_8 0)(p_8 0)(e_9 0)(p_9 0)(e_10 6650)(p_10 1335)(e_11 0)(p_11 0)(e_12 0)(p_12 0)(e_13 0)(p_13 0)(e_14 0)(p_14 0)(e_15 0)(p_15 0)(e_16 0)(p_16 0)(e_17 0)(p_17 0)(e_18 0)(p_18 0)(e_19 0)(p_19 0)(e_20 0)(p_20 0)(e_21 0)(p_21 0)(e_22 0)(p_22 0)(e_23 0)(p_23 0)(e_24 0)(p_24 0)(e_25 0)(p_25 0)(e_26 0)(p_26 0)(e_27 0)(p_27 0)(e_28 0)(p_28 0)(e_29 0)(p_29 0)(e_30 0)(p_30 0)(e_31 0)(p_31 0)(e_32 0)(p_32 0)(n_1 0)(n_2 0)(n_3 0)(n_4 0)(t_1 0.0)(t_2 0.0)(t_3 0.0)(t_4 0.0)(t_5 0)(t_6 0)(t_7 0)(t_8 0)))

If they don't look like that, you can probably fiddle with System tab-> Packet Format to set it to SmartEnergyGroups packet format.

Step 8) Use EtherX to point the GEM at the smartenergygroups.com IP address

8.1) set the server to 204.62.14.231 port 80

8.2) I haven't yet tried to tell it the server DNS name instead

Step 9) You should be receiving data now in your streams. Go create some dashboards or look at individual streams.

Hey topherhansen,

Nice outline!

I can make this a little easir in SEG buy helping with the discovery magic.

In SEG, Create a site and work out it's site token.  To do this go edit the site or go to:

https://smartenergygroups.com/my_things/show_keys

2. It's not necessary to do anything else in SEG yet.

3. Then go and do all your ECM things that need to be done.  The important one here is to give the ECM the SEG site token!

4. Get the ECM talking to SEG (try and use the DNS, we change servers etc from time to time ;) )

5. Once the ECM is sending data to SEG start a discovery for your site at:

https://smartenergygroups.com/tools -> Discoveries

6.  If SEG is getting data, then it will create your device according to the ECM name that's coming for the node_name - in the above example this is greeeneye, and it will create all your streams!

7.  Then when this is finished, it will bring up the Streams page

https://smartenergygroups.com/streams

Where you can go and label everything in one place!

Note, I don't know what the n_ and t_ data is for...  Note temperature the following stream_name as (temperature_1 22.4) (temperature_2 12.6) etc  This will create celcius unit streams.

Let me know if I can help out!

Thanks,

Sam.

Much thanks to both of you. I shall try to configure my GEM with the steps outlined above. Right now I am having some hardware issues that Brutltech needs to address. topherhansen, Would you be so kind and let me know the following in your GEM. When you select the live monitoring via the GEM software. Do you notice that the stream of data stops at some point? Because right now my streaming data seems to stop anywhere from 30 seconds to 60 seconds later? This seems to be related to when I upgraded the firmware of my GEM to the latest version. Which Ben indicates was to fix some odd issues? It appears to me that this new firmware has created another one. So I am looking for you reference to compare to what I see here. Teken . . .

Hi all. I am new to this forum. I have just set up 2 GEMs in my home along with the GEM server. Currently monitoring about 62 circuits. While it is "working", the Brultech interface is very slow at the moment. Im trying to debug with Ben at Brultech, but in the meantime, I'd like to send the GEM data to the SEG site. The interface looks very good and im interested in getting it working. I've read the posts above, but not sure how to configure the GEM software to send the packets to the SEG group i created. Any further feedback you can provide?

thanks!

You will follow steps 6 and onward per topherhansen instructions to point the GEM to the SEG site.

Sam,

I'm getting reliable p_ (power) values from the GEM.

I have a question about the e_ (energy) streams though; I'm hoping you can help answer it, since it depends in part on how SEG treats them I think.

The GEM reports wattseconds for each report that it sends out. In my case that's set to 5 seconds, so the power value (p_ streams) are computed as difference-in-wattseconds / difference-in-seconds. The e_ stream is simply the wattsecond difference / 3600 to end up with Watt Hours. That could be correct, but only if SEG integrates (sums) the e_ values over the course of an hour.

I had (remporarily stopped last night due to ongoing rewiring in my house) a fairly constant p_ stream (fluctuating between 48 and 51 W). I compute the e_ stream by dividing by 3600, and the SEG website shows a 22 Wh usage.. I would have expected something like 50 Wh.

Could you explain in a little more detail how e_ streams are processed (if at all) and displayed in SEG, or point me to some documentation?

Thanks,
Erik

 

Hey Erik,

He streams are processes according to their engineering units (I was a mechanical engineer once ;) ).  Power is averaged,  Energy is summed.  I won't get into the ddimensional analysis here.

I think you are getting rounding issues at 5 seconds.  I recommend a rate of 45 seconds for a good balance of data, resolution and rounding issues.  You may have seen this:

http://smartenergygroups.com/forums/11-SEGmeter...

Im not sure exactly what's going on, put perhaps try inspecting the API trace in tools and first verify the data being sent is what's being received in SEG.  Let me know of something then seems awry in SEG.

Sam. @samotage

Just to clarify: When you say set it to 45 seconds. Will this include all captured data in the GEM for the 45 second duration? Or will the GEM simply push data every 45 seconds? Teken . . .

Gem to push a single set of data every 45 seconds.

With SEGmeter the Wh energy sent every update is fully integrated over the whole sample time, while the W power value is the snapshot.  Im not sure what the Gem upstream software does, but this is what it 'should' do ;)

Think of your car speedo.

Watts / Power is the speed travelling.  This varies all the time

Watt hours / Energy is how far travelled.  This includes all speed variations over a longer time base.

Sam, @samotage

Sam, I increased the interval from 5 sec (the GEM default) to 30 sec, and the rounding issues appear to be gone. Data looks good!

Awesome!  Great to hear :D

An addendum for calculated streams!

Please make sure that your calibration details are set properly for Calculated Streams, and the Calibration Factor should be 1 unless it needs tweaking.  Check the child streams units and do some maths to work out if it really really needs changing.

If this is set to the 0.0002777778 then the calc reslts will likely be zero or incorrect!

Thansk,

Sam @samotage

Hi folks,

I had a devil of a time getting discovery to work using the btmon.py script from http://lancet.mit.edu/~mwall/projects/power/.  It turns out that btmon.py uses "XXXnnn" as the device name, where "XXX" is a literal "XXX" and "nnn" is the last three digits of the serial number.  Discovery wasn't discovering anything, until on an impulse I changed "XXX" to "xxx".  I think there is some case folding magic that needs to get fixed.

 

eric

Hey Eric,

I think I found a small case sensitivity in SEG today and it should now be fixed.

Sam, @samotage