Earth Notes: 16WW Energy Series Dataset

Auto-updated 2026-02-10.

Time series of electricity and gas and other energy generation and use. #energy #microgen #dataset

Abstract

Consolidated and normalised/aligned auto-updating view of 16WW energy time series, gas, electricity, off-grid, kWh by year and month and day, including machine readable versions, sonification, and dependencies. Set to music also!

Keywords

UK, London, Kingston-upon-Thames, 16WW, domestic, residential, home, energy, electricity, gas, series, kWh, behind-the-meter, storage, heat, heat battery, solar, PV, diversion, eddi, grid, export, DHW, hot water, space heat, central heating

Available

Machine-readable data summaries.
Electricity import and export from meter reads, Enphase, eddi.
Gas (import) from meter reads and Loop.
PV generation from meter reads, Enphase, SunnyBeam.
Divert/boost for DHW via eddi, separate and combined.
Total heat demand from gas and eddi divert/boost.
Off-grid energy stats.
Automated sonification of the data.

Not in this dataset:

Implied carbon footprint.
Self-consumption / "energy independence" percentage.
Peak generation, demand, import, export (instantaneous, by day, etc).

Notes

Meta-data is optionally included in each CSV file to trace how it was generated and from at least which direct upstream inputs.
Supply meters are calibrated and their readings can be regarded as the 'official' energy consumption/flow view where available.
Supply meter readings are manual and usually taken about 6pm local time on Mondays and the last day of each month, so offset ~6h from (UTC) day/month end.
There were lots of supply meter changes before 2010, but since then there has been unbroken service from the current supply meter set other than the gas meter removal at the end of 2024.

16WW live grid-tie generation — LIVE 16WW grid-tied PV generation.

Monthly Gas Consumption 2007 to 2024 — 16WW daily gas and electricity consumption over the years, by month.

Monthly Electricity Consumption Since 2007 (gross) — 16WW daily gas and electricity consumption over the years, by month.

Yearly Electricity and Gas (ie heat and light) Carbon Footprint — 16WW yearly total utility energy carbon footprint.

Dataset

name: 16WW uniform domestic energy time series
description: 16WW London suburb consolidated and uniform home energy time series, Kingston-upon-Thames, London, UK
version: 1
keywords: domestic, residential, home, London, UK, urban, suburban, energy, electricity, gas, microgeneration, storage, heat, diversion, time series
variable measured: kWh
date created: 2007
date published: 2022-04-30T18:36:43Z
date modified: 2026-02
temporal coverage: 2005/..
spatial coverage: UK centre 51.406696N,-0.288789E elevation 16m
distribution: consolidated energy data directory
canonical URL: this descriptive text with markup
is part of: 16WW Dataset
licence: this dataset is licensed under CC0, ie it is effectively public domain; if you make use of this data, attribution is welcome but not required
is accessible for free: true

CSV Data Format

Body

The body of a single-source CSV data file consists of five columns:

Date/time: ISO-8601, nominally UTC, to appropriate minimum precision.
Data source device name: no spaces, case sensitive.
Coverage: [0.0,1.0], fraction of time period covered by measurement; may be empty "" for unknown or some other irregularity.
kWh: energy for this date/time.
Comment: optional, must be "-quoted and not contain commas nor quotes.

A sample body:

2018,Enphase,0.410714,419.827
2019,Enphase,0.999888,845.953
2020,Enphase,0.999888,960.588
2021,Enphase,0.999888,935.3
2022,Enphase,0.416555,313.576

Where multiple data sources are combined, the first (date/time) column is not repeated, and the device/coverage/kWh columns are repeated for each source.

Comments are discarded at this stage. In future they could be combined into a new super-comment somehow, or marked "comments from source(s): x y z".

Primary Header

Each of the generated CSV files starts with a common header line such as:

#YYYY-MM,device,coverage,geno,comment

where YYYY-MM is for monthly data (it is YYYY for annual, YYYY-MM-DD for daily), and geno is the variable being tracked, with a unit of kWh.

A consolidated view with multiple sources might look like:

#YYYY-MM,device,coverage,gen,device,coverage,gen,device,coverage,gen
2008-02,,,,meter,1,4,SunnyBeam,0.142857,3.54
2008-03,,,,meter,1,70,SunnyBeam,1,68.55
2008-04,,,,meter,1,108,SunnyBeam,1,106.13
2008-05,,,,meter,1,135,SunnyBeam,1,134.03
2008-06,,,,meter,1,160,SunnyBeam,1,158.1
...

The last three columns are repeated for each data source device.

Optional headers and footers

Optional headers (starting with '#') may be inserted under the primary header. Footers (same syntax) may be appended at the foot/end.

These help with traceability of the numbers, one step at a time.

Header: synth

A 'synth' header indicates the formula used to synthesise a data set, eg:

#YYYY-MM,device,coverage,net
#synth,"meter.imp-meter.exp"
...

Header: collapse

A 'collapse' header indicates the collapse/coarsening of data granularity, eg:

#YYYY,device,coverage,net,comment
#collapse,"MtoY"
...

Header: input

An 'input' header indicates the data input to the process.

#YYYY,device,coverage,net,comment
#collapse,"MtoY"
#input,"data/consolidated/energy/std/net/M/synth/net-M-synth.csv"
...

Footer: script

A 'script' footer indicates the script used to generate the CSV, possibly excluding this footer. This is primarily intended for a caller to append to a successful direct-generation script output, to keep those scripts themselves as simple as possible.

This can be used (as a header) to indicate a necessary sub-script also.

This can be used as an explicit file dependency, eg to make.

...
2021,meter,1,1002.6
#script,"script/consolidate/energy/std/imp/Y/meter/imp-Y-meter.sh"

Parameters

Nominally-available data sources:

Eddi: Myenergi Eddi solar PV diverter
Enphase: Enphase AC-coupled battery system
Loop: Loop gas meter system
SSMPPT: Morningstar SunSaver SS-MPPT-15L off-grid solar controller
SunnyBeam: SMA SunnyBeam remote unit for SunnyBoy solar PV inverters
meter: supply meter
synth: synthetic combinations of other inputs

Nominally-available variables:

gas: fossil gas import
eheat: electric heat as heat pump plus DHW immersion by diversion and boost for alternative H4 boundary
iheat: immersion heat as DHW by diversion and boost
imp: grid import
exp: grid export
con: gross in-home electricity consumption
conexDHW: gross in-home electricity consumption excluding resistive DHW
conexeh: gross in-home electricity consumption excluding electrifed heat
net: net grid imports
flow: total grid flow
gen: total grid-tied PV generation
gen1: PV meter 1 generation
gen2: PV meter 2 generation
geno: off-grid primary PV generation
battc: grid-tied battery charge
battd: grid-tied battery discharge
h1: DHW heater 1 all; heat battery until 2024-11 then DHW cylinder
h1d: DHW heater 1 diversion from PV
h1b: DHW heater 1 boost from grid
h2: DHW heater 2 all; heat battery from 2024-11
h2d: DHW heater 2 diversion from PV
h2b: DHW heater 2 boost from grid
divDHW: DHW to immersions from solar diversion
heat: heat pump plus DHW immersion by diversion and boost plus fossil gas
hph4: heat pump H4 boundary consumption including circulation pump but excluding diversion/boost

Nominally-available granularities:

Y: yearly
M: monthly
D: daily

16WW Recent Utility Stats

At 16WW over 7 days from 2026-02-02 to 2026-02-09: electricity import 8.0kWh/d.

At 16WW over 28 days from 2026-01-12 to 2026-02-09: electricity import 7.9kWh/d.

At 16WW over 371 days from 2025-02-03 to 2026-02-09: electricity import 3.4kWh/d (net -1.0kWh/d).

16WW Utility Energy CO2 Year-to-date

Raw and projected net kgCO2 for year so far for utility grid electricity based on computed live grid intensity and 16WW imports and exports.

2026: year to date (1 months) 52kgCO2 net, full-year linearly projected (more-of-the-same) 614kgCO2 net.

16WW Energy System Settings Summary

Expected GB grid intensity/demand by local hour

Low: 01 02 03 04 05 06
High: 16 17 18

GB SSES designated grid peak demand by local hour

High: 08 09 10 16 17 18 19 20 21

Miscellaneous energy system soft parameters

SOFTPMINSTORAGECOPPC = 300: minimum effective CoP % for storage from grid

Energy System Events and Changes

16WW Energy System Events / Changes
#	Date	Description	Related variables
[1]	2004-06-14	Moved in; occupancy 2	con, gas, imp
[2]	2005-12	First child; occupancy 3	con, conexDHW, conexeh, gas, heat, imp
[3]	2007-07	PV off-grid system for lighting load	imp
[4]	2007-07	Old server farm replaced with low-power laptop	con, conexDHW, conexeh, imp
[5]	2007-08-21	Started regular meter readings	conexDHW, conexeh, gas, imp
[6]	2008-02-11	Electricity import meter change but still unratcheted	imp
[7]	2008-02-27	PV grid-tied first (1.29kWp) installation	exp, flow, gen, gen1, imp, net
[8]	2008-11	Second child; occupancy 4	con, conexDHW, conexeh, exp, flow, gas, heat, imp, net
[9]	2009-02-10	PV grid-tied second (2.58kWp) installation	exp, flow, gen, gen1, imp, net
[10]	2009-06-04	Gas cuft meter replaced with m^3	gas
[11]	2009-09-21	Electricity import/export pair installed	exp, flow, imp, net
[12]	2009-10-26	Servers moved off-grid to SheevaPlug	conexDHW, conexeh, imp
[13]	2010-04-26	PV grid-tied third (1.29kWp) installation	exp, flow, gen, gen2, imp, net
[14]	2010-07-14	IWI superinsulation of living room	gas, heat
[15]	2011-01-14	LA off-grid major battery upgrade	imp
[16]	2011-10-04	IWI superinsulation in some bedrooms	gas, heat
[17]	2012-09-11	upgraded windows to 3G	gas, heat
[18]	2013-02-27	soft zoning with smart TRVs throughout	gas, heat
[19]	2013-05	IWI superinsulation in kitchen	gas, heat
[20]	2013-05	Replaced gas stove with induction hob and fan electric oven	conexDHW, conexeh, exp, flow, gas, heat, imp, net
[21]	2015-11	IWI superinsulation of north wall	gas, heat
[22]	2016-08-04	PV off-grid system significantly expanded	con, geno, imp
[23]	2018-08-06	Enphase grid-tied first (1.2kWh) AC Battery installation	battc, battd, exp, flow, imp, net
[24]	2020-03-23	First London coronavirus lockdown	battc, battd, con, conexDHW, conexeh, exp, flow, gas, gen, gen1, gen2, geno, heat, imp, net
[25]	2021-09-03	LA off-grid battery bank replacement	con, geno, imp
[26]	2021-09-15	Enphase grid-tied second (1.2kWh) AC Battery installation	battc, battd, exp, flow, imp, net
[27]	2021-11-01	Enphase grid-tied third/fourth (2.4kWh) AC Battery installation	battc, battd, exp, flow, imp, net
[28]	2021-02	Overshadowing tree to south-east of house trimmed maybe	gen, gen1, gen2
[29]	2022-03-09	Thermino+Eddi heat battery installation live	con, exp, flow, gas, h1, h1b, h1d, heat, imp, net
[30]	2022-09-09	Added 100Wp panel to off-grid system	con, geno, imp
[31]	2023-02-21	Overshadowing tree to south-east of house heavily trimmed	gen, gen1, gen2
[32]	2024-09-21	Daughter off to university; occupancy 3.x	battc, battd, con, conexDHW, conexeh, exp, flow, gas, heat, imp, net
[33]	2024-11-17	Turned off Thermino grid boost h1b preparing for heat-pump installation	con, flow, gas, h1, h1b, heat, imp, net
[34]	2024-11-25	Gas boiler removal and heat-pump installation	battc, battd, con, divDHW, exp, flow, gas, h1, h1b, h1d, h2, h2b, h2d, heat, hph4, immDHW, imp, net
[35]	2024-12-12	Grid-tied solar PV cleaned	gen, gen1, gen2
[36]	2025-01-23	Eddi metering errors and outage	divDHW, exp, gen, h1, h1b, h1d, h2, h2b, h2d, heat, hph4, immDHW, imp
[37]	2025-02-28	Thermino heat battery reconnected	con, divDHW, exp, flow, h2, h2b, h2d, heat, hph4, immDHW, imp, net
[38]	2025-04-17	Enphase grid-tied fifth (1.2kWh) AC Battery installation	battc, battd, exp, flow, imp, net

Variable battc: grid-tied battery charge

Variable: battc; granularity: Y; date range: 2018/2026.

Data as CSV: data/consolidated/energy/std/battc/Y/battc-Y.csv.

Data as a simple MIDI sonification: data/consolidated/energy/std/battc/Y/battc-Y.mid.

Data as a mildly-augmented MIDI sonification: data/consolidated/energy/std/battc/Y/battc-Y.mild.mid.

Data as a house-style MIDI sonification: data/consolidated/energy/std/battc/Y/battc-Y.house.mid.

Earth Notes: 16WW Energy Series Dataset

Abstract

Keywords

Available

Notes

Dataset

CSV Data Format

Body

Primary Header

Optional headers and footers

Header: synth

Header: collapse

Header: input

Footer: script

Parameters

16WW Recent Utility Stats

16WW Utility Energy CO2 Year-to-date

16WW Energy System Settings Summary

Expected GB grid intensity/demand by local hour

GB SSES designated grid peak demand by local hour

Miscellaneous energy system soft parameters

Energy System Events and Changes

Variable battc: grid-tied battery charge

Variable battd: grid-tied battery discharge

Variable con: gross in-home electricity consumption

Variable conexDHW: gross in-home electricity consumption excluding resistive DHW

Variable conexeh: gross in-home electricity consumption excluding electrifed heat

Variable divDHW: DHW to immersions from solar diversion

Variable eheat: electric heat as heat pump plus DHW immersion by diversion and boost for alternative H4 boundary

Variable exp: grid export

Variable flow: total grid flow

Variable gas: fossil gas import

Variable gen: total grid-tied PV generation

Variable gen1: PV meter 1 generation

Variable gen2: PV meter 2 generation

Variable geno: off-grid primary PV generation

Variable h1: DHW heater 1 all; heat battery until 2024-11 then DHW cylinder

Variable h1b: DHW heater 1 boost from grid

Variable h1d: DHW heater 1 diversion from PV

Variable h2: DHW heater 2 all; heat battery from 2024-11

Variable h2b: DHW heater 2 boost from grid

Variable h2d: DHW heater 2 diversion from PV

Variable heat: heat pump plus DHW immersion by diversion and boost plus fossil gas

Variable hph4: heat pump H4 boundary consumption including circulation pump but excluding diversion/boost

Variable iheat: immersion heat as DHW by diversion and boost

Variable imp: grid import

Variable net: net grid imports