Benchmarking in the energy industry is generally capital-H Horrible, with all sorts of unexamined assumptions and presumptions that can readily be shown to lead to incorrect conclusions. I have railed against tools like Energy Star Portfolio Manager, but to no avail. It is a bill of goods that has been sold to upper management and many consultants – who always likes things to be short, sweet and simple. In this case, way too simple.
As a management tool, most benchmarks are awful.
My reasons for benchmarking skepticism are located here:
This is not to say that good benchmarking metrics can’t be created. But we need to take the process away from the well intentioned policy types and have a discussion about what rigorous and accurate metrics should look like.