<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Aptos;}
@font-face
{font-family:"Segoe UI Emoji";
panose-1:2 11 5 2 4 2 4 2 2 3;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
font-size:12.0pt;
font-family:"Aptos",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
p.xmsonormal, li.xmsonormal, div.xmsonormal
{mso-style-name:x_msonormal;
margin:0cm;
font-size:12.0pt;
font-family:"Aptos",sans-serif;}
span.EmailStyle24
{mso-style-type:personal-reply;
font-family:"Aptos",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;
mso-ligatures:none;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:600142642;
mso-list-template-ids:712939816;}
@list l0:level1
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:36.0pt;
mso-level-number-position:left;
text-indent:-18.0pt;
mso-ansi-font-size:10.0pt;
font-family:Symbol;}
@list l0:level2
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:72.0pt;
mso-level-number-position:left;
text-indent:-18.0pt;
mso-ansi-font-size:10.0pt;
font-family:Symbol;}
@list l0:level3
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:108.0pt;
mso-level-number-position:left;
text-indent:-18.0pt;
mso-ansi-font-size:10.0pt;
font-family:Symbol;}
@list l0:level4
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:144.0pt;
mso-level-number-position:left;
text-indent:-18.0pt;
mso-ansi-font-size:10.0pt;
font-family:Symbol;}
@list l0:level5
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:180.0pt;
mso-level-number-position:left;
text-indent:-18.0pt;
mso-ansi-font-size:10.0pt;
font-family:Symbol;}
@list l0:level6
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:216.0pt;
mso-level-number-position:left;
text-indent:-18.0pt;
mso-ansi-font-size:10.0pt;
font-family:Symbol;}
@list l0:level7
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:252.0pt;
mso-level-number-position:left;
text-indent:-18.0pt;
mso-ansi-font-size:10.0pt;
font-family:Symbol;}
@list l0:level8
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:288.0pt;
mso-level-number-position:left;
text-indent:-18.0pt;
mso-ansi-font-size:10.0pt;
font-family:Symbol;}
@list l0:level9
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:324.0pt;
mso-level-number-position:left;
text-indent:-18.0pt;
mso-ansi-font-size:10.0pt;
font-family:Symbol;}
ol
{margin-bottom:0cm;}
ul
{margin-bottom:0cm;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-GB link=blue vlink=purple style='word-wrap:break-word'><div class=WordSection1><p class=MsoNormal><span style='font-size:11.0pt;mso-fareast-language:EN-US'>Thanks, Jeff.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;mso-fareast-language:EN-US'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;mso-fareast-language:EN-US'>I’ve kept your references from various emails to this group on file. I mean to get around to searching for them at some point. Unfortunately M&V is only one small part of my job (I’d like it to be more).<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;mso-fareast-language:EN-US'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;mso-fareast-language:EN-US'>On a separate note I’ve been thinking of ways to get the IMT into Excel. This could probably be done natively using VBA, or by writing some kind of wrapper for the executable.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;mso-fareast-language:EN-US'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;mso-fareast-language:EN-US'>I foresee challenges ahead for M&V as buildings increasingly depend on heat pumps and we often only get data for the main meters. In years past, we could attribute heat to gas and electric to hvac, lighting, and plug loads. <o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;mso-fareast-language:EN-US'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;mso-fareast-language:EN-US'>Thanks again<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;mso-fareast-language:EN-US'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;mso-fareast-language:EN-US'>Chris<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;mso-fareast-language:EN-US'><o:p> </o:p></span></p><div><div style='border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm'><p class=MsoNormal><b><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif'>From:</span></b><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif'> Haberl, Jeff <jhaberl@tamu.edu> <br><b>Sent:</b> Tuesday, July 23, 2024 3:53 PM<br><b>To:</b> 'Karen Walkerman' <kwalkerman@gmail.com>; 'Julien Marrec' <julien.marrec@gmail.com>; chris.malcolm.yates@gmail.com<br><b>Cc:</b> bldg-sim@onebuilding.org<br><b>Subject:</b> Re: [Bldg-sim] "Maslow's" hierarchy of calibration<o:p></o:p></span></p></div></div><p class=MsoNormal><o:p> </o:p></p><div><p class=MsoNormal><span style='color:black'>Hello BLDG-SIM:<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span style='color:black'>Here are some of my favorite references:<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span style='color:black'>+Clarke, et al. 1993. "An approach to the calibration of Building Energy Simulation Models", ASHRAE Transactions.<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span style='color:black'>+Norford et al. 1994. "Two-to-one-discrepancy between measured and predicted performance of a low-energy office building: insights from a reconciliation based on DOE-2 model, Energy and Buildings.<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span style='color:black'>+Haberl et al. 1995. "Impact of Using Measured weather data vs TMY weather data in a DOE-2 simulation", ASHRAE Transactions.<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span style='color:black'>+Manke et al. 1996. "Calibrating Building Energy Analysis Models using short term data", Solar Engineering 1996, ASME.<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span style='color:black'>+Haberl and Bou-Saada, 1998. "Procedures for Calibrating Hourly Simulation models to measured building energy and environmental data", JSEE.<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span style='color:black'>+Reddy 2006. Literature review on calibration of building energy simulation programs: uses, problems, procedures, uncertainty, tools, ASHRAE Transactions.<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span style='color:black'>+Coakley et al. 2014. "A review of methods to match building energy simulation models to measured data", Renewable and Sustainable Energy Reviews.<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span style='color:black'>... There are lots more ... If you have trouble accessing these papers drop me a note.<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='color:black'><o:p> </o:p></span></p></div><div><p class=MsoNormal><span style='color:black'>Jeff<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='color:black'> <o:p></o:p></span></p></div><div id=Signature><p><span style='font-family:"Calibri",sans-serif'>Jeff S. Haberl, Ph.D., P.E.inactive, FASHRAE, FIBPSA <i>We are like fluttering leaves on the branches of trees</i></span><o:p></o:p></p><p><span style='font-family:"Calibri",sans-serif'>Liz & Nelson Mitchell Professor in Residential Design <i>in the forest of the landscape that surrounds us.</i></span><o:p></o:p></p><p><span style='font-family:"Calibri",sans-serif'>Department of Architecture <i>If we could, for just a moment, flutter together,</i> </span><o:p></o:p></p><p><span style='font-family:"Calibri",sans-serif'>Texas A&M University <i>we could lift the earth up to be a better place. JSH</i> 2022</span><o:p></o:p></p><p><span style='font-family:"Calibri",sans-serif'>College Station, TX 77845-3581 </span><o:p></o:p></p><p><span style='font-family:"Calibri",sans-serif'>Office: 979-845-6507, Lab: 979-845-6065</span><o:p></o:p></p><p><span style='font-family:"Calibri",sans-serif'>Fax 979-862-2457</span><o:p></o:p></p><p><span style='font-family:"Calibri",sans-serif'><a href="mailto:jhaberl@tamu.edu,www.esl.tamu.edu">jhaberl@tamu.edu,www.esl.tamu.edu</a></span><o:p></o:p></p></div><div class=MsoNormal align=center style='text-align:center'><hr size=2 width="98%" align=center></div><div id=divRplyFwdMsg><p class=MsoNormal><b><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:black'>From:</span></b><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:black'> Bldg-sim <<a href="mailto:bldg-sim-bounces@lists.onebuilding.org">bldg-sim-bounces@lists.onebuilding.org</a>> on behalf of Chris Yates via Bldg-sim <<a href="mailto:bldg-sim@lists.onebuilding.org">bldg-sim@lists.onebuilding.org</a>><br><b>Sent:</b> Tuesday, July 23, 2024 5:54 AM<br><b>To:</b> 'Karen Walkerman' <<a href="mailto:kwalkerman@gmail.com">kwalkerman@gmail.com</a>>; 'Julien Marrec' <<a href="mailto:julien.marrec@gmail.com">julien.marrec@gmail.com</a>><br><b>Cc:</b> <a href="mailto:bldg-sim@onebuilding.org">bldg-sim@onebuilding.org</a> <<a href="mailto:bldg-sim@onebuilding.org">bldg-sim@onebuilding.org</a>><br><b>Subject:</b> Re: [Bldg-sim] "Maslow's" hierarchy of calibration</span> <o:p></o:p></p><div><p class=MsoNormal> <o:p></o:p></p></div></div><div><div><p class=MsoNormal style='mso-line-height-alt:.75pt'><span style='font-size:1.0pt;color:white'>Hi Karen, “Maslow’s” hierarchy of calibration In answer to my own question, perhaps a good starting point is to target the minimum median, and then apply hourly variation. Please excuse my ASCII art (it’s meant to be a triangle!). ________^_________<o:p></o:p></span></p></div><div><p class=MsoNormal style='mso-line-height-alt:.75pt'><span style='font-size:1.0pt;color:white'>ZjQcmQRYFpfptBannerStart<o:p></o:p></span></p></div><div style='border:none;border-top:solid #90A4AE 3.0pt;padding:0cm 0cm 0cm 0cm;display:block!important;text-align:left!important;margin:0px!important;padding:16px!important;border-radius:4px!important;min-width:200px!important;background-color:#D0D8DC!important;border-top:#90a4ae!important' id="x_pfptBannergcgtfyw"><div id="x_pfptBannergcgtfyw"><div id="x_pfptBannergcgtfyw"><p class=MsoNormal style='line-height:13.5pt;background:#D0D8DC'><b><span style='font-family:"Arial",sans-serif;color:black'>This Message Is >From an External Sender <o:p></o:p></span></b></p></div><div id="x_pfptBannergcgtfyw"><p class=MsoNormal style='line-height:13.5pt;background:#D0D8DC'><span style='font-family:"Arial",sans-serif;color:black'>This message came from outside your organization. <o:p></o:p></span></p></div></div><div><p class=MsoNormal style='background:#D0D8DC'><span style='color:black'> </span><o:p></o:p></p></div></div><div><p class=MsoNormal style='mso-line-height-alt:.75pt'><span style='font-size:1.0pt;color:white'>ZjQcmQRYFpfptBannerEnd<o:p></o:p></span></p></div><div><p class=xmsonormal><span style='font-size:11.0pt'>Hi Karen,</span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'> </span><o:p></o:p></p><p class=xmsonormal><b><span style='font-size:11.0pt'>“Maslow’s” hierarchy of calibration</span></b><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'>In answer to my own question, perhaps a good starting point is to target the minimum median, and then apply hourly variation.</span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'>Please excuse my ASCII art (it’s meant to be a triangle!).</span><o:p></o:p></p><p class=xmsonormal><b><span style='font-size:11.0pt'> ________^_________</span></b><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'> / \</span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'> / \</span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'> / \</span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'>Review NMBE & iterate required \</span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'>_____________ ___________________ \</span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'>Review CVRMSE & iterate if required \</span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'>_ ____________ _______________________\</span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'>Apply hourly variations to build \</span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'> up energy usage \</span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'>Apply holidays \</span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'>_________ _______________________________________\</span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'>Set a “universal” generic profile to apply to all gains. \</span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'>This is set to a diversity (say 20% in the above example) \</span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'>And should have enough “headroom” and range to model \ </span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'>_________ _____________________________________________ \</span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'>Create a model with known parameters \ </span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'>Quantify unknown knowns \</span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'>___________________________________________________________</span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'> </span><o:p></o:p></p><p class=xmsonormal><b><span style='font-size:11.0pt'>Carpet and box plots</span></b><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'>I use similar carpet or colour-area plots. Yours is similar, but I think you are tracing an average day in your example? I like your “synoptic” view of modelled v. actual.</span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'> </span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'>I create the carpet plot using a pivot table hack in Excel and ECAM processed data as the source:</span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'><img border=0 width=875 height=317 style='width:9.1145in;height:3.302in' id="x_Picture_x0020_4" src="cid:image002.png@01DADE86.F5377FD0"></span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'> </span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'>Another handy tool in ECAM is the Boxplot. I will usually target the median as the most likely observed outcome.</span><o:p></o:p></p><p class=xmsonormal><img border=0 width=708 height=395 style='width:7.375in;height:4.1145in' id="x_Picture_x0020_3" src="cid:image003.png@01DADE86.F5377FD0"><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'> </span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'>Regards</span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'>Chris</span><o:p></o:p></p><p class=xmsonormal><span style='font-size:11.0pt'> </span><o:p></o:p></p><div style='border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm'><p class=xmsonormal><b><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif'>From:</span></b><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif'> Karen Walkerman <<a href="mailto:kwalkerman@gmail.com">kwalkerman@gmail.com</a>> <br><b>Sent:</b> Tuesday, July 23, 2024 10:29 AM<br><b>To:</b> Julien Marrec <<a href="mailto:julien.marrec@gmail.com">julien.marrec@gmail.com</a>><br><b>Cc:</b> Chris Yates <<a href="mailto:chris.malcolm.yates@gmail.com">chris.malcolm.yates@gmail.com</a>>; <a href="mailto:bldg-sim@onebuilding.org">bldg-sim@onebuilding.org</a><br><b>Subject:</b> Re: [Bldg-sim] "Maslow's" hierarchy of calibration</span><o:p></o:p></p></div><p class=xmsonormal> <o:p></o:p></p><div><p class=xmsonormal>Chris - one tool I've found very useful is to create a heat-map that compares modeled data with actual data. I usually do this with hourly data. Then I'll create a grid that shows actual and modeled data and break it down by hour of the day and day of the week. I can further filter it by time of year, or outdoor temperature. Here's an example of total electrical demand for the whole year broken down by day and hour of day:<o:p></o:p></p><div><p class=xmsonormal><img border=0 width=472 height=392 style='width:4.9166in;height:4.0833in' id="x_Picture_x0020_1" src="cid:image004.png@01DADE86.F5377FD0"><o:p></o:p></p></div><div><p class=xmsonormal> <o:p></o:p></p></div><div><p class=xmsonormal>In this example, we can see that the model is missing some night-time base loads, there is better agreement during periods of time with high occupancy and that the occupancy schedule and building opening / closing schedules need to be adjusted.<o:p></o:p></p></div><div><p class=xmsonormal> <o:p></o:p></p></div><div><p class=xmsonormal>I've found this approach can really help me identify what parameters to experiment with, and it is also an excellent tool for communicating with clients.<o:p></o:p></p></div><div><p class=xmsonormal> <o:p></o:p></p></div><div><p class=xmsonormal>--<o:p></o:p></p></div><div><p class=xmsonormal>Karen<o:p></o:p></p></div></div><p class=xmsonormal> <o:p></o:p></p><div><div><p class=xmsonormal>On Tue, Jul 23, 2024 at 3:41<span style='font-family:"Arial",sans-serif'> </span>AM Julien Marrec via Bldg-sim <<a href="mailto:bldg-sim@lists.onebuilding.org">bldg-sim@lists.onebuilding.org</a>> wrote:<o:p></o:p></p></div><blockquote style='border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt'><div><div><p class=xmsonormal>Hello Chris,<o:p></o:p></p></div><div><p class=xmsonormal> <o:p></o:p></p></div><div><p class=xmsonormal>Apologies if I didn't understand the question correctly, but I understood it as how to automate (part of) the calibration process.<o:p></o:p></p></div><div><p class=xmsonormal> <o:p></o:p></p></div><div><p class=xmsonormal>I don't think you should do without first taking a hard look at your initial model, refine it until almost satisfied, before you can start the calibration process itself. One example would be you should probably take a close look at your output:variables to ensure that you are supplying the right amount of outside air to your zones.<o:p></o:p></p></div><div><p class=xmsonormal> <o:p></o:p></p></div><div><p class=xmsonormal>I also don't think you should blindly let some tool touch <b>any</b> parameters there are in your simulation file. There are things you can measure or reasonably approximate, and those should be defined in your model. Then there are things that are hard to guess, or hard to guess right, and those should be what you play on.<o:p></o:p></p></div><div><p class=xmsonormal> <o:p></o:p></p></div><div><p class=xmsonormal>These caveats aside, there are a number of tools and algorithms that can help you automate the calibration process itself.<o:p></o:p></p></div><div><p class=xmsonormal> <o:p></o:p></p></div><div><p class=xmsonormal>One example of such is LBNL's <a href="https://urldefense.com/v3/__https:/simulationresearch.lbl.gov/projects/genopt__;!!KwNVnqRv!Em5xqgZ5BEMU6HnP1TTca-WhZo9-Hn1LZPCWjh75yndE7tRgedMxs1q23qMpXDKcciC9w9P2uSlKNj1TfYCztW9nKLs$" target="_blank">GenOpt</a> which is software agnostic (a front-end for it that I have used in the past with both eQuest and EnergyPlus is ExcaliBEM, from Canada's SIMEB, not sure if still out there or not)<o:p></o:p></p></div><div><p class=xmsonormal> <o:p></o:p></p></div><div><p class=xmsonormal>You basically inform the software of the parameters you want to vary and how (for eg, infiltration from 0.3 to 1.0 ACH, R-value +- 30%, heating system efficiency range, etc), and define an objective function, which can be a python script. I've done one that basically tries to minimize the CV(RMSE) and NMBE %, and penalizes heavily if not meeting the thresholds of Guideline 14. The tool will run simulations and try to minimize the objective function. <o:p></o:p></p></div><div><p class=xmsonormal> <o:p></o:p></p></div><div><p class=xmsonormal>The <a href="https://urldefense.com/v3/__https:/github.com/NREL/OpenStudio-server__;!!KwNVnqRv!Em5xqgZ5BEMU6HnP1TTca-WhZo9-Hn1LZPCWjh75yndE7tRgedMxs1q23qMpXDKcciC9w9P2uSlKNj1TfYCzBMDGrTc$" target="_blank">OpenStudio Analysis Framework</a> is a great candidate if you're working with the OpenStudio ecosystem.<o:p></o:p></p></div><div><p class=xmsonormal> <o:p></o:p></p></div><div><p class=xmsonormal><a href="https://urldefense.com/v3/__http:/www.jeplus.org/wiki/doku.php__;!!KwNVnqRv!Em5xqgZ5BEMU6HnP1TTca-WhZo9-Hn1LZPCWjh75yndE7tRgedMxs1q23qMpXDKcciC9w9P2uSlKNj1TfYCzMY11YME$" target="_blank">JEPlus+EA</a> can do that for EnergyPlus (and is (was?) bundled in Design Builder if I recall correctly)<o:p></o:p></p></div><div><p class=xmsonormal> <o:p></o:p></p></div><div><p class=xmsonormal>There are a variety of similar questions on <a href="https://urldefense.com/v3/__http:/unmethours.com__;!!KwNVnqRv!Em5xqgZ5BEMU6HnP1TTca-WhZo9-Hn1LZPCWjh75yndE7tRgedMxs1q23qMpXDKcciC9w9P2uSlKNj1TfYCzNoYx_sA$" target="_blank">unmethours.com</a><o:p></o:p></p></div><div><p class=xmsonormal> <o:p></o:p></p></div><div><p class=xmsonormal>Best,<o:p></o:p></p></div><div><p class=xmsonormal>Julien<o:p></o:p></p></div><div><div><div><div><div><div><div><div><div><p class=xmsonormal>--<br>Julien Marrec, EBCP, BPI MFBA<br>Owner at <a href="https://urldefense.com/v3/__http:/www.effibem.com__;!!KwNVnqRv!Em5xqgZ5BEMU6HnP1TTca-WhZo9-Hn1LZPCWjh75yndE7tRgedMxs1q23qMpXDKcciC9w9P2uSlKNj1TfYCznvsw29o$" target="_blank">EffiBEM</a><br>T: +33 6 95 14 42 13<br><span style='color:black'><br>LinkedIn (<a href="https://urldefense.com/v3/__https:/www.linkedin.com/in/julienmarrec__;!!KwNVnqRv!Em5xqgZ5BEMU6HnP1TTca-WhZo9-Hn1LZPCWjh75yndE7tRgedMxs1q23qMpXDKcciC9w9P2uSlKNj1TfYCzV8n5UH8$" target="_blank">en</a>) <i>| </i>(<a href="https://urldefense.com/v3/__https:/fr.linkedin.com/in/julienmarrec/fr__;!!KwNVnqRv!Em5xqgZ5BEMU6HnP1TTca-WhZo9-Hn1LZPCWjh75yndE7tRgedMxs1q23qMpXDKcciC9w9P2uSlKNj1TfYCzRFBgLeI$" target="_blank">fr</a>) : </span><o:p></o:p></p></div></div></div></div></div></div></div></div><p class=xmsonormal> <o:p></o:p></p></div></div><p class=xmsonormal> <o:p></o:p></p><div><div><p class=xmsonormal>Le mar. 23 juil. 2024 à 09:06, Chris Yates via Bldg-sim <<a href="mailto:bldg-sim@lists.onebuilding.org" target="_blank">bldg-sim@lists.onebuilding.org</a>> a écrit :<o:p></o:p></p></div><blockquote style='border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt'><div><div><div><p class=xmsonormal>Dear bldg-sim’rs,<o:p></o:p></p><p class=xmsonormal> <o:p></o:p></p><p class=xmsonormal>I’m interested in how people save time and improve accuracy when it comes to calibrated simulation.<o:p></o:p></p><p class=xmsonormal> <o:p></o:p></p><p class=xmsonormal>Calibrated simulation attempts to model a vast amount of parameters. In comparison to regression methods it’s completely overspecified. We do it in the hope of creating a model (a “digital twin”) that gives us many more what-if? scenarios than regression could on its own.<o:p></o:p></p><p class=xmsonormal> <o:p></o:p></p><p class=xmsonormal>However, the process is often fraught with dead ends. Of course it is! There are too many details. We can waste a lot of time on getting one parameter right, only to find it has little effect. Even worse, we could overlook something major and compensate with our own erroneous assumptions. Or, we can work through a whole model and find something very late on, causing us to backtrack over previous work. The act of calibration seems beyond detailed management because of the sheer number of building types, servicing approaches, operational parameters, embedded issues (this is a longer list but I’ve ran out of words…).<o:p></o:p></p><p class=xmsonormal> <o:p></o:p></p><p class=xmsonormal>The exam question is:<o:p></o:p></p><p class=xmsonormal> <o:p></o:p></p><ul style='margin-top:0cm' type=disc><li class=xmsonormal style='mso-list:l0 level1 lfo1'>Does anybody follow a simple high level framework (a bit like Maslow) for calibration? <o:p></o:p></li></ul><p class=xmsonormal> <o:p></o:p></p><p class=xmsonormal>Sorry. I could have asked that at the start of the email <span style='font-family:"Segoe UI Emoji",sans-serif'>😐</span><o:p></o:p></p><p class=xmsonormal> <o:p></o:p></p><p class=xmsonormal>All the best<o:p></o:p></p><p class=xmsonormal> <o:p></o:p></p><p class=xmsonormal>Chris<o:p></o:p></p></div></div><p class=xmsonormal>_______________________________________________<br>Bldg-sim mailing list<br><a href="https://urldefense.com/v3/__http:/lists.onebuilding.org/listinfo.cgi/bldg-sim-onebuilding.org__;!!KwNVnqRv!Em5xqgZ5BEMU6HnP1TTca-WhZo9-Hn1LZPCWjh75yndE7tRgedMxs1q23qMpXDKcciC9w9P2uSlKNj1TfYCzFoZLAxU$" target="_blank">http://lists.onebuilding.org/listinfo.cgi/bldg-sim-onebuilding.org</a><br>To unsubscribe from this mailing list send a blank message to <a href="mailto:BLDG-SIM-UNSUBSCRIBE@ONEBUILDING.ORG" target="_blank">BLDG-SIM-UNSUBSCRIBE@ONEBUILDING.ORG</a><o:p></o:p></p></div></blockquote></div><p class=xmsonormal>_______________________________________________<br>Bldg-sim mailing list<br><a href="https://urldefense.com/v3/__http:/lists.onebuilding.org/listinfo.cgi/bldg-sim-onebuilding.org__;!!KwNVnqRv!Em5xqgZ5BEMU6HnP1TTca-WhZo9-Hn1LZPCWjh75yndE7tRgedMxs1q23qMpXDKcciC9w9P2uSlKNj1TfYCzFoZLAxU$" target="_blank">http://lists.onebuilding.org/listinfo.cgi/bldg-sim-onebuilding.org</a><br>To unsubscribe from this mailing list send a blank message to <a href="mailto:BLDG-SIM-UNSUBSCRIBE@ONEBUILDING.ORG" target="_blank">BLDG-SIM-UNSUBSCRIBE@ONEBUILDING.ORG</a><o:p></o:p></p></blockquote></div></div></div></div></body></html>