NREL/OpenOA

Some cells in the example notebooks take a long time to run.

jordanperr opened this issue · 3 comments

I noticed the following cells take a relatively long time to run for an example:

02c_augmented_plant_aep_analysis.ipynb:

  • aep_gam.run(num_sim=1000) takes about 5 minutes to run on my machine.

03_turbine_ideal_energy.ipynb:

  • ta.run(reanalysis_products=['era5', 'merra2']) towards the end of the notebook takes 3 minutes to run on my machine.

05_eya_gap_analysis.ipynb:

  • Cell that starts with # Calculate TIE also takes a long time (3 minutes) to run on my machine.

@jordanperr this is how the examples have always been, except in v2 they took 15-20 minutes to run, so it'd be great to get more background on what exactly a satisfactory resolution would be. The primary reason they take a long time to run is to demonstrate the UQ capabilities of the models

This has been an ongoing back-and-forth with these tests and examples. We have discussed the pros and cons in reducing the number of iterations to speed up tests and examples but also wanting to maintain validity. Five minutes isn't too bad. Maybe a middle-ground is to add some text in the preceding notebook cell suggesting that users could further reduce num_sim if the example is taking too long to run (at the expense of accuracy).

@jordanperr, please check out #266 to see if this appropriately addresses the problem. I was aiming to balance run time and results stability based on the resulting plots, but let me know if anything should be changed further there.