[Bug]: CEA Pathway for IDP Test Bug Report

[bnutr]

What happened?

Major bugs

• Plot - Lifecycle Emissions: Error in plotting even results exist ('NoneType' object has no attribute 'set_index’). The error log is below:

  City Energy Analyst version 4.0.0-beta.7
  Running `cea plot-lifecycle-emissions` with the following parameters:
  - general:scenario = C:\Codes\CEA_projects\NRP81\20260425_try_winterthur
    (default: C:\Codes\CEA_projects\NRP81\20260425_try_winterthur)
  - plots-general:plot-title = 
    (default: )
  - plots-general:plot-type = bar_plot_stack
    (default: bar_plot_stack)
  - plots-general:y-min = None
    (default: None)
  - plots-general:y-max = None
    (default: None)
  - plots-general:y-step = None
    (default: None)
  - plots-general:y-label = 
    (default: )
  - plots-general:facet-by-numbers-wrapped = 3
    (default: 3)
  - plots-general:facet-by-rows = False
    (default: False)
  - plots-general:x-sorted-by = building_name
    (default: default)
  - plots-general:x-sorted-reversed = False
    (default: False)
  - plots-general:x-label = 
    (default: )
  - plots-general:context = {'feature': 'lifecycle-emissions', 'period_start': 2000, 'period_end': 2100, 'solar_panel_types': {}}
    (default: {})
  - plots-include-plants-buildings:include = ['plants', 'buildings']
    (default: ['plants', 'buildings'])
  - plots-lifecycle-emissions:what-if-name = ['what-if1']
    (default: [])
  - plots-lifecycle-emissions:y-category-to-plot = ['operation', 'production', 'demolition', 'biogenic']
    (default: ['operation', 'production', 'demolition', 'biogenic'])
  - plots-lifecycle-emissions:operation-services = ['electricity', 'space_heating', 'space_cooling']
    (default: ['electricity', 'space_heating', 'space_cooling', 'domestic_hot_water', 'district_heating', 'district_cooling', 'solar_pv_electricity', 'solar_pvt_electricity', 'solar_pvt_thermal', 'solar_thermal'])
  - plots-lifecycle-emissions:envelope-components = ['wall_ag', 'wall_bg', 'wall_part', 'win_ag', 'roof', 'upperside', 'underside', 'floor', 'base', 'technical_systems']
    (default: ['wall_ag', 'wall_bg', 'wall_part', 'win_ag', 'roof', 'upperside', 'underside', 'floor', 'base', 'technical_systems'])
  - plots-lifecycle-emissions:y-metric-unit = kgCO2e
    (default: kgCO2e)
  - plots-lifecycle-emissions:y-normalised-by = gross_floor_area
    (default: gross_floor_area)
  - plots-lifecycle-emissions:x-to-plot = building
    (default: building)
  - plots-building-filter:buildings = ['B1000', 'B1001', 'B1002']
    (default: [])
  - plots-building-filter:filter-buildings-by-year-start = 1900
    (default: 1900)
  - plots-building-filter:filter-buildings-by-year-end = 2100
    (default: 2050)
  - plots-building-filter:filter-buildings-by-construction-type = ['STANDARD1', 'STANDARD2', 'STANDARD3', 'STANDARD4', 'STANDARD5', 'STANDARD6', 'STANDARD4_COPY', 'STANDARD4_COPY1']
    (default: [])
  - plots-building-filter:filter-buildings-by-use-type = ['MULTI_RES', 'SINGLE_RES', 'HOTEL', 'OFFICE', 'RETAIL', 'FOODSTORE', 'RESTAURANT', 'INDUSTRIAL', 'SCHOOL', 'HOSPITAL', 'GYM', 'SWIMMING', 'SERVERROOM', 'PARKING', 'COOLROOM', 'LAB', 'MUSEUM', 'LIBRARY', 'UNIVERSITY', 'MULTI_MULTI']
    (default: [])
  - plots-building-filter:min-ratio-as-main-use = 0.0
    (default: 0.0)
  Using context: {'feature': 'lifecycle-emissions', 'period_start': 2000, 'period_end': 2100, 'solar_panel_types': {}}
  Error loading csv file: [Errno 2] No such file or directory: 'C:\\Codes\\CEA_projects\\NRP81\\20260425_try_winterthur\\export\\plots\\selected_buildings.csv'
  
  ------------------------------------
  Script failed. Execution time: 0.14s
  
  ERROR: 'NoneType' object has no attribute 'set_index'
  

• Weather helper — pyepwmorph: Error

  --> The keys in the returned dictionary of datasets are constructed as follows:
  	'activity_id.institution_id.source_id.experiment_id.table_id.grid_label'
  █
  
   |------------------------------------------------------------| 0.00% [0/10 00:00<?]
   Could not determine bucket type for bucket name cmip6: Your default credentials were not found. 
   To set up Application Default Credentials, see https://cloud.google.com/docs/authentication/external/set-up-adc 
   for more information., falling back to GCSFileSystem
  

• Pathway Builder — The individual pathway’s state (specific year) custom editor (on the left top UI) disappear after I move the cursor/change the view of the map. The whole panel of "pathway" just disappears. Workaround solution: Refresh the UI, but the same problem persists, making users unable to edit pathway's state. This is the same issue raised in the CEA-GUI git: Pathway selector GUI missing CityEnergyAnalyst-GUI#228

• Pathway Builder — For state that has building with void_deck, radiation simulation (with DAYSIM) seems not running, resulting in an error for the state demand calculation.

    --- Simulating state 2028: base workflow ---
    ================================================================================
    Workflow step 1: script=<cea radiation>
    ================================================================================
    City Energy Analyst version 4.0.0-beta.7
    Running `cea radiation` with the following parameters:
    - general:scenario = C:\Codes\CEA_projects\NRP81\20260425_try_winterthur_extension\outputs\pathways\20260803_test\state_2028
      (default: C:\Codes\CEA_projects\NRP81\20260425_try_winterthur_extension\outputs\pathways\20260803_test\state_2028)
    - general:multiprocessing = True
      (default: True)
    - general:number-of-cpus-to-keep-free = 1
      (default: 1)
    - general:debug = False
      (default: False)
    - radiation:buildings = []
      (default: [])
    - radiation:roof-grid = 10.0
      (default: 10.0)
    - radiation:walls-grid = 200.0
      (default: 200.0)
    - radiation:zone-geometry = 2.0
      (default: 2.0)
    - radiation:surrounding-geometry = 5.0
      (default: 5.0)
    - radiation:consider-floors = True
      (default: True)
    - radiation:neglect-adjacent-buildings = False
      (default: False)
    - radiation:albedo = 0.2
      (default: 0.2)
    - radiation:rad-ab = 4
      (default: 4)
    - radiation:rad-ad = 512
      (default: 512)
    - radiation:rad-as = 32
      (default: 32)
    - radiation:rad-ar = 20
      (default: 20)
    - radiation:rad-aa = 0.15
      (default: 0.15)
    - radiation:rad-lr = 8
      (default: 8)
    - radiation:rad-st = 0.5
      (default: 0.5)
    - radiation:rad-sj = 0.7
      (default: 0.7)
    - radiation:rad-lw = 0.05
      (default: 0.05)
    - radiation:rad-dj = 0.7
      (default: 0.7)
    - radiation:rad-ds = 0.0
      (default: 0.0)
    - radiation:rad-dr = 0
      (default: 0)
    - radiation:rad-dp = 32
      (default: 32)
    - radiation:n-buildings-in-chunk = 100
      (default: 100)
    - radiation:write-sensor-data = True
      (default: True)
    Using Daysim binaries from path: c:\codes\cityenergyanalyst\.pixi\envs\default\lib\site-packages\cea_external_tools\bin
    verifying geometry files
    zone: C:\Codes\CEA_projects\NRP81\20260425_try_winterthur_extension\outputs\pathways\20260803_test\state_2028\inputs\building-geometry\zone.shp
    surroundings: C:\Codes\CEA_projects\NRP81\20260425_try_winterthur_extension\outputs\pathways\20260803_test\state_2028\inputs\building-geometry\surroundings.shp
    trees: None
    Getting geometry materials
    Creating 3D geometry and surfaces
    Saving geometry pickle files in: C:\Codes\CEA_projects\NRP81\20260425_try_winterthur_extension\outputs\pathways\20260803_test\state_2028\outputs\data\solar-radiation\radiance_geometry_pickle
    Standardizing coordinate systems
    Reprojected scene to `EPSG:32632`
    Reading terrain geometry
    Creating 3D building surfaces
    Calculating terrain intersection of building geometries
    Using 21 CPU's
    Creating geometry for building 1 completed out of 5
    Creating geometry for building 2 completed out of 5
    Creating geometry for building 3 completed out of 5
    Creating geometry for building 4 completed out of 5
    Creating geometry for building 5 completed out of 5
    Using 21 CPU's
    Creating geometry for building 1 completed out of 46
    Creating geometry for building 2 completed out of 46
    Creating geometry for building 3 completed out of 46
    Creating geometry for building 4 completed out of 46
    Creating geometry for building 5 completed out of 46
    Creating geometry for building 6 completed out of 46
    Creating geometry for building 7 completed out of 46
    Creating geometry for building 8 completed out of 46
    Creating geometry for building 9 completed out of 46
    Creating geometry for building 10 completed out of 46
    Creating geometry for building 11 completed out of 46
    Creating geometry for building 12 completed out of 46
    Creating geometry for building 13 completed out of 46
    Creating geometry for building 14 completed out of 46
    Creating geometry for building 15 completed out of 46
    Creating geometry for building 16 completed out of 46
    Creating geometry for building 17 completed out of 46
    Creating geometry for building 18 completed out of 46
    Creating geometry for building 19 completed out of 46
    Creating geometry for building 21 completed out of 46
    Creating geometry for building 22 completed out of 46
    Creating geometry for building 20 completed out of 46
    Creating geometry for building 23 completed out of 46
    Creating geometry for building 24 completed out of 46
    Creating geometry for building 25 completed out of 46
    Creating geometry for building 26 completed out of 46
    Creating geometry for building 27 completed out of 46
    Creating geometry for building 28 completed out of 46
    Creating geometry for building 29 completed out of 46
    Creating geometry for building 30 completed out of 46
    Creating geometry for building 31 completed out of 46
    Creating geometry for building 32 completed out of 46
    Creating geometry for building 33 completed out of 46
    Creating geometry for building 34 completed out of 46
    Creating geometry for building 35 completed out of 46
    Creating geometry for building 36 completed out of 46
    Creating geometry for building 37 completed out of 46
    Creating geometry for building 38 completed out of 46
    Creating geometry for building 39 completed out of 46
    Creating geometry for building 40 completed out of 46
    Creating geometry for building 41 completed out of 46
    Creating geometry for building 42 completed out of 46
    Creating geometry for building 43 completed out of 46
    Creating geometry for building 44 completed out of 46
    Creating geometry for building 45 completed out of 46
    Creating geometry for building 46 completed out of 46
    Generating geometry for surrounding buildings
    Generating geometry for buildings in the zone of analysis
    Using 21 CPU's
    Generating geometry for building 1 completed out of 5
    Generating geometry for building 2 completed out of 5
    Generating geometry for building 3 completed out of 5
    Generating geometry for building 4 completed out of 5
    Generating geometry for building 5 completed out of 5
    Creating radiance material file
    Creating radiance geometry file
    Converting files for DAYSIM
    Transforming weather files to daysim format
    Running command `epw2wea "C:\Codes\CEA_projects\NRP81\20260425_try_winterthur_extension\outputs\pathways\20260803_test\state_2028\inputs\weather\weather.epw" "C:\Users\BBERNA~1\AppData\Local\Temp\tmpgeqdit0y\cea_radiation\common_inputs\weather_60min.wea"`
    place Dubendorf.AP_CHE
    latitude 47.39900
    longitude -8.65
    time_zone -15.00
    site_elevation 448.1
    weather_data_file_units 1
    
    Transforming radiance files to daysim format
    Running command `radfiles2daysim "C:\Users\BBERNA~1\AppData\Local\Temp\tmpgeqdit0y\cea_radiation\common_inputs\rad2daysim.hea" -g -m -d`
    
    Using 21 CPU's
    Daysim simulation finished in 0.52 mins
    
    -----------------------------------------
    Script completed. Execution time: 145.30s
    --------------------------------------------------------------------------------
    
    ================================================================================
    Workflow step 2: script=<cea occupancy>
    ================================================================================
    City Energy Analyst version 4.0.0-beta.7
    Running `cea occupancy` with the following parameters:
    - general:scenario = C:\Codes\CEA_projects\NRP81\20260425_try_winterthur_extension\outputs\pathways\20260803_test\state_2028
      (default: C:\Codes\CEA_projects\NRP81\20260425_try_winterthur_extension\outputs\pathways\20260803_test\state_2028)
    - general:multiprocessing = True
      (default: True)
    - general:number-of-cpus-to-keep-free = 1
      (default: 1)
    - general:debug = False
      (default: False)
    - occupancy:occupancy-model = deterministic
      (default: deterministic)
    - occupancy:buildings = ['B1000', 'B1000H', 'B1001', 'B1001V', 'B1002']
      (default: [])
    Running occupancy model for scenario C:\Codes\CEA_projects\NRP81\20260425_try_winterthur_extension\outputs\pathways\20260803_test\state_2028
    Running occupancy model  with schedule model=deterministic
    Using 21 CPU's
    Schedule for building No. 1 completed out of 5: B1000H
    Schedule for building No. 2 completed out of 5: B1002
    Schedule for building No. 3 completed out of 5: B1001V
    Schedule for building No. 4 completed out of 5: B1001
    Schedule for building No. 5 completed out of 5: B1000
    
    ----------------------------------------
    Script completed. Execution time: 31.62s
    --------------------------------------------------------------------------------
    
    ================================================================================
    Workflow step 3: script=<cea demand>
    ================================================================================
    City Energy Analyst version 4.0.0-beta.7
    Running `cea demand` with the following parameters:
    - general:scenario = C:\Codes\CEA_projects\NRP81\20260425_try_winterthur_extension\outputs\pathways\20260803_test\state_2028
      (default: C:\Codes\CEA_projects\NRP81\20260425_try_winterthur_extension\outputs\pathways\20260803_test\state_2028)
    - general:multiprocessing = True
      (default: True)
    - general:number-of-cpus-to-keep-free = 1
      (default: 1)
    - general:debug = False
      (default: False)
    - demand:buildings = ['B1000', 'B1000H', 'B1001', 'B1001V', 'B1002']
      (default: [])
    - demand:use-dynamic-infiltration-calculation = False
      (default: False)
    - demand:overheating-warning = False
      (default: False)
    - demand:retain-technical-results = False
      (default: False)
    
    ---------------------------
    ERROR: Missing input files:
    - C:\Codes\CEA_projects\NRP81\20260425_try_winterthur_extension\outputs\pathways\20260803_test\state_2028\outputs\data\solar-radiation\B1000_geometry.csv
      (HINT: try running radiation)
    - C:\Codes\CEA_projects\NRP81\20260425_try_winterthur_extension\outputs\pathways\20260803_test\state_2028\outputs\data\solar-radiation\B1000_radiation.csv
      (HINT: try running radiation)
    
    --------------------------------------
    Script failed. Execution time: 344.12s
    
    ERROR: 
  

• Pathway Builder — After finishing “simulate pathway” successfully without any error, results cannot be plotted due to “Pathway emissions timeline file not found” (error log below). My investigation suggests that this only occurs if I have a pathway that was previously partially run (e.g., error on a state force the batch simulation to stop), and then after error on a state has been resolved and the pathway continues the rest of the simulation, the "Pathway emissions timeline" is not automatically calculated (maybe?)

  City Energy Analyst version 4.0.0-beta.7
  Running `cea plot-pathway-emission-timeline` with the following parameters:
  - general:scenario = C:\Codes\CEA_projects\NRP81\20260803_cea_pathway_test_withoutVE
   (default: C:\Codes\CEA_projects\NRP81\20260803_cea_pathway_test_withoutVE)
  - plots-pathway-emission-timeline:existing-pathway-names = ['20260803_test']
   (default: [])
  - plots-pathway-emission-timeline:plot-type = shaded_stack_cumulative
   (default: shaded_stack_cumulative)
  - plots-pathway-emission-timeline:y-category-to-plot = ['operation', 'production', 'demolition', 'biogenic']
   (default: ['operation', 'production', 'demolition', 'biogenic'])
  - plots-pathway-emission-timeline:operation-services = ['electricity', 'space_heating', 'space_cooling', 'dhw', 'pv_electricity_offset', 'pv_electricity_export']
   (default: ['electricity', 'space_heating', 'space_cooling', 'dhw', 'pv_electricity_offset', 'pv_electricity_export'])
  - plots-pathway-emission-timeline:envelope-components = ['wall_ag', 'wall_bg', 'wall_part', 'win_ag', 'roof', 'upperside', 'underside', 'floor', 'base', 'technical_systems', 'pv']
   (default: ['wall_ag', 'wall_bg', 'wall_part', 'win_ag', 'roof', 'upperside', 'underside', 'floor', 'base', 'technical_systems', 'pv'])
  - plots-pathway-emission-timeline:pv-code = PV1
   (default: PV1)
  - plots-pathway-emission-timeline:y-metric-unit = kgCO2e
   (default: kgCO2e)
  - plots-pathway-emission-timeline:y-normalised-by = no_normalisation
   (default: no_normalisation)
  - plots-pathway-emission-timeline:y-min = None
   (default: None)
  - plots-pathway-emission-timeline:y-max = None
   (default: None)
  - plots-pathway-emission-timeline:y-step = None
   (default: None)
  - plots-pathway-emission-timeline:net-zero-target-year = 2060
   (default: 2060)
  - plots-pathway-emission-timeline:cutoff-year = None
   (default: None)
  - plots-pathway-emission-timeline:context = {'feature': 'pathway-emission-timeline', 'period_start': 0, 'period_end': 0, 'solar_panel_types': {}}
   (default: {})
  - plots-building-filter:buildings = ['B1000', 'B1000H', 'B1001', 'B1002', 'B1002NB']
   (default: [])
  - plots-building-filter:filter-buildings-by-year-start = 1900
   (default: 1900)
  - plots-building-filter:filter-buildings-by-year-end = 2100
   (default: 2050)
  - plots-building-filter:filter-buildings-by-construction-type = ['STANDARD1', 'STANDARD2', 'STANDARD3', 'STANDARD4', 'STANDARD5', 'STANDARD6', 'STANDARD4_COPY', 'STANDARD4_COPY1', 'STANDARD4_COPY_COPY']
   (default: [])
  - plots-building-filter:filter-buildings-by-use-type = ['MULTI_RES', 'SINGLE_RES', 'HOTEL', 'OFFICE', 'RETAIL', 'FOODSTORE', 'RESTAURANT', 'INDUSTRIAL', 'SCHOOL', 'HOSPITAL', 'GYM', 'SWIMMING', 'SERVERROOM', 'PARKING', 'COOLROOM', 'LAB', 'MUSEUM', 'LIBRARY', 'UNIVERSITY', 'MULTI_MULTI']
   (default: [])
  - plots-building-filter:min-ratio-as-main-use = 0.0
   (default: 0.0)
  
  ------------------------------------
  Script failed. Execution time: 0.18s
  
  ERROR: Pathway emissions timeline file not found: C:\Codes\CEA_projects\NRP81\20260803_cea_pathway_test_withoutVE\outputs\pathways\20260803_test\district_pathway_emissions_timeline.csv
  

Minor bugs

• Plot - Lifecycle Emissions: default setting/value for “y-category-to-plot” only includes “operation”. Maybe good to have all (operation, demolition, etc.)
• Error when plotting cost: no matter what value is chosen for x-sorted-by (e.g. building name), the plot is always grouped and showed only for “BUILDING”

• UI — Pathway : Logs are hidden behind the pathway builder toggle

Good-to-haves

• Create a “clear log” button/functionality
• Clear/delete simulation outputs in pathway

Questions

• Is “Building Solar Radiation using CRAX” still on BETA?
• GHG is still on BETA?

How can we reproduce this?

20260803_cea_pathway_test.zip

With the following input zip

Operating System

Windows

CEA Version

4.0.0-beta7

Additional information (optional)

No response

[reyery]

Weather helper — pyepwmorph: Error

--> The keys in the returned dictionary of datasets are constructed as follows:
	'activity_id.institution_id.source_id.experiment_id.table_id.grid_label'
█

 |------------------------------------------------------------| 0.00% [0/10 00:00<?]
 Could not determine bucket type for bucket name cmip6: Your default credentials were not found. 
 To set up Application Default Credentials, see https://cloud.google.com/docs/authentication/external/set-up-adc 
 for more information., falling back to GCSFileSystem

@justinfmccarty are you familiar with this error? Seems like there's something wrong with the google bucket.

[justinfmccarty]

Hmmm @reyery, that's a new one. Might have been a momentary outage?

https://console.cloud.google.com/storage/browser/cmip6

[reyery]

Hmmm @reyery, that's a new one. Might have been a momentary outage?

https://console.cloud.google.com/storage/browser/cmip6

@justinfmccarty I was able to access the dataset via the browser after signing in using a google account. Not sure if there was a change in authenticate for it. Does any of the dependencies require some form of authentication?