Error exporting image as tif
nlebovits opened this issue · 1 comments
nlebovits commented
Environment Information
OS | Windows | CPU(s) | 20 | Machine | AMD64
Architecture | 64bit | RAM | 63.8 GiB | Environment | Jupyter
Python 3.9.16 (main, Mar 8 2023, 10:39:24) [MSC v.1916 64 bit (AMD64)]
geemap | 0.23.1 | ee | 0.1.357 | ipyleaflet | 0.17.3
folium | 0.14.0 | jupyterlab | 3.6.3 | notebook | 6.5.4
ipyevents | 2.0.1 | geopandas | 0.12.2 | |
Intel(R) oneAPI Math Kernel Library Version 2023.1-Product Build 20230303 for Intel(R) 64 architecture applications
Description
I'm trying to export an image to my local machine via ee_export_image(). I followed the code here but am running into an error when downloading. The code runs but breaks after ~2.5s and says "An error occurred while downloading."
Error message here:
---------------------------------------------------------------------------
JSONDecodeError Traceback (most recent call last)
File [c:\Users\Nissim\AppData\Local\r-miniconda\envs\geemap\lib\site-packages\requests\models.py:971](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/site-packages/requests/models.py:971), in Response.json(self, **kwargs)
[970](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/site-packages/requests/models.py:970) try:
--> [971](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/site-packages/requests/models.py:971) return complexjson.loads(self.text, **kwargs)
[972](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/site-packages/requests/models.py:972) except JSONDecodeError as e:
[973](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/site-packages/requests/models.py:973) # Catch JSON-related errors and raise as requests.JSONDecodeError
[974](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/site-packages/requests/models.py:974) # This aliases json.JSONDecodeError and simplejson.JSONDecodeError
File [c:\Users\Nissim\AppData\Local\r-miniconda\envs\geemap\lib\json\__init__.py:346](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/json/__init__.py:346), in loads(s, cls, object_hook, parse_float, parse_int, parse_constant, object_pairs_hook, **kw)
[343](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/json/__init__.py:343) if (cls is None and object_hook is None and
[344](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/json/__init__.py:344) parse_int is None and parse_float is None and
[345](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/json/__init__.py:345) parse_constant is None and object_pairs_hook is None and not kw):
--> [346](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/json/__init__.py:346) return _default_decoder.decode(s)
[347](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/json/__init__.py:347) if cls is None:
File [c:\Users\Nissim\AppData\Local\r-miniconda\envs\geemap\lib\json\decoder.py:337](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/json/decoder.py:337), in JSONDecoder.decode(self, s, _w)
[333](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/json/decoder.py:333) """Return the Python representation of ``s`` (a ``str`` instance
[334](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/json/decoder.py:334) containing a JSON document).
[335](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/json/decoder.py:335)
[336](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/json/decoder.py:336) """
--> [337](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/json/decoder.py:337) obj, end = self.raw_decode(s, idx=_w(s, 0).end())
[338](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/json/decoder.py:338) end = _w(s, end).end()
File [c:\Users\Nissim\AppData\Local\r-miniconda\envs\geemap\lib\json\decoder.py:355](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/json/decoder.py:355), in JSONDecoder.raw_decode(self, s, idx)
[354](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/json/decoder.py:354) except StopIteration as err:
--> [355](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/json/decoder.py:355) raise JSONDecodeError("Expecting value", s, err.value) from None
[356](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/json/decoder.py:356) return obj, end
JSONDecodeError: Expecting value: line 1 column 1 (char 0)
During handling of the above exception, another exception occurred:
JSONDecodeError Traceback (most recent call last)
[c:\Users\Nissim\Documents\GitHub\HotspotStoplight\flood_mapping\flood_extents.ipynb](file:///C:/Users/Nissim/Documents/GitHub/HotspotStoplight/flood_mapping/flood_extents.ipynb) Cell 14 line 2
[1](vscode-notebook-cell:/c%3A/Users/Nissim/Documents/GitHub/HotspotStoplight/flood_mapping/flood_extents.ipynb#X12sZmlsZQ%3D%3D?line=0) filename = 'data/outputs/san_jose_flood_100m_2023_10_05.tif'
----> [2](vscode-notebook-cell:/c%3A/Users/Nissim/Documents/GitHub/HotspotStoplight/flood_mapping/flood_extents.ipynb#X12sZmlsZQ%3D%3D?line=1) geemap.ee_export_image(flooded_100m, filename, scale=scale, crs=crs, region=aoi_geom, file_per_band=False)
File [c:\Users\Nissim\AppData\Local\r-miniconda\envs\geemap\lib\site-packages\geemap\common.py:2374](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/site-packages/geemap/common.py:2374), in ee_export_image(ee_object, filename, scale, crs, crs_transform, region, dimensions, file_per_band, format, unzip, unmask_value, timeout, proxies)
[2372](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/site-packages/geemap/common.py:2372) print("An error occurred while downloading.")
[2373](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/site-packages/geemap/common.py:2373) if r is not None:
-> [2374](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/site-packages/geemap/common.py:2374) print(r.json()["error"]["message"])
[2375](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/site-packages/geemap/common.py:2375) return
[2377](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/site-packages/geemap/common.py:2377) try:
File [c:\Users\Nissim\AppData\Local\r-miniconda\envs\geemap\lib\site-packages\requests\models.py:975](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/site-packages/requests/models.py:975), in Response.json(self, **kwargs)
[971](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/site-packages/requests/models.py:971) return complexjson.loads(self.text, **kwargs)
[972](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/site-packages/requests/models.py:972) except JSONDecodeError as e:
[973](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/site-packages/requests/models.py:973) # Catch JSON-related errors and raise as requests.JSONDecodeError
[974](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/site-packages/requests/models.py:974) # This aliases json.JSONDecodeError and simplejson.JSONDecodeError
--> [975](file:///C:/Users/Nissim/AppData/Local/r-miniconda/envs/geemap/lib/site-packages/requests/models.py:975) raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
JSONDecodeError: Expecting value: line 1 column 1 (char 0)
What I Did
Here's my best attempt at a reprex:
import os
import json
import ee
import geemap
from geemap import geojson_to_ee, ee_to_geojson
from ipyleaflet import GeoJSON
file_path = os.path.abspath("data/resourceshedbb_CostaRica_SanJose.geojson")
with open(file_path) as f:
json_data = json.load(f)
bbox_geojson = geojson_to_ee(json_data) # need as a feature collection, not bounding box
aoi = bbox_geojson
aoi_geom = aoi.geometry().bounds()
## set time frame
before_start= '2023-09-25'
before_end='2023-10-05'
after_start='2023-10-05'
after_end='2023-10-15'
# SET SAR PARAMETERS (can be left default)
polarization = "VH" # or "VV"
pass_direction = "DESCENDING" # or "ASCENDING"
difference_threshold = 1.25
# Load and filter Sentinel-1 GRD data by predefined parameters
collection = ee.ImageCollection('COPERNICUS/S1_GRD') \
.filter(ee.Filter.eq('instrumentMode', 'IW')) \
.filter(ee.Filter.listContains('transmitterReceiverPolarisation', polarization)) \
.filter(ee.Filter.eq('orbitProperties_pass', pass_direction)) \
.filter(ee.Filter.eq('resolution_meters', 10)) \
.filterBounds(aoi) \
.select(polarization)
# Select images by predefined dates
before_collection = collection.filterDate(before_start, before_end)
after_collection = collection.filterDate(after_start, after_end)
# Create a mosaic of selected tiles and clip to the study area
before = before_collection.mosaic().clip(aoi)
after = after_collection.mosaic().clip(aoi)
# Apply radar speckle reduction by smoothing
smoothing_radius = 50
before_filtered = before.focal_mean(smoothing_radius, 'circle', 'meters')
after_filtered = after.focal_mean(smoothing_radius, 'circle', 'meters')
# Calculate the difference between the before and after images
difference = after_filtered.divide(before_filtered)
# Apply the predefined difference-threshold and create the flood extent mask
threshold = difference_threshold
difference_binary = difference.gt(threshold)
# Refine the flood result using additional datasets
swater = ee.Image('JRC/GSW1_0/GlobalSurfaceWater').select('seasonality')
swater_mask = swater.gte(10).updateMask(swater.gte(10))
flooded_mask = difference_binary.where(swater_mask, 0)
flooded = flooded_mask.updateMask(flooded_mask)
connections = flooded.connectedPixelCount()
flooded = flooded.updateMask(connections.gte(8))
# Mask out areas with more than 5 percent slope using a Digital Elevation Model
DEM = ee.Image('WWF/HydroSHEDS/03VFDEM')
terrain = ee.Algorithms.Terrain(DEM)
slope = terrain.select('slope')
flooded = flooded.updateMask(slope.lt(5))
flooded = flooded.setDefaultProjection(crs=crs, scale=scale)
crs = flooded.projection().crs()
scale = 100 # 100m resolution
def reduce_resolution(image, reducer, scale):
return image.reduceResolution(reducer=reducer, maxPixels=1024) \
.reproject(crs=crs, scale=scale)
flooded_100m = reduce_resolution(flooded, ee.Reducer.mode(), scale)
filename = 'data/outputs/san_jose_flood_100m_2023_10_05.tif'
geemap.ee_export_image(flooded_100m, filename, scale=scale, crs=crs, region=aoi_geom, file_per_band=False)
nlebovits commented
I'm an idiot--the subdirectory just didn't exist.