Anthro failing while digitizing roads

[philipbaileynar]

Lots of anthro projects are failing while digitizing roads. Here's the end of the log file for one example for HUC 0403011003:

[debug] [intersect_geometry_with_feature_class] Intersection with feature class: Performing unary union on input: /usr/local/data/output/anthro/inputs/inputs.gpkg/roads
        PROGRESS: 1 / 722  (0%)  Unary Unioning features     (Ellapsed: 0.0 seconds)
[info] [Unary Unioning features] Completed 722 operations.  Total Time: 0.0 seconds     
[debug] [get_geometry_unary_union] finished iterating with list of size: 223
[debug] [get_geometry_unary_union] Starting final union of geom_list of size: 223
[debug] [get_geometry_unary_union] Byte Size of output object: 162.6KB Type: MultiLineString IsValid: True Length: 5.145722961952307 Area: 0.0
[debug] [get_geometry_unary_union] Complete
[debug] [intersect_geometry_with_feature_class] Finding intersections (may take a few minutes)...
[debug] [intersect_geometry_with_feature_class] Intersection done in 0.4 seconds
[debug] [VectorBase] No layer named "road_valleybottom" found
        PROGRESS: 1 / 836  (0%)  Unary Unioning features     (Ellapsed: 0.0 seconds)
[info] [Unary Unioning features] Completed 836 operations.  Total Time: 1.0 seconds     
[debug] [get_geometry_unary_union] finished iterating with list of size: 337
[debug] [get_geometry_unary_union] Starting final union of geom_list of size: 337
[debug] [get_geometry_unary_union] Byte Size of output object: 2.3MB Type: MultiPolygon IsValid: True Length: 19.895177249851443 Area: 0.03164908078355308
[debug] [get_geometry_unary_union] Complete
[debug] [intersect_geometry_with_feature_class] Intersection with feature class: Performing unary union on input: /usr/local/data/output/anthro/inputs/inputs.gpkg/rails
        PROGRESS: 1 / 39  (2%)  Unary Unioning features     (Ellapsed: 0.0 seconds)
[info] [Unary Unioning features] Completed 39 operations.  Total Time: 0.0 seconds     
[debug] [get_geometry_unary_union] finished iterating with list of size: 39
[debug] [get_geometry_unary_union] Starting final union of geom_list of size: 39
[debug] [get_geometry_unary_union] Byte Size of output object: 8.1KB Type: MultiLineString IsValid: True Length: 0.8988206077537878 Area: 0.0
[debug] [get_geometry_unary_union] Complete
[debug] [intersect_geometry_with_feature_class] Finding intersections (may take a few minutes)...
[debug] [intersect_geometry_with_feature_class] Intersection done in 0.4 seconds
[debug] [VectorBase] No layer named "rail_valleybottom" found
[debug] [VectorBase] No layer named "private_land" found
        PROGRESS: 1 / 32  (3%)  Copying features     (Ellapsed: 0.0 seconds)
[info] [Copying features] Completed 32 operations.  Total Time: 0.0 seconds     
        PROGRESS: 1 / 2,007  (0%)  Loading features     (Ellapsed: 0.0 seconds)
[info] [Loading features] Completed 2,007 operations.  Total Time: 0.0 seconds     
[info] [VectorBase] 30m distance converts to 0.0003130101 using UTM EPSG 26916
[info] [VectorBase] 5m distance converts to 0.0000521684 using UTM EPSG 26916
[info] [MakeDir] Folder not found. Creating: /usr/local/data/output/anthro/intermediates/tmp_conflict
[info] [Conflict] Rasterizing 2,007 features at 5m cell size for generating iPC_RoadVB field using Mean distance.
        PROGRESS: 0 / 100  (0%)  Rasterizing      (Ellapsed: 0.0 seconds)
/usr/local/src/riverscapes-tools/scripts/automation/FargateAnthro.sh: line 78:   127 Killed                  anthro $HUC $RS_CONTEXT_DIR/vegetation/existing_veg.tif $RS_CONTEXT_DIR/topography/dem_hillshade.tif $VBET_DIR/outputs/vbet.gpkg/vbet_igos $VBET_DIR/intermediates/vbet_intermediates.gpkg/vbet_dgos $RS_CONTEXT_DIR/hydrology/hydro_derivatives.gpkg/network_segmented $VBET_DIR/outputs/vbet.gpkg/vbet_full $RS_CONTEXT_DIR/ownership/ownership.shp $RS_CONTEXT_DIR/transportation/canals.shp $RS_CONTEXT_DIR/transportation/roads.shp $RS_CONTEXT_DIR/transportation/railways.shp $ANTHRO_DIR --meta "Runner=Cybercastor" --verbose --canal_codes 33600,33601,33603
<<ANTHRO PROCESS ENDED WITH AN ERROR>>

[philipbaileynar]

Pretty sure this is a memory issue. The NumPy array required for the Euclidean distance is just crashing the machine. I coded a "raster windowing" fix last week before I realized that windowing can't be used with Euclidean distance.

@KellyMWhitehead can you try running this HUC (0403011003) in Cyber Castor with more system resources to see if it passes?