fimeval 0.1.52__tar.gz → 0.1.53__tar.gz

fimeval-0.1.52/README.md → fimeval-0.1.53/PKG-INFO

@@ -1,3 +1,30 @@
+Metadata-Version: 2.4
+Name: fimeval
+Version: 0.1.53
+Summary: A Framework for Automatic Evaluation of Flood Inundation Mapping Predictions Evaluation
+Author: Surface Dynamics Modeling Lab
+Author-email: Supath Dhital <sdhital@crimson.ua.edu>, Dipshika Devi <ddevi@ua.edu>
+Maintainer-email: Supath Dhital <sdhital@crimson.ua.edu>, Dipshika Devi <ddevi@ua.edu>
+Requires-Python: >=3.10
+Description-Content-Type: text/markdown
+License-File: LICENSE.txt
+Requires-Dist: rasterio<2.0.0,>=1.4.2
+Requires-Dist: numpy>=2
+Requires-Dist: geopandas<2.0.0,>=1.0.1
+Requires-Dist: shapely<3.0.0,>=2.0.6
+Requires-Dist: matplotlib<4.0.0,>=3.9.2
+Requires-Dist: plotly<6.0.0,>=5.24.1
+Requires-Dist: kaleido==0.2.1
+Requires-Dist: nbformat<6.0.0,>=5.10.4
+Requires-Dist: pyproj<4.0.0,>=3.7.0
+Requires-Dist: notebook<8.0.0,>=7.3.2
+Requires-Dist: boto3<2.0.0,>=1.36.16
+Requires-Dist: geemap
+Provides-Extra: dev
+Requires-Dist: pytest; extra == "dev"
+Requires-Dist: black; extra == "dev"
+Dynamic: license-file
+
 ## Flood Inundation Mapping Predictions Evaluation Framework (FIMeval)
 <hr style="border: 1px solid black; margin: 0;">  
 
@@ -34,6 +61,7 @@ fimeval/
 ├── src/
 │   └── fimeval/         
 │       ├──BuildingFootprint/ # Contains the evaluation of model predicted FIM with microsoft building footprint
+│       │   └── microsoftBF.py 
 │       │   └── evaluationwithBF.py       
 │       └── ContingencyMap/      # Contains all the metrics calculation and contingency map generation
 │       │   ├── evaluationFIM.py # main evaluation moodule 
@@ -59,7 +87,8 @@ This framework is published as a python package in PyPI (https://pypi.org/projec
 
 ```bash
 #Install to use this framework
-pip install fimeval
+pip install uv #Makes the downloading much faster
+uv pip install fimeval
 
 #Use this framework in your workflows using poetry
 poetry add fimeval
@@ -132,7 +161,7 @@ Table 1: Modules in `fimeval` are in order of execution.
 | `EvaluateFIM` | It runs all the evaluation of FIM between B-FIM and M-FIMs. | `main_dir`: Main directory containing the case study folders, <br> `method_name`: How users wants to evaluate their FIM, <br> `outpur_dir`: Output directory where all the results and the intermidiate files will be saved for further calculation, <br>  *`PWB_dir`*: The permanenet water bodies vectory file directory if user wants to user their own boundary, <br> *`target_crs`*: this fimeval framework needs the floodmaps to be in projected CRS so define the projected CRS in epsg code format, <br> *`target_resolution`*: sometime if the benchmark is very high resolution than candidate FIMs, it needs heavy computational time, so user can define the resolution if there FIMs are in different spatial resolution, else it will use the coarser resolution among all FIMS within that case. |The outputs includes generated files in TIFF, SHP, CSV, and PNG formats, all stored within the output folder. Users can visualize the TIFF files using any geospatial platform. The TIFF files consist of the binary Benchmark-FIM (Benchmark.tif), Model-FIM (Candidate.tif), and Agreement-FIM (Contingency.tif). The shp files contain the boundary of the generated flood extent.|
 | `PlotContingencyMap` | For better understanding, It will print the agreement maps derived in first step. | `main_dir`, `method_name`, `output_dir` : Based on the those arguments, once all the evaluation is done, it will dynamically get the corresponding contingency raster for printing.| This prints the contingency map showing different class of evaluation (TP, FP, no data, PWB etc). The outputs look like- Figure 4 first row.|
 | `PlotEvaluationMetrics` | For quick understanding of the evaluation metrics, to plot bar of evaluation scores. | `main_dir`, `method_name`, `output_dir` : Based on the those arguments, once all the evaluation is done, it will dynamically get the corresponding file for printing based on all those info.| This prints the bar plots which includes different performance metrics calculated by EvaluateFIM module. The outputs look like- Figure 4 second row.|
-| `EvaluationWithBuildingFootprint` | For Building Footprint Analysis, user can specify shapefile of building footprints as .shp or .gpkg format. By default it consider global Microsoft building footprint dataset. Those data are hosted in Google Earth Engine (GEE) so, It pops up to authenticate the GEE account, please allow it and it will download the data based on evaluation boundary and evaluation is done. | `main_dir`, `method_name`, `output_dir`: Those arguments are as it is, same as all other modules. <br> *`building_footprint`*: If user wants to use their own building footprint file then pass the directory here, *`country`*: It is the 3 letter based country ISO code (eg. 'USA', NEP' etc), for the building data automation using GEE based on the evaluation extent, *`shapefile_dir`*: this is the directory of user defined AOI if user is working with their own boundary and automatic Building footprint download and evaluation. | It will calculate the different metrics (e.g. TP, FP, CSI, F1, Accuracy etc) based on hit and miss of building on different M-FIM and B-FIM. Those all metrics will be saved as CSV format in `output_dir` and finally using that info it prints the counts of building foorpint in each FIMs as well as scenario on the evaluation end via bar plot.|
+| `EvaluationWithBuildingFootprint` | For Building Footprint Analysis, user can specify shapefile of building footprints as .shp or .gpkg format. By default it consider global Microsoft building footprint dataset. Those data are hosted in Google Earth Engine (GEE) so, It pops up to authenticate the GEE account, please allow it and it will download the data based on evaluation boundary and evaluation is done. | `main_dir`, `method_name`, `output_dir`: Those arguments are as it is, same as all other modules. <br> *`building_footprint`*: If user wants to use their own building footprint file then pass the directory here, *`country`*: It is the 3 letter based country ISO code (eg. 'USA', NEP' etc), for the building data automation using GEE based on the evaluation extent, *`shapefile_dir`*: this is the directory of user defined AOI if user is working with their own boundary and automatic Building footprint download and evaluation, *`geeprojectID`*: this is the google earth engine google cloud project ID, which helps to access the GEE data and resources to work with building footprint download and process. | It will calculate the different metrics (e.g. TP, FP, CSI, F1, Accuracy etc) based on hit and miss of building on different M-FIM and B-FIM. Those all metrics will be saved as CSV format in `output_dir` and finally using that info it prints the counts of building foorpint in each FIMs as well as scenario on the evaluation end via bar plot.|
 
 <p align="center">
   <img src="./Images/methodsresults_combined.jpg" width="750" />
@@ -140,6 +169,58 @@ Table 1: Modules in `fimeval` are in order of execution.
 
 Figure 4: Combined raw output from framework for different two method. First row (subplot a and b) and second row (subplot c and d) is contingency maps and evaluation metrics of FIM derived using `PrintContingencyMaP` and `PlotEvaluationMetrics` module. Third row (subplot e and f) is the output after processing and calculating of evaluation with BF by unsing `EvaluateWithBuildingFoorprint` module.
 
+## Installation Instructions
+
+### 1. Prerequisites
+
+Before installing `fimeval`, ensure the following software are installed:
+
+- **Python**: Version 3.10 or higher  
+- **Anaconda**: For managing environments and dependencies  
+- **GIS Software**: For Visulalisation
+  - [ArcGIS](https://www.esri.com/en-us/arcgis/products/index) or [QGIS](https://qgis.org/en/site/)
+- **Optional**:
+  - [Google Earth Engine](https://earthengine.google.com/) account
+  - Java Runtime Environment (for using GEE API)
+
+---
+
+### 2. Install Anaconda
+
+If Anaconda is not installed, download and install it from the [official website](https://www.anaconda.com/products/distribution).
+
+---
+
+### 3. Set Up Virtual Environment
+
+#### For Mac Users
+
+Open **Terminal** and run:
+```bash
+# Create a new environment named 'fimeval'
+conda create --name fimeval python=3.10
+
+# Activate the environment
+conda activate fimeval
+
+# Install fimeval package
+pip install uv
+uv pip install fimeval
+```
+
+### Google Colab Version
+
+To use fimeval in Google Colab, follow the steps below:
+
+## Upload Files
+Upload all necessary input files (e.g., raster, shapefiles, model outputs) to your Google Drive.
+## Open Google Colab
+Go to Google Colab and sign in with a valid Google account.
+## Mount Google Drive
+In a new Colab notebook, mount the  Google Drive
+```bash
+pip install fimeval
+```
 ### **Acknowledgements**
 | | |
 | --- | --- |

fimeval-0.1.52/PKG-INFO → fimeval-0.1.53/README.md

@@ -1,34 +1,3 @@
-Metadata-Version: 2.1
-Name: fimeval
-Version: 0.1.52
-Summary: A Framework for Automatic Evaluation of Flood Inundation Mapping Predictions Evaluation
-License: GPLv3
-Author: Surface Dynamics Modeling Lab
-Maintainer: Supath Dhital
-Maintainer-email: sdhital@crimson.ua.edu
-Requires-Python: >=3.10,<4.0
-Classifier: License :: Other/Proprietary License
-Classifier: Programming Language :: Python :: 3
-Classifier: Programming Language :: Python :: 3.10
-Classifier: Programming Language :: Python :: 3.11
-Classifier: Programming Language :: Python :: 3.12
-Classifier: Programming Language :: Python :: 3.13
-Requires-Dist: boto3 (>=1.36.16,<2.0.0)
-Requires-Dist: geopandas (>=1.0.1,<2.0.0)
-Requires-Dist: kaleido (==0.2.1)
-Requires-Dist: matplotlib (>=3.9.2,<4.0.0)
-Requires-Dist: msfootprint (>=0.1.27,<0.2.0)
-Requires-Dist: nbformat (>=5.10.4,<6.0.0)
-Requires-Dist: notebook (>=7.3.2,<8.0.0)
-Requires-Dist: numpy (<2)
-Requires-Dist: pathlib (>=1.0.1,<2.0.0)
-Requires-Dist: plotly (>=5.24.1,<6.0.0)
-Requires-Dist: pyproj (>=3.7.0,<4.0.0)
-Requires-Dist: pytest (>=8.3.3,<9.0.0)
-Requires-Dist: rasterio (>=1.4.2,<2.0.0)
-Requires-Dist: shapely (>=2.0.6,<3.0.0)
-Description-Content-Type: text/markdown
-
 ## Flood Inundation Mapping Predictions Evaluation Framework (FIMeval)
 <hr style="border: 1px solid black; margin: 0;">  
 
@@ -65,6 +34,7 @@ fimeval/
 ├── src/
 │   └── fimeval/         
 │       ├──BuildingFootprint/ # Contains the evaluation of model predicted FIM with microsoft building footprint
+│       │   └── microsoftBF.py 
 │       │   └── evaluationwithBF.py       
 │       └── ContingencyMap/      # Contains all the metrics calculation and contingency map generation
 │       │   ├── evaluationFIM.py # main evaluation moodule 
@@ -90,7 +60,8 @@ This framework is published as a python package in PyPI (https://pypi.org/projec
 
 ```bash
 #Install to use this framework
-pip install fimeval
+pip install uv #Makes the downloading much faster
+uv pip install fimeval
 
 #Use this framework in your workflows using poetry
 poetry add fimeval
@@ -163,7 +134,7 @@ Table 1: Modules in `fimeval` are in order of execution.
 | `EvaluateFIM` | It runs all the evaluation of FIM between B-FIM and M-FIMs. | `main_dir`: Main directory containing the case study folders, <br> `method_name`: How users wants to evaluate their FIM, <br> `outpur_dir`: Output directory where all the results and the intermidiate files will be saved for further calculation, <br>  *`PWB_dir`*: The permanenet water bodies vectory file directory if user wants to user their own boundary, <br> *`target_crs`*: this fimeval framework needs the floodmaps to be in projected CRS so define the projected CRS in epsg code format, <br> *`target_resolution`*: sometime if the benchmark is very high resolution than candidate FIMs, it needs heavy computational time, so user can define the resolution if there FIMs are in different spatial resolution, else it will use the coarser resolution among all FIMS within that case. |The outputs includes generated files in TIFF, SHP, CSV, and PNG formats, all stored within the output folder. Users can visualize the TIFF files using any geospatial platform. The TIFF files consist of the binary Benchmark-FIM (Benchmark.tif), Model-FIM (Candidate.tif), and Agreement-FIM (Contingency.tif). The shp files contain the boundary of the generated flood extent.|
 | `PlotContingencyMap` | For better understanding, It will print the agreement maps derived in first step. | `main_dir`, `method_name`, `output_dir` : Based on the those arguments, once all the evaluation is done, it will dynamically get the corresponding contingency raster for printing.| This prints the contingency map showing different class of evaluation (TP, FP, no data, PWB etc). The outputs look like- Figure 4 first row.|
 | `PlotEvaluationMetrics` | For quick understanding of the evaluation metrics, to plot bar of evaluation scores. | `main_dir`, `method_name`, `output_dir` : Based on the those arguments, once all the evaluation is done, it will dynamically get the corresponding file for printing based on all those info.| This prints the bar plots which includes different performance metrics calculated by EvaluateFIM module. The outputs look like- Figure 4 second row.|
-| `EvaluationWithBuildingFootprint` | For Building Footprint Analysis, user can specify shapefile of building footprints as .shp or .gpkg format. By default it consider global Microsoft building footprint dataset. Those data are hosted in Google Earth Engine (GEE) so, It pops up to authenticate the GEE account, please allow it and it will download the data based on evaluation boundary and evaluation is done. | `main_dir`, `method_name`, `output_dir`: Those arguments are as it is, same as all other modules. <br> *`building_footprint`*: If user wants to use their own building footprint file then pass the directory here, *`country`*: It is the 3 letter based country ISO code (eg. 'USA', NEP' etc), for the building data automation using GEE based on the evaluation extent, *`shapefile_dir`*: this is the directory of user defined AOI if user is working with their own boundary and automatic Building footprint download and evaluation. | It will calculate the different metrics (e.g. TP, FP, CSI, F1, Accuracy etc) based on hit and miss of building on different M-FIM and B-FIM. Those all metrics will be saved as CSV format in `output_dir` and finally using that info it prints the counts of building foorpint in each FIMs as well as scenario on the evaluation end via bar plot.|
+| `EvaluationWithBuildingFootprint` | For Building Footprint Analysis, user can specify shapefile of building footprints as .shp or .gpkg format. By default it consider global Microsoft building footprint dataset. Those data are hosted in Google Earth Engine (GEE) so, It pops up to authenticate the GEE account, please allow it and it will download the data based on evaluation boundary and evaluation is done. | `main_dir`, `method_name`, `output_dir`: Those arguments are as it is, same as all other modules. <br> *`building_footprint`*: If user wants to use their own building footprint file then pass the directory here, *`country`*: It is the 3 letter based country ISO code (eg. 'USA', NEP' etc), for the building data automation using GEE based on the evaluation extent, *`shapefile_dir`*: this is the directory of user defined AOI if user is working with their own boundary and automatic Building footprint download and evaluation, *`geeprojectID`*: this is the google earth engine google cloud project ID, which helps to access the GEE data and resources to work with building footprint download and process. | It will calculate the different metrics (e.g. TP, FP, CSI, F1, Accuracy etc) based on hit and miss of building on different M-FIM and B-FIM. Those all metrics will be saved as CSV format in `output_dir` and finally using that info it prints the counts of building foorpint in each FIMs as well as scenario on the evaluation end via bar plot.|
 
 <p align="center">
   <img src="./Images/methodsresults_combined.jpg" width="750" />
@@ -171,6 +142,58 @@ Table 1: Modules in `fimeval` are in order of execution.
 
 Figure 4: Combined raw output from framework for different two method. First row (subplot a and b) and second row (subplot c and d) is contingency maps and evaluation metrics of FIM derived using `PrintContingencyMaP` and `PlotEvaluationMetrics` module. Third row (subplot e and f) is the output after processing and calculating of evaluation with BF by unsing `EvaluateWithBuildingFoorprint` module.
 
+## Installation Instructions
+
+### 1. Prerequisites
+
+Before installing `fimeval`, ensure the following software are installed:
+
+- **Python**: Version 3.10 or higher  
+- **Anaconda**: For managing environments and dependencies  
+- **GIS Software**: For Visulalisation
+  - [ArcGIS](https://www.esri.com/en-us/arcgis/products/index) or [QGIS](https://qgis.org/en/site/)
+- **Optional**:
+  - [Google Earth Engine](https://earthengine.google.com/) account
+  - Java Runtime Environment (for using GEE API)
+
+---
+
+### 2. Install Anaconda
+
+If Anaconda is not installed, download and install it from the [official website](https://www.anaconda.com/products/distribution).
+
+---
+
+### 3. Set Up Virtual Environment
+
+#### For Mac Users
+
+Open **Terminal** and run:
+```bash
+# Create a new environment named 'fimeval'
+conda create --name fimeval python=3.10
+
+# Activate the environment
+conda activate fimeval
+
+# Install fimeval package
+pip install uv
+uv pip install fimeval
+```
+
+### Google Colab Version
+
+To use fimeval in Google Colab, follow the steps below:
+
+## Upload Files
+Upload all necessary input files (e.g., raster, shapefiles, model outputs) to your Google Drive.
+## Open Google Colab
+Go to Google Colab and sign in with a valid Google account.
+## Mount Google Drive
+In a new Colab notebook, mount the  Google Drive
+```bash
+pip install fimeval
+```
 ### **Acknowledgements**
 | | |
 | --- | --- |
@@ -181,4 +204,3 @@ Contact <a href="https://geography.ua.edu/people/sagy-cohen/" target="_blank">Sa
  (sagy.cohen@ua.edu)
  Dipsikha Devi, (ddevi@ua.edu)
 Supath Dhital, (sdhital@crimson.ua.edu)
-

fimeval-0.1.53/pyproject.toml

@@ -0,0 +1,49 @@
+[project]
+name = "fimeval"
+version = "0.1.53"
+description = "A Framework for Automatic Evaluation of Flood Inundation Mapping Predictions Evaluation"
+readme = "README.md"
+requires-python = ">=3.10"
+license = { file = "LICENSE" }
+
+authors = [
+  { name = "Surface Dynamics Modeling Lab" },
+  { name = "Supath Dhital", email = "sdhital@crimson.ua.edu" },
+  { name = "Dipshika Devi", email = "ddevi@ua.edu" }
+]
+
+maintainers = [
+  { name = "Supath Dhital", email = "sdhital@crimson.ua.edu" },
+  { name = "Dipshika Devi", email = "ddevi@ua.edu" }
+]
+
+dependencies = [
+  "rasterio>=1.4.2,<2.0.0",
+  "numpy>=2",
+  "geopandas>=1.0.1,<2.0.0",
+  "shapely>=2.0.6,<3.0.0",
+  "matplotlib>=3.9.2,<4.0.0",
+  "plotly>=5.24.1,<6.0.0",
+  "kaleido==0.2.1",
+  "nbformat>=5.10.4,<6.0.0",
+  "pyproj>=3.7.0,<4.0.0",
+  "notebook>=7.3.2,<8.0.0",
+  "boto3>=1.36.16,<2.0.0",
+  "geemap"
+]
+
+[project.optional-dependencies]
+dev = [
+  "pytest",
+  "black"
+]
+
+[tool.setuptools]
+package-dir = { "" = "src" }
+
+[tool.setuptools.packages.find]
+where = ["src"]
+
+[build-system]
+requires = ["setuptools>=61.0"]
+build-backend = "setuptools.build_meta"

fimeval-0.1.53/setup.cfg

@@ -0,0 +1,4 @@
+[egg_info]
+tag_build = 
+tag_date = 0
+

{fimeval-0.1.52 → fimeval-0.1.53}/src/fimeval/BuildingFootprint/evaluationwithBF.py

@@ -1,5 +1,4 @@
 import os
-import ee
 import glob
 import geopandas as gpd
 import rasterio
@@ -21,6 +20,7 @@ def Changeintogpkg(input_path, output_dir, layer_name):
         gdf.to_file(output_gpkg, driver="GPKG")
         return output_gpkg
 
+
 def GetFloodedBuildingCountInfo(
     building_fp_path,
     study_area_path,
@@ -85,7 +85,7 @@ def GetFloodedBuildingCountInfo(
     if "bm" in str(raster1_path).lower():
         count_centroids_in_raster(raster1_path, "Benchmark")
         count_centroids_in_raster(raster2_path, "Candidate")
-        
+
     elif "candidate" in str(raster2_path).lower():
         count_centroids_in_raster(raster1_path, "Candidate")
         count_centroids_in_raster(raster2_path, "Benchmark")
@@ -106,9 +106,10 @@ def GetFloodedBuildingCountInfo(
     CSI = TP / (TP + FP + FN) if (TP + FP + FN) > 0 else 0
     FAR = FP / (TP + FP) if (TP + FP) > 0 else 0
     POD = TP / (TP + FN) if (TP + FN) > 0 else 0
-    
-    
-    BDR = (centroid_counts["Candidate"]- centroid_counts["Benchmark"])/centroid_counts["Benchmark"]
+
+    BDR = (
+        centroid_counts["Candidate"] - centroid_counts["Benchmark"]
+    ) / centroid_counts["Benchmark"]
 
     counts_data = {
         "Category": [
@@ -223,6 +224,7 @@ def GetFloodedBuildingCountInfo(
     print(f"Performance metrics chart is saved as PNG at {output_path}")
     fig.show()
 
+
 def process_TIFF(
     tif_files, contingency_files, building_footprint, boundary, method_path
 ):
@@ -266,22 +268,46 @@ def process_TIFF(
         print("Warning: No benchmark file found.")
     elif not candidate_paths:
         print("Warning: No candidate files found.")
-        
+
+
 def find_existing_footprint(out_dir):
     gpkg_files = list(Path(out_dir).glob("*.gpkg"))
     return gpkg_files[0] if gpkg_files else None
 
-#Incase user defined individual shapefile for each case study
+
+# Incase user defined individual shapefile for each case study
 def detect_shapefile(folder):
-        shapefile = None
-        for ext in (".shp", ".gpkg", ".geojson", ".kml"):
-            for file in os.listdir(folder):
-                if file.lower().endswith(ext):
-                    shapefile = os.path.join(folder, file)
-                    print(f"Auto-detected shapefile: {shapefile}")
-                    return shapefile
-        return None
-    
+    shapefile = None
+    for ext in (".shp", ".gpkg", ".geojson", ".kml"):
+        for file in os.listdir(folder):
+            if file.lower().endswith(ext):
+                shapefile = os.path.join(folder, file)
+                print(f"Auto-detected shapefile: {shapefile}")
+                return shapefile
+    return None
+
+
+def ensure_pyspark(version: str | None = "3.5.4") -> None:
+    """Install pyspark at runtime via `uv pip` into this env (no-op if present)."""
+    import importlib, shutil, subprocess, sys, re
+    try:
+        import importlib.util
+        if importlib.util.find_spec("pyspark"):
+            return
+    except Exception:
+        pass
+    uv = shutil.which("uv")
+    if not uv:
+        raise RuntimeError("`uv` not found on PATH. Please install uv or add it to PATH.")
+    if version is None:
+        spec = "pyspark"
+    else:
+        v = version.strip()
+        spec = f"pyspark{v}" if re.match(r"^[<>=!~]", v) else f"pyspark=={v}"
+    subprocess.check_call([uv, "pip", "install", "--python", sys.executable, spec])
+
+
+
 def EvaluationWithBuildingFootprint(
     main_dir,
     method_name,
@@ -289,6 +315,7 @@ def EvaluationWithBuildingFootprint(
     country=None,
     building_footprint=None,
     shapefile_dir=None,
+    geeprojectID=None,
 ):
     tif_files_main = glob.glob(os.path.join(main_dir, "*.tif"))
     if tif_files_main:
@@ -303,9 +330,7 @@ def EvaluationWithBuildingFootprint(
 
                 if shapefile_dir:
                     boundary = shapefile_dir
-                elif os.path.exists(
-                    os.path.join(method_path, "BoundaryforEvaluation")
-                ):
+                elif os.path.exists(os.path.join(method_path, "BoundaryforEvaluation")):
                     boundary = os.path.join(
                         method_path, "BoundaryforEvaluation", "FIMEvaluatedExtent.shp"
                     )
@@ -313,9 +338,11 @@ def EvaluationWithBuildingFootprint(
                     boundary = detect_shapefile(main_dir)
 
                 building_footprintMS = building_footprint
+                
                 if building_footprintMS is None:
-                    import msfootprint as msf
-
+                    ensure_pyspark()
+                    from .microsoftBF import BuildingFootprintwithISO
+                    
                     out_dir = os.path.join(method_path, "BuildingFootprint")
                     if not os.path.exists(out_dir):
                         os.makedirs(out_dir)
@@ -323,7 +350,15 @@ def EvaluationWithBuildingFootprint(
                     if not EX_building_footprint:
                         boundary_dir = shapefile_dir if shapefile_dir else boundary
 
-                        msf.BuildingFootprintwithISO(country, boundary_dir, out_dir)
+                        if geeprojectID:
+                            BuildingFootprintwithISO(
+                                country,
+                                boundary_dir,
+                                out_dir,
+                                geeprojectID=geeprojectID,
+                            )
+                        else:
+                            BuildingFootprintwithISO(country, boundary_dir, out_dir)
                         building_footprintMS = os.path.join(
                             out_dir, f"building_footprint.gpkg"
                         )
@@ -355,15 +390,19 @@ def EvaluationWithBuildingFootprint(
                             os.path.join(method_path, "BoundaryforEvaluation")
                         ):
                             boundary = os.path.join(
-                                method_path, "BoundaryforEvaluation", "FIMEvaluatedExtent.shp"
+                                method_path,
+                                "BoundaryforEvaluation",
+                                "FIMEvaluatedExtent.shp",
                             )
                         else:
                             boundary = detect_shapefile(os.path.join(main_dir, folder))
 
                         building_footprintMS = building_footprint
+                        
                         if building_footprintMS is None:
-                            import msfootprint as msf
-
+                            ensure_pyspark()
+                            from .microsoftBF import BuildingFootprintwithISO
+                            
                             out_dir = os.path.join(method_path, "BuildingFootprint")
                             if not os.path.exists(out_dir):
                                 os.makedirs(out_dir)
@@ -372,9 +411,17 @@ def EvaluationWithBuildingFootprint(
                                 boundary_dir = (
                                     shapefile_dir if shapefile_dir else boundary
                                 )
-                                msf.BuildingFootprintwithISO(
-                                    country, boundary_dir, out_dir
-                                )
+                                if geeprojectID:
+                                    BuildingFootprintwithISO(
+                                        country,
+                                        boundary_dir,
+                                        out_dir,
+                                        geeprojectID=geeprojectID,
+                                    )
+                                else:
+                                    BuildingFootprintwithISO(
+                                        country, boundary_dir, out_dir
+                                    )
                                 building_footprintMS = os.path.join(
                                     out_dir, f"building_footprint.gpkg"
                                 )

fimeval-0.1.53/src/fimeval/BuildingFootprint/microsoftBF.py

@@ -0,0 +1,131 @@
+# Importing necessary libraries
+import geemap
+import ee
+import os
+from shapely.geometry import box
+import pandas as pd
+from pathlib import Path
+import geopandas as gpd
+from pyspark.sql import SparkSession
+from shapely.wkt import loads
+import shutil
+
+# Suppress the warnings
+import warnings
+
+warnings.filterwarnings("ignore")
+
+# Authenticate and initialize Earth Engine
+ee.Authenticate()
+
+# %%
+def split_into_tiles(boundary, tile_size=0.1):
+    bounds = boundary.total_bounds
+    x_min, y_min, x_max, y_max = bounds
+    tiles = []
+    x = x_min
+    while x < x_max:
+        y = y_min
+        while y < y_max:
+            tile = box(x, y, x + tile_size, y + tile_size)
+            if tile.intersects(boundary.unary_union):
+                tiles.append(tile)
+            y += tile_size
+        x += tile_size
+    return gpd.GeoDataFrame(geometry=tiles, crs=boundary.crs)
+
+
+# Merge the final geojson files
+def mergeGeoJSONfiles(output_dir, merged_file):
+    output_dir = Path(output_dir)
+    files = list(output_dir.glob("*.geojson"))
+    gdfs = [gpd.read_file(file) for file in files]
+    merged_gdf = gpd.GeoDataFrame(pd.concat(gdfs, ignore_index=True), crs="EPSG:4326")
+    merged_gdf.to_file(merged_file, driver="GPKG")
+
+
+# Process each batch with number of tiles
+def process_batch(partition, collection_name, output_dir, boundary_wkt, projectID=None):
+    try:
+        if projectID:
+            ee.Initialize(project=projectID)
+        else:
+            ee.Initialize()
+
+    except Exception:
+        print("To initialize, please provide the earth engine project ID")
+
+    # Convert WKT boundary to geometry
+    boundary = loads(boundary_wkt)
+    results = []
+
+    for tile_wkt in partition:
+        try:
+            tile = loads(tile_wkt)
+            aoi = ee.Geometry(tile.__geo_interface__)
+            collection = ee.FeatureCollection(collection_name).filterBounds(aoi)
+
+            # Download features and filter by boundary
+            gdf = geemap.ee_to_gdf(collection)
+            gdf = gdf[gdf.geometry.intersects(boundary)]
+
+            # Save each tile as a GeoJSON file
+            tile_id = f"tile_{hash(tile)}"
+            output_file = Path(output_dir) / f"{tile_id}.geojson"
+            gdf.to_file(output_file, driver="GeoJSON")
+            results.append(f"Saved: {output_file}")
+        except Exception as e:
+            results.append(f"Error processing tile: {e}")
+
+    return results
+
+
+def getBuildingFootprintSpark(
+    countryISO, boundary_file, out_dir, tile_size, projectID=None
+):
+    spark = SparkSession.builder.appName("BuildingFootprints").getOrCreate()
+
+    # Make temporary directory
+    temp_dir = out_dir / "temp"
+    temp_dir.mkdir(parents=True, exist_ok=True)
+
+    # Load and process boundary
+    boundary = gpd.read_file(boundary_file).to_crs("EPSG:4326")
+    tiles = split_into_tiles(boundary, tile_size)
+    boundary_wkt = boundary.unary_union.wkt
+
+    collection_names = [f"projects/sat-io/open-datasets/VIDA_COMBINED/{countryISO}"]
+
+    # Distribute processing
+    for collection_name in collection_names:
+        tiles_rdd = spark.sparkContext.parallelize(
+            tiles.geometry.apply(lambda x: x.wkt).tolist(), numSlices=10
+        )
+        results = tiles_rdd.mapPartitions(
+            lambda partition: process_batch(
+                partition, collection_name, str(temp_dir), boundary_wkt, projectID
+            )
+        ).collect()
+
+    # Merge GeoJSON files
+    mergeGeoJSONfiles(temp_dir, out_dir / "building_footprint.gpkg")
+
+    # Clean up the temp directory
+    shutil.rmtree(temp_dir, ignore_errors=True)
+
+    print(f"Building footprint data saved to {out_dir / 'building_footprint.gpkg'}")
+
+
+# %%
+# Export the building footprint
+def BuildingFootprintwithISO(countryISO, ROI, out_dir, geeprojectID=None):
+    out_dir = Path(out_dir)
+    out_dir.mkdir(parents=True, exist_ok=True)
+    filename = out_dir / "building_footprint.gpkg"
+
+    if filename.exists():
+        os.remove(filename)
+
+    getBuildingFootprintSpark(
+        countryISO, ROI, out_dir, tile_size=0.05, projectID=geeprojectID
+    )