active-vision 0.1.1__tar.gz → 0.3.0__tar.gz

{active_vision-0.1.1 → active_vision-0.3.0}/PKG-INFO

@@ -1,7 +1,7 @@
 Metadata-Version: 2.2
 Name: active-vision
-Version: 0.1.1
-Summary: Active learning for edge vision.
+Version: 0.3.0
+Summary: Active learning for computer vision.
 Requires-Python: >=3.10
 Description-Content-Type: text/markdown
 License-File: LICENSE
@@ -17,10 +17,10 @@ Requires-Dist: timm>=1.0.13
 Requires-Dist: transformers>=4.48.0
 Requires-Dist: xinfer>=0.3.2
 
-![Python Version](https://img.shields.io/badge/python-3.10%2B-blue?style=for-the-badge)
-![License](https://img.shields.io/badge/License-Apache%202.0-green.svg?style=for-the-badge)
-[![PyPI](https://img.shields.io/pypi/v/active-vision?style=for-the-badge)](https://pypi.org/project/active-vision/)
-![Downloads](https://img.shields.io/pepy/dt/active-vision?style=for-the-badge&logo=pypi&logoColor=white&label=Downloads&color=purple)   
+[![Python Version](https://img.shields.io/badge/python-3.10%2B-blue?style=for-the-badge&logo=python&logoColor=white)](https://pypi.org/project/active-vision/)
+[![PyPI](https://img.shields.io/pypi/v/active-vision?style=for-the-badge&logo=pypi&logoColor=white)](https://pypi.org/project/active-vision/)
+[![Downloads](https://img.shields.io/pepy/dt/active-vision?style=for-the-badge&logo=pypi&logoColor=white&label=Downloads&color=purple)](https://pypi.org/project/active-vision/)
+[![License](https://img.shields.io/badge/License-Apache%202.0-green.svg?style=for-the-badge&logo=apache&logoColor=white)](https://github.com/dnth/active-vision/blob/main/LICENSE)
 
 <p align="center">
   <img src="https://raw.githubusercontent.com/dnth/active-vision/main/assets/logo.png" alt="active-vision">
@@ -47,13 +47,14 @@ The goal of this project is to create a framework for the active learning loop f
 
 Uncertainty Sampling:
 - [X] Least confidence
-- [ ] Margin of confidence
-- [ ] Ratio of confidence
-- [ ] Entropy
+- [X] Margin of confidence
+- [X] Ratio of confidence
+- [X] Entropy
 
 Diverse Sampling:
 - [X] Random sampling
-- [ ] Model-based outlier
+- [X] Model-based outlier
+- [ ] Embeddings-based outlier
 - [ ] Cluster-based
 - [ ] Representative
 
@@ -172,7 +173,7 @@ The active learning loop is a iterative process and can keep going until you hit
 - You hit a budget.
 - Other criteria.
 
-For this dataset,I decided to stop the active learning loop at 275 labeled images because the performance on the evaluation set is close to the top performing model on the leaderboard. 
+For this dataset, I decided to stop the active learning loop at 275 labeled images because the performance on the evaluation set exceeds the top performing model on the leaderboard. 
 
 
 | #Labeled Images 	| Evaluation Accuracy 	| Train Epochs 	| Model                	| Active Learning 	| Source                                                                              	|

{active_vision-0.1.1 → active_vision-0.3.0}/README.md

@@ -1,7 +1,7 @@
-![Python Version](https://img.shields.io/badge/python-3.10%2B-blue?style=for-the-badge)
-![License](https://img.shields.io/badge/License-Apache%202.0-green.svg?style=for-the-badge)
-[![PyPI](https://img.shields.io/pypi/v/active-vision?style=for-the-badge)](https://pypi.org/project/active-vision/)
-![Downloads](https://img.shields.io/pepy/dt/active-vision?style=for-the-badge&logo=pypi&logoColor=white&label=Downloads&color=purple)   
+[![Python Version](https://img.shields.io/badge/python-3.10%2B-blue?style=for-the-badge&logo=python&logoColor=white)](https://pypi.org/project/active-vision/)
+[![PyPI](https://img.shields.io/pypi/v/active-vision?style=for-the-badge&logo=pypi&logoColor=white)](https://pypi.org/project/active-vision/)
+[![Downloads](https://img.shields.io/pepy/dt/active-vision?style=for-the-badge&logo=pypi&logoColor=white&label=Downloads&color=purple)](https://pypi.org/project/active-vision/)
+[![License](https://img.shields.io/badge/License-Apache%202.0-green.svg?style=for-the-badge&logo=apache&logoColor=white)](https://github.com/dnth/active-vision/blob/main/LICENSE)
 
 <p align="center">
   <img src="https://raw.githubusercontent.com/dnth/active-vision/main/assets/logo.png" alt="active-vision">
@@ -28,13 +28,14 @@ The goal of this project is to create a framework for the active learning loop f
 
 Uncertainty Sampling:
 - [X] Least confidence
-- [ ] Margin of confidence
-- [ ] Ratio of confidence
-- [ ] Entropy
+- [X] Margin of confidence
+- [X] Ratio of confidence
+- [X] Entropy
 
 Diverse Sampling:
 - [X] Random sampling
-- [ ] Model-based outlier
+- [X] Model-based outlier
+- [ ] Embeddings-based outlier
 - [ ] Cluster-based
 - [ ] Representative
 
@@ -153,7 +154,7 @@ The active learning loop is a iterative process and can keep going until you hit
 - You hit a budget.
 - Other criteria.
 
-For this dataset,I decided to stop the active learning loop at 275 labeled images because the performance on the evaluation set is close to the top performing model on the leaderboard. 
+For this dataset, I decided to stop the active learning loop at 275 labeled images because the performance on the evaluation set exceeds the top performing model on the leaderboard. 
 
 
 | #Labeled Images 	| Evaluation Accuracy 	| Train Epochs 	| Model                	| Active Learning 	| Source                                                                              	|

{active_vision-0.1.1 → active_vision-0.3.0}/pyproject.toml

@@ -1,7 +1,7 @@
 [project]
 name = "active-vision"
-version = "0.1.1"
-description = "Active learning for edge vision."
+version = "0.3.0"
+description = "Active learning for computer vision."
 readme = "README.md"
 requires-python = ">=3.10"
 dependencies = [

active_vision-0.3.0/src/active_vision/__init__.py

@@ -0,0 +1,3 @@
+__version__ = "0.3.0"
+
+from .core import *

{active_vision-0.1.1 → active_vision-0.3.0}/src/active_vision/core.py

@@ -2,6 +2,8 @@ import pandas as pd
 from loguru import logger
 from fastai.vision.all import *
 import torch
+import numpy as np
+import bisect
 
 import warnings
 from typing import Callable
@@ -55,7 +57,6 @@ class ActiveLearner:
         learner_path: str = None,
     ):
         logger.info(f"Loading dataset from {filepath_col} and {label_col}")
-        self.train_set = df.copy()
 
         logger.info("Creating dataloaders")
         self.dls = ImageDataLoaders.from_df(
@@ -84,6 +85,8 @@ class ActiveLearner:
                 self.dls, self.model, metrics=accuracy
             ).to_fp16()
 
+        self.train_set = self.learn.dls.train_ds.items
+        self.valid_set = self.learn.dls.valid_ds.items
         self.class_names = self.dls.vocab
         self.num_classes = self.dls.c
         logger.info("Done. Ready to train.")
@@ -135,16 +138,24 @@ class ActiveLearner:
         """
         logger.info(f"Running inference on {len(filepaths)} samples")
         test_dl = self.dls.test_dl(filepaths, bs=batch_size)
-        preds, _, cls_preds = self.learn.get_preds(dl=test_dl, with_decoded=True)
+
+        def identity(x):
+            return x
+
+        logits, _, class_idxs = self.learn.get_preds(
+            dl=test_dl, with_decoded=True, act=identity
+        )
 
         self.pred_df = pd.DataFrame(
             {
                 "filepath": filepaths,
-                "pred_label": [self.learn.dls.vocab[i] for i in cls_preds.numpy()],
-                "pred_conf": torch.max(preds, dim=1)[0].numpy(),
-                "pred_raw": preds.numpy().tolist(),
+                "pred_label": [self.learn.dls.vocab[i] for i in class_idxs.numpy()],
+                "pred_conf": torch.max(F.softmax(logits, dim=1), dim=1)[0].numpy(),
+                "probs": F.softmax(logits, dim=1).numpy().tolist(),
+                "logits": logits.numpy().tolist(),
             }
         )
+
         return self.pred_df
 
     def evaluate(
@@ -189,38 +200,62 @@ class ActiveLearner:
         df = df[~df["filepath"].isin(self.train_set["filepath"])].copy()
 
         if strategy == "least-confidence":
-            logger.info(f"Getting top {num_samples} low confidence samples")
-
-            df.loc[:, "uncertainty_score"] = 1 - (df["pred_conf"]) / (
+            logger.info(
+                f"Using least confidence strategy to get top {num_samples} samples"
+            )
+            df.loc[:, "score"] = 1 - (df["pred_conf"]) / (
                 self.num_classes - (self.num_classes - 1)
             )
 
-            # Sort by descending uncertainty score
-            uncertain_df = df.sort_values(by="uncertainty_score", ascending=False).head(
-                num_samples
+        elif strategy == "margin-of-confidence":
+            logger.info(
+                f"Using margin of confidence strategy to get top {num_samples} samples"
             )
-            return uncertain_df
+            if len(df["probs"].iloc[0]) < 2:
+                logger.error("probs has less than 2 elements")
+                raise ValueError("probs has less than 2 elements")
 
-        # TODO: Implement margin of confidence strategy
-        elif strategy == "margin-of-confidence":
-            logger.error("Margin of confidence strategy not implemented")
-            raise NotImplementedError("Margin of confidence strategy not implemented")
+            # Calculate uncertainty score as 1 - (difference between top two predictions)
+            df.loc[:, "score"] = df["probs"].apply(
+                lambda x: 1 - (np.sort(x)[-1] - np.sort(x)[-2])
+            )
 
-        # TODO: Implement ratio of confidence strategy
         elif strategy == "ratio-of-confidence":
-            logger.error("Ratio of confidence strategy not implemented")
-            raise NotImplementedError("Ratio of confidence strategy not implemented")
+            logger.info(
+                f"Using ratio of confidence strategy to get top {num_samples} samples"
+            )
+            if len(df["probs"].iloc[0]) < 2:
+                logger.error("probs has less than 2 elements")
+                raise ValueError("probs has less than 2 elements")
+
+            # Calculate uncertainty score as ratio of top two predictions
+            df.loc[:, "score"] = df["probs"].apply(
+                lambda x: np.sort(x)[-2] / np.sort(x)[-1]
+            )
 
-        # TODO: Implement entropy strategy
         elif strategy == "entropy":
-            logger.error("Entropy strategy not implemented")
-            raise NotImplementedError("Entropy strategy not implemented")
+            logger.info(f"Using entropy strategy to get top {num_samples} samples")
+
+            # Calculate uncertainty score as entropy of the prediction
+            df.loc[:, "score"] = df["probs"].apply(lambda x: -np.sum(x * np.log2(x)))
+
+            # Normalize the uncertainty score to be between 0 and 1 by dividing by log2 of the number of classes
+            df.loc[:, "score"] = df["score"] / np.log2(self.num_classes)
 
         else:
             logger.error(f"Unknown strategy: {strategy}")
             raise ValueError(f"Unknown strategy: {strategy}")
 
-    def sample_diverse(self, df: pd.DataFrame, num_samples: int):
+        df = df[["filepath", "pred_label", "pred_conf", "score", "probs", "logits"]]
+
+        df["score"] = df["score"].map("{:.4f}".format)
+        df["pred_conf"] = df["pred_conf"].map("{:.4f}".format)
+
+        return df.sort_values(by="score", ascending=False).head(num_samples)
+
+    def sample_diverse(
+        self, df: pd.DataFrame, num_samples: int, strategy: str = "model-based-outlier"
+    ):
         """
         Sample top `num_samples` diverse samples. Returns a df with filepaths and predicted labels, and confidence scores.
 
@@ -228,9 +263,63 @@ class ActiveLearner:
         - model-based-outlier: Get top `num_samples` samples with lowest activation of the model's last layer.
         - cluster-based: Get top `num_samples` samples with the highest distance to the nearest neighbor.
         - representative: Get top `num_samples` samples with the highest distance to the centroid of the training set.
+
         """
-        logger.error("Diverse sampling strategy not implemented")
-        raise NotImplementedError("Diverse sampling strategy not implemented")
+        # Remove samples that is already in the training set
+        df = df[~df["filepath"].isin(self.train_set["filepath"])].copy()
+
+        if strategy == "model-based-outlier":
+            logger.info(
+                f"Using model-based outlier strategy to get top {num_samples} samples"
+            )
+
+            # Get the activations for all items in the validation set.
+            valid_set_preds = self.predict(self.valid_set["filepath"].tolist())
+
+            # Store logits for each class in a list instead of dict
+            validation_class_logits = [
+                sorted(
+                    valid_set_preds["logits"].apply(lambda x: x[i]).tolist(),
+                    reverse=True,
+                )
+                for i in range(self.num_classes)
+            ]
+
+            # Get the logits for the unlabeled set
+            unlabeled_set_preds = self.predict(df["filepath"].tolist())
+
+            # For each element in the unlabeled set logits, compare it to the validation set ranked logits and get the position in the ranked logits
+            unlabeled_set_logits = []
+            for idx, row in unlabeled_set_preds.iterrows():
+                logits = row["logits"]
+                # For each class, find where this sample's logit would rank in the validation set
+                ranks = []
+                for class_idx in range(self.num_classes):
+                    class_logit = logits[class_idx]
+                    ranked_logits = validation_class_logits[
+                        class_idx
+                    ]  # Access by index instead of dict key
+                    # Find position where this logit would be inserted to maintain sorted order
+                    # Now using bisect_left directly since logits are sorted high to low
+                    rank = bisect.bisect_left(ranked_logits, class_logit)
+                    ranks.append(
+                        rank / len(ranked_logits)
+                    )  # Normalize rank to 0-1 range
+
+                # Average rank across all classes - lower means more outlier-like
+                avg_rank = np.mean(ranks)
+                unlabeled_set_logits.append(avg_rank)
+
+            # Add outlier scores to dataframe
+            df.loc[:, "score"] = unlabeled_set_logits
+
+            df = df[["filepath", "pred_label", "pred_conf", "score", "probs", "logits"]]
+
+            df["score"] = df["score"].map("{:.4f}".format)
+            df["pred_conf"] = df["pred_conf"].map("{:.4f}".format)
+
+            # Sort by score ascending higher rank = more outlier-like compared to the validation set
+            return df.sort_values(by="score", ascending=False).head(num_samples)
 
     def sample_random(self, df: pd.DataFrame, num_samples: int, seed: int = None):
         """
@@ -258,7 +347,7 @@ class ActiveLearner:
                 return;
             }
             
-            if (e.key === "ArrowUp" || e.key === "Enter") {
+            if (e.key === "ArrowUp") {
                 document.getElementById("submit_btn").click();
             } else if (e.key === "ArrowRight") {
                 document.getElementById("next_btn").click();
@@ -284,7 +373,7 @@ class ActiveLearner:
                             type="filepath",
                             label="Image",
                             value=filepaths[0],
-                            height=500
+                            height=510,
                         )
 
                         # Add bar plot with top 5 predictions
@@ -295,11 +384,11 @@ class ActiveLearner:
                                 title="Top 5 Predictions",
                                 x_lim=[0, 1],
                                 value=None
-                                if "pred_raw" not in df.columns
+                                if "probs" not in df.columns
                                 else pd.DataFrame(
                                     {
                                         "class": self.class_names,
-                                        "probability": df["pred_raw"].iloc[0],
+                                        "probability": df["probs"].iloc[0],
                                     }
                                 ).nlargest(5, "probability"),
                             )
@@ -307,18 +396,27 @@ class ActiveLearner:
                             filename = gr.Textbox(
                                 label="Filename", value=filepaths[0], interactive=False
                             )
-
-                            pred_label = gr.Textbox(
-                                label="Predicted Label",
-                                value=df["pred_label"].iloc[0]
-                                if "pred_label" in df.columns
-                                else "",
-                                interactive=False,
-                            )
-                            pred_conf = gr.Textbox(
-                                label="Confidence",
-                                value=f"{df['pred_conf'].iloc[0]:.2%}"
-                                if "pred_conf" in df.columns
+                            with gr.Row():
+                                pred_label = gr.Textbox(
+                                    label="Predicted Label",
+                                    value=df["pred_label"].iloc[0]
+                                    if "pred_label" in df.columns
+                                    else "",
+                                    interactive=False,
+                                )
+
+                                pred_conf = gr.Textbox(
+                                    label="Confidence",
+                                    value=df["pred_conf"].iloc[0]
+                                    if "pred_conf" in df.columns
+                                    else "",
+                                    interactive=False,
+                                )
+
+                            sample_score = gr.Textbox(
+                                label="Sample Score [0-1] - Indicates how informative the sample is. Higher means more informative.",
+                                value=df["score"].iloc[0]
+                                if "score" in df.columns
                                 else "",
                                 interactive=False,
                             )
@@ -334,7 +432,7 @@ class ActiveLearner:
                     with gr.Row():
                         back_btn = gr.Button("← Previous", elem_id="back_btn")
                         submit_btn = gr.Button(
-                            "Submit (↑/Enter)",
+                            "Submit ↑",
                             variant="primary",
                             elem_id="submit_btn",
                         )
@@ -344,8 +442,26 @@ class ActiveLearner:
                         minimum=0,
                         maximum=len(filepaths) - 1,
                         value=0,
+                        step=1,
                         label="Progress",
-                        interactive=False,
+                        interactive=True,
+                    )
+
+                    # Add event handler for slider changes
+                    progress.change(
+                        fn=lambda idx: navigate(idx, 0),
+                        inputs=[progress],
+                        outputs=[
+                            filename,
+                            image,
+                            pred_label,
+                            pred_conf,
+                            category,
+                            current_index,
+                            progress,
+                            pred_plot,
+                            sample_score,
+                        ],
                     )
 
                     finish_btn = gr.Button("Finish Labeling", variant="primary")
@@ -434,11 +550,11 @@ class ActiveLearner:
                 if 0 <= next_idx < len(filepaths):
                     plot_data = (
                         None
-                        if "pred_raw" not in df.columns
+                        if "probs" not in df.columns
                         else pd.DataFrame(
                             {
                                 "class": self.class_names,
-                                "probability": df["pred_raw"].iloc[next_idx],
+                                "probability": df["probs"].iloc[next_idx],
                             }
                         ).nlargest(5, "probability")
                     )
@@ -448,7 +564,7 @@ class ActiveLearner:
                         df["pred_label"].iloc[next_idx]
                         if "pred_label" in df.columns
                         else "",
-                        f"{df['pred_conf'].iloc[next_idx]:.2%}"
+                        df["pred_conf"].iloc[next_idx]
                         if "pred_conf" in df.columns
                         else "",
                         df["pred_label"].iloc[next_idx]
@@ -457,14 +573,15 @@ class ActiveLearner:
                         next_idx,
                         next_idx,
                         plot_data,
+                        df["score"].iloc[next_idx] if "score" in df.columns else "",
                     )
                 plot_data = (
                     None
-                    if "pred_raw" not in df.columns
+                    if "probs" not in df.columns
                     else pd.DataFrame(
                         {
                             "class": self.class_names,
-                            "probability": df["pred_raw"].iloc[current_idx],
+                            "probability": df["probs"].iloc[current_idx],
                         }
                     ).nlargest(5, "probability")
                 )
@@ -474,7 +591,7 @@ class ActiveLearner:
                     df["pred_label"].iloc[current_idx]
                     if "pred_label" in df.columns
                     else "",
-                    f"{df['pred_conf'].iloc[current_idx]:.2%}"
+                    df["pred_conf"].iloc[current_idx]
                     if "pred_conf" in df.columns
                     else "",
                     df["pred_label"].iloc[current_idx]
@@ -483,6 +600,7 @@ class ActiveLearner:
                     current_idx,
                     current_idx,
                     plot_data,
+                    df["score"].iloc[current_idx] if "score" in df.columns else "",
                 )
 
             def save_and_next(current_idx, selected_category):
@@ -490,21 +608,32 @@ class ActiveLearner:
                 current_idx = int(current_idx)
 
                 if selected_category is None:
-                    plot_data = None if "pred_raw" not in df.columns else pd.DataFrame(
-                        {
-                            "class": self.class_names,
-                            "probability": df["pred_raw"].iloc[current_idx],
-                        }
-                    ).nlargest(5, "probability")
+                    plot_data = (
+                        None
+                        if "probs" not in df.columns
+                        else pd.DataFrame(
+                            {
+                                "class": self.class_names,
+                                "probability": df["probs"].iloc[current_idx],
+                            }
+                        ).nlargest(5, "probability")
+                    )
                     return (
                         filepaths[current_idx],
                         filepaths[current_idx],
-                        df["pred_label"].iloc[current_idx] if "pred_label" in df.columns else "",
-                        f"{df['pred_conf'].iloc[current_idx]:.2%}" if "pred_conf" in df.columns else "",
-                        df["pred_label"].iloc[current_idx] if "pred_label" in df.columns else None,
+                        df["pred_label"].iloc[current_idx]
+                        if "pred_label" in df.columns
+                        else "",
+                        df["pred_conf"].iloc[current_idx]
+                        if "pred_conf" in df.columns
+                        else "",
+                        df["pred_label"].iloc[current_idx]
+                        if "pred_label" in df.columns
+                        else None,
                         current_idx,
                         current_idx,
                         plot_data,
+                        df["score"].iloc[current_idx] if "score" in df.columns else "",
                     )
 
                 # Save the current annotation
@@ -514,38 +643,58 @@ class ActiveLearner:
                 # Move to next image if not at the end
                 next_idx = current_idx + 1
                 if next_idx >= len(filepaths):
-                    plot_data = None if "pred_raw" not in df.columns else pd.DataFrame(
-                        {
-                            "class": self.class_names,
-                            "probability": df["pred_raw"].iloc[current_idx],
-                        }
-                    ).nlargest(5, "probability")
+                    plot_data = (
+                        None
+                        if "probs" not in df.columns
+                        else pd.DataFrame(
+                            {
+                                "class": self.class_names,
+                                "probability": df["probs"].iloc[current_idx],
+                            }
+                        ).nlargest(5, "probability")
+                    )
                     return (
                         filepaths[current_idx],
                         filepaths[current_idx],
-                        df["pred_label"].iloc[current_idx] if "pred_label" in df.columns else "",
-                        f"{df['pred_conf'].iloc[current_idx]:.2%}" if "pred_conf" in df.columns else "",
-                        df["pred_label"].iloc[current_idx] if "pred_label" in df.columns else None,
+                        df["pred_label"].iloc[current_idx]
+                        if "pred_label" in df.columns
+                        else "",
+                        df["pred_conf"].iloc[current_idx]
+                        if "pred_conf" in df.columns
+                        else "",
+                        df["pred_label"].iloc[current_idx]
+                        if "pred_label" in df.columns
+                        else None,
                         current_idx,
                         current_idx,
                         plot_data,
+                        df["score"].iloc[current_idx] if "score" in df.columns else "",
                     )
 
-                plot_data = None if "pred_raw" not in df.columns else pd.DataFrame(
-                    {
-                        "class": self.class_names,
-                        "probability": df["pred_raw"].iloc[next_idx],
-                    }
-                ).nlargest(5, "probability")
+                plot_data = (
+                    None
+                    if "probs" not in df.columns
+                    else pd.DataFrame(
+                        {
+                            "class": self.class_names,
+                            "probability": df["probs"].iloc[next_idx],
+                        }
+                    ).nlargest(5, "probability")
+                )
                 return (
                     filepaths[next_idx],
                     filepaths[next_idx],
-                    df["pred_label"].iloc[next_idx] if "pred_label" in df.columns else "",
-                    f"{df['pred_conf'].iloc[next_idx]:.2%}" if "pred_conf" in df.columns else "",
-                    df["pred_label"].iloc[next_idx] if "pred_label" in df.columns else None,
+                    df["pred_label"].iloc[next_idx]
+                    if "pred_label" in df.columns
+                    else "",
+                    df["pred_conf"].iloc[next_idx] if "pred_conf" in df.columns else "",
+                    df["pred_label"].iloc[next_idx]
+                    if "pred_label" in df.columns
+                    else None,
                     next_idx,
                     next_idx,
                     plot_data,
+                    df["score"].iloc[next_idx] if "score" in df.columns else "",
                 )
 
             def convert_csv_to_parquet():
@@ -571,6 +720,7 @@ class ActiveLearner:
                     current_index,
                     progress,
                     pred_plot,
+                    sample_score,
                 ],
             )
 
@@ -586,6 +736,7 @@ class ActiveLearner:
                     current_index,
                     progress,
                     pred_plot,
+                    sample_score,
                 ],
             )
 
@@ -601,6 +752,7 @@ class ActiveLearner:
                     current_index,
                     progress,
                     pred_plot,
+                    sample_score,
                 ],
             )
 

{active_vision-0.1.1 → active_vision-0.3.0}/src/active_vision.egg-info/PKG-INFO

@@ -1,7 +1,7 @@
 Metadata-Version: 2.2
 Name: active-vision
-Version: 0.1.1
-Summary: Active learning for edge vision.
+Version: 0.3.0
+Summary: Active learning for computer vision.
 Requires-Python: >=3.10
 Description-Content-Type: text/markdown
 License-File: LICENSE
@@ -17,10 +17,10 @@ Requires-Dist: timm>=1.0.13
 Requires-Dist: transformers>=4.48.0
 Requires-Dist: xinfer>=0.3.2
 
-![Python Version](https://img.shields.io/badge/python-3.10%2B-blue?style=for-the-badge)
-![License](https://img.shields.io/badge/License-Apache%202.0-green.svg?style=for-the-badge)
-[![PyPI](https://img.shields.io/pypi/v/active-vision?style=for-the-badge)](https://pypi.org/project/active-vision/)
-![Downloads](https://img.shields.io/pepy/dt/active-vision?style=for-the-badge&logo=pypi&logoColor=white&label=Downloads&color=purple)   
+[![Python Version](https://img.shields.io/badge/python-3.10%2B-blue?style=for-the-badge&logo=python&logoColor=white)](https://pypi.org/project/active-vision/)
+[![PyPI](https://img.shields.io/pypi/v/active-vision?style=for-the-badge&logo=pypi&logoColor=white)](https://pypi.org/project/active-vision/)
+[![Downloads](https://img.shields.io/pepy/dt/active-vision?style=for-the-badge&logo=pypi&logoColor=white&label=Downloads&color=purple)](https://pypi.org/project/active-vision/)
+[![License](https://img.shields.io/badge/License-Apache%202.0-green.svg?style=for-the-badge&logo=apache&logoColor=white)](https://github.com/dnth/active-vision/blob/main/LICENSE)
 
 <p align="center">
   <img src="https://raw.githubusercontent.com/dnth/active-vision/main/assets/logo.png" alt="active-vision">
@@ -47,13 +47,14 @@ The goal of this project is to create a framework for the active learning loop f
 
 Uncertainty Sampling:
 - [X] Least confidence
-- [ ] Margin of confidence
-- [ ] Ratio of confidence
-- [ ] Entropy
+- [X] Margin of confidence
+- [X] Ratio of confidence
+- [X] Entropy
 
 Diverse Sampling:
 - [X] Random sampling
-- [ ] Model-based outlier
+- [X] Model-based outlier
+- [ ] Embeddings-based outlier
 - [ ] Cluster-based
 - [ ] Representative
 
@@ -172,7 +173,7 @@ The active learning loop is a iterative process and can keep going until you hit
 - You hit a budget.
 - Other criteria.
 
-For this dataset,I decided to stop the active learning loop at 275 labeled images because the performance on the evaluation set is close to the top performing model on the leaderboard. 
+For this dataset, I decided to stop the active learning loop at 275 labeled images because the performance on the evaluation set exceeds the top performing model on the leaderboard. 
 
 
 | #Labeled Images 	| Evaluation Accuracy 	| Train Epochs 	| Model                	| Active Learning 	| Source                                                                              	|

active_vision-0.1.1/src/active_vision/__init__.py

@@ -1,3 +0,0 @@
-__version__ = "0.1.1"
-
-from .core import *