vision-agent 0.0.44__py3-none-any.whl → 0.0.46__py3-none-any.whl

{vision_agent-0.0.44.dist-info → vision_agent-0.0.46.dist-info}/METADATA

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: vision-agent
-Version: 0.0.44
+Version: 0.0.46
 Summary: Toolset for Vision Agent
 Author: Landing AI
 Author-email: dev@landing.ai
@@ -71,8 +71,8 @@ You can interact with the agents as you would with any LLM or LMM model:
 ```python
 >>> import vision_agent as va
 >>> agent = VisionAgent()
->>> agent("How many apples are in this image?", image="apples.jpg")
-"There are 2 apples in the image."
+>>> agent("What percentage of the area of this jar is filled with coffee beans?", image="jar.jpg")
+"The percentage of area of the jar filled with coffee beans is 25%."
 ```
 
 To better understand how the model came up with it's answer, you can also run it in
@@ -86,22 +86,22 @@ You can also have it return the workflow it used to complete the task along with
 the individual steps and tools to get the answer:
 
 ```python
->>> resp, workflow = agent.chat_with_workflow([{"role": "user", "content": "How many apples are in this image?"}], image="apples.jpg")
+>>> resp, workflow = agent.chat_with_workflow([{"role": "user", "content": "What percentage of the area of this jar is filled with coffee beans?"}], image="jar.jpg")
 >>> print(workflow)
-[{"task": "Count the number of apples using 'grounding_dino_'.",
-  "tool": "grounding_dino_",
-  "parameters": {"prompt": "apple", "image": "apples.jpg"},
+[{"task": "Segment the jar using 'grounding_sam_'.",
+  "tool": "grounding_sam_",
+  "parameters": {"prompt": "jar", "image": "jar.jpg"},
   "call_results": [[
     {
-      "labels": ["apple", "apple"],
-      "scores": [0.99, 0.95],
+      "labels": ["jar"],
+      "scores": [0.99],
       "bboxes": [
         [0.58, 0.2, 0.72, 0.45],
-        [0.94, 0.57, 0.98, 0.66],
-      ]
+      ],
+      "masks": "mask.png"
     }
   ]],
-  "answer": "There are 2 apples in the image.",
+  "answer": "The jar is located at [0.58, 0.2, 0.72, 0.45].",
 }]
 ```
 
@@ -113,13 +113,12 @@ you. For example:
 ```python
 >>> import vision_agent as va
 >>> llm = va.llm.OpenAILLM()
->>> detector = llm.generate_detector("Can you build an apple detector for me?")
->>> detector("apples.jpg")
-[{"labels": ["apple", "apple"],
-  "scores": [0.99, 0.95],
+>>> detector = llm.generate_detector("Can you build a jar detector for me?")
+>>> detector("jar.jpg")
+[{"labels": ["jar",],
+  "scores": [0.99],
   "bboxes": [
     [0.58, 0.2, 0.72, 0.45],
-    [0.94, 0.57, 0.98, 0.66],
   ]
 }]
 ```
@@ -133,7 +132,9 @@ you. For example:
 | Crop | Crop crops an image given a bounding box and returns a file name of the cropped image. |
 | BboxArea | BboxArea returns the area of the bounding box in pixels normalized to 2 decimal places. |
 | SegArea | SegArea returns the area of the segmentation mask in pixels normalized to 2 decimal places. |
-| ExtractFrames | ExtractFrames extracts image frames from the input video. |
+| BboxIoU | BboxIoU returns the intersection over union of two bounding boxes normalized to 2 decimal places. |
+| SegIoU | SegIoU returns the intersection over union of two segmentation masks normalized to 2 decimal places. |
+| ExtractFrames | ExtractFrames extracts frames with motion from a video. |
 
 
 It also has a basic set of calculate tools such as add, subtract, multiply and divide.

{vision_agent-0.0.44.dist-info → vision_agent-0.0.46.dist-info}/RECORD

@@ -20,7 +20,7 @@ vision_agent/tools/__init__.py,sha256=AKN-T659HpwVearRnkCd6wWNoJ6K5kW9gAZwb8IQSL
 vision_agent/tools/prompts.py,sha256=9RBbyqlNlExsGKlJ89Jkph83DAEJ8PCVGaHoNbyN7TM,1416
 vision_agent/tools/tools.py,sha256=aMTBxxaXQp33HwplOS8xrgfbsTJ8e1pwO6byR7HcTJI,23447
 vision_agent/tools/video.py,sha256=40rscP8YvKN3lhZ4PDcOK4XbdFX2duCRpHY_krmBYKU,7476
-vision_agent-0.0.44.dist-info/LICENSE,sha256=xx0jnfkXJvxRnG63LTGOxlggYnIysveWIZ6H3PNdCrQ,11357
-vision_agent-0.0.44.dist-info/METADATA,sha256=37VbNe7gzshtrljawNTJ4pHR2-rac_-A_sZFQOxFtvI,5324
-vision_agent-0.0.44.dist-info/WHEEL,sha256=7Z8_27uaHI_UZAc4Uox4PpBhQ9Y5_modZXWMxtUi4NU,88
-vision_agent-0.0.44.dist-info/RECORD,,
+vision_agent-0.0.46.dist-info/LICENSE,sha256=xx0jnfkXJvxRnG63LTGOxlggYnIysveWIZ6H3PNdCrQ,11357
+vision_agent-0.0.46.dist-info/METADATA,sha256=Q5UxkEqKAbnJJtwwFSGhLhobdwhTJF552zsEfKayXz8,5564
+vision_agent-0.0.46.dist-info/WHEEL,sha256=7Z8_27uaHI_UZAc4Uox4PpBhQ9Y5_modZXWMxtUi4NU,88
+vision_agent-0.0.46.dist-info/RECORD,,