cloudos-cli 2.66.2__tar.gz → 2.68.0__tar.gz

{cloudos_cli-2.66.2 → cloudos_cli-2.68.0}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: cloudos_cli
-Version: 2.66.2
+Version: 2.68.0
 Summary: Python package for interacting with CloudOS
 Home-page: https://github.com/lifebit-ai/cloudos-cli
 Author: David Piñeyro
@@ -80,6 +80,7 @@ Python package for interacting with CloudOS
       - [Get Job Workdir](#get-job-workdir)
       - [List Jobs](#list-jobs)
       - [Get Job Costs](#get-job-costs)
+      - [Get Job Related Analyses](#get-job-related-analyses)
     - [Bash Jobs](#bash-jobs)
       - [Send Array Job](#send-array-job)
       - [Submit a Bash Array Job](#submit-a-bash-array-job)
@@ -1198,6 +1199,114 @@ cat 62c83a1191fe06013b7ef355_costs.json
 
 ```
 
+#### Get Job Related Analyses
+
+You can view related jobs that share the same working directory in a CloudOS workspace by using the `job related` command. This feature helps track job lineages, resume workflows, and understand job relationships.
+
+The information is retrieved from CloudOS and can be displayed in multiple formats:
+
+- **Console display**: Rich formatted tables with pagination
+- **JSON**: Complete job data for programmatic processing
+
+To get related analyses for a specific job:
+
+```bash
+cloudos job related --profile my_profile --job-id 66b5e5ded52f33061e2468d5
+```
+
+The expected output is a formatted table showing:
+
+```console
+Total related analyses found: 15
+
+                                              Related Analyses                                              
+┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━┓
+┃ Status    ┃ Name                               ┃ Owner          ┃ ID                       ┃ Submit time         ┃ Run time  ┃ Total Cost ┃
+┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━┩
+│ completed │ workflow_analysis_v1               │ John Smith     │ 66b5e5ded52f33061e2468d5 │ 2024-08-09 14:23:10 │ 45m 12s   │ $1.2340    │
+│ completed │ workflow_analysis_v1_resumed       │ John Smith     │ 66b6f2a1e52f33061e246abc │ 2024-08-10 09:15:22 │ 12m 5s    │ $0.3210    │
+│ running   │ workflow_analysis_v2               │ Jane Doe       │ 66b7a3b2f52f33061e246def │ 2024-08-11 11:30:45 │ 5m 30s    │ $0.1150    │
+│ failed    │ workflow_analysis_test             │ John Smith     │ 66b8c4d3g52f33061e246ghi │ 2024-08-12 16:42:18 │ 2m 15s    │ $0.0450    │
+│ completed │ workflow_downstream_processing     │ Jane Doe       │ 66b9d5e4h52f33061e246jkl │ 2024-08-13 08:20:33 │ 28m 40s   │ $0.7890    │
+│ aborted   │ workflow_analysis_v1_test2         │ John Smith     │ 66bae6f5i52f33061e246mno │ 2024-08-14 13:55:07 │ 1m 8s     │ $0.0120    │
+│ completed │ workflow_final_results             │ Jane Doe       │ 66bbf807j52f33061e246pqr │ 2024-08-15 10:12:44 │ 18m 22s   │ $0.5670    │
+│ queued    │ workflow_reanalysis                │ John Smith     │ 66bcd918k52f33061e246stu │ 2024-08-16 15:38:19 │ N/A       │ N/A        │
+│ completed │ workflow_quality_control           │ Jane Doe       │ 66bdea29l52f33061e246vwx │ 2024-08-17 07:45:52 │ 8m 15s    │ $0.2340    │
+│ completed │ workflow_variant_calling           │ John Smith     │ 66befb3am52f33061e246yz1 │ 2024-08-18 12:03:28 │ 55m 48s   │ $1.5620    │
+└───────────┴────────────────────────────────────┴────────────────┴──────────────────────────┴─────────────────────┴───────────┴────────────┘
+On page 1/2: n = next, p = prev, q = quit
+```
+
+The table displays key information for each related job:
+- **Status**: Current job state (initializing, running, completed, aborting, aborted, failed)
+- **Name**: Job name assigned when submitted
+- **Owner**: User who submitted the job (first name and last name)
+- **ID**: Job identifier in CloudOS
+- **Submit time**: When the job was submitted (formatted as YYYY-MM-DD HH:MM:SS)
+- **Run time**: Actual execution time (formatted as hours, minutes, seconds)
+- **Total Cost**: Compute cost in USD
+
+**Pagination controls:**
+- Press `n` to navigate to the next page
+- Press `p` to navigate to the previous page
+- Press `q` to quit and return to the terminal
+
+The console automatically clears between pages for a clean viewing experience, displaying 10 jobs per page.
+
+**Export options:**
+
+Save related analyses to JSON for programmatic analysis:
+
+```bash
+cloudos job related --profile my_profile --job-id 66b5e5ded52f33061e2468d5 --output-format json
+
+cat related_analyses.json
+{
+  "66b5e5ded52f33061e2468d5": {
+    "status": "completed",
+    "name": "workflow_analysis_v1",
+    "user_name": "John",
+    "user_surname": "Smith",
+    "_id": "66b5e5ded52f33061e2468d5",
+    "createdAt": "2024-08-09T14:23:10.000Z",
+    "runTime": 2712,
+    "computeCostSpent": 123400
+  },
+  "66b6f2a1e52f33061e246abc": {
+    "status": "completed",
+    "name": "workflow_analysis_v1_resumed",
+    "user_name": "John",
+    "user_surname": "Smith",
+    "_id": "66b6f2a1e52f33061e246abc",
+    "createdAt": "2024-08-10T09:15:22.000Z",
+    "runTime": 725,
+    "computeCostSpent": 32100
+  },
+  ...
+}
+```
+
+The JSON format includes:
+- `status`: Job execution status
+- `name`: Job name
+- `user_name` and `user_surname`: Owner information
+- `_id`: Job identifier
+- `createdAt`: ISO 8601 timestamp of job submission
+- `runTime`: Execution time in seconds
+- `computeCostSpent`: Total cost in cents (divide by 100 for dollars)
+
+**Use cases:**
+
+Related analyses are particularly useful for:
+- **Resumed workflows**: Find previous jobs to continue from checkpoints
+- **Job lineage tracking**: Understand which jobs are part of the same analysis
+- **Cost analysis**: Compare costs across related jobs
+- **Debugging**: Identify failed jobs in a workflow series
+- **Collaboration**: See all jobs from team members working on shared data
+
+> [!NOTE]
+> Related jobs are identified by their shared working directory folder ID. Only jobs within the same workspace that use the same working directory will be displayed.
+
 ### Bash Jobs
 Execute bash scripts on CloudOS for custom processing workflows. Bash jobs allow you to run shell commands with custom parameters and are ideal for data preprocessing or simple computational tasks.
 

{cloudos_cli-2.66.2 → cloudos_cli-2.68.0}/README.md

@@ -45,6 +45,7 @@ Python package for interacting with CloudOS
       - [Get Job Workdir](#get-job-workdir)
       - [List Jobs](#list-jobs)
       - [Get Job Costs](#get-job-costs)
+      - [Get Job Related Analyses](#get-job-related-analyses)
     - [Bash Jobs](#bash-jobs)
       - [Send Array Job](#send-array-job)
       - [Submit a Bash Array Job](#submit-a-bash-array-job)
@@ -1163,6 +1164,114 @@ cat 62c83a1191fe06013b7ef355_costs.json
 
 ```
 
+#### Get Job Related Analyses
+
+You can view related jobs that share the same working directory in a CloudOS workspace by using the `job related` command. This feature helps track job lineages, resume workflows, and understand job relationships.
+
+The information is retrieved from CloudOS and can be displayed in multiple formats:
+
+- **Console display**: Rich formatted tables with pagination
+- **JSON**: Complete job data for programmatic processing
+
+To get related analyses for a specific job:
+
+```bash
+cloudos job related --profile my_profile --job-id 66b5e5ded52f33061e2468d5
+```
+
+The expected output is a formatted table showing:
+
+```console
+Total related analyses found: 15
+
+                                              Related Analyses                                              
+┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━┓
+┃ Status    ┃ Name                               ┃ Owner          ┃ ID                       ┃ Submit time         ┃ Run time  ┃ Total Cost ┃
+┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━╇━━━━━━━━━━━━┩
+│ completed │ workflow_analysis_v1               │ John Smith     │ 66b5e5ded52f33061e2468d5 │ 2024-08-09 14:23:10 │ 45m 12s   │ $1.2340    │
+│ completed │ workflow_analysis_v1_resumed       │ John Smith     │ 66b6f2a1e52f33061e246abc │ 2024-08-10 09:15:22 │ 12m 5s    │ $0.3210    │
+│ running   │ workflow_analysis_v2               │ Jane Doe       │ 66b7a3b2f52f33061e246def │ 2024-08-11 11:30:45 │ 5m 30s    │ $0.1150    │
+│ failed    │ workflow_analysis_test             │ John Smith     │ 66b8c4d3g52f33061e246ghi │ 2024-08-12 16:42:18 │ 2m 15s    │ $0.0450    │
+│ completed │ workflow_downstream_processing     │ Jane Doe       │ 66b9d5e4h52f33061e246jkl │ 2024-08-13 08:20:33 │ 28m 40s   │ $0.7890    │
+│ aborted   │ workflow_analysis_v1_test2         │ John Smith     │ 66bae6f5i52f33061e246mno │ 2024-08-14 13:55:07 │ 1m 8s     │ $0.0120    │
+│ completed │ workflow_final_results             │ Jane Doe       │ 66bbf807j52f33061e246pqr │ 2024-08-15 10:12:44 │ 18m 22s   │ $0.5670    │
+│ queued    │ workflow_reanalysis                │ John Smith     │ 66bcd918k52f33061e246stu │ 2024-08-16 15:38:19 │ N/A       │ N/A        │
+│ completed │ workflow_quality_control           │ Jane Doe       │ 66bdea29l52f33061e246vwx │ 2024-08-17 07:45:52 │ 8m 15s    │ $0.2340    │
+│ completed │ workflow_variant_calling           │ John Smith     │ 66befb3am52f33061e246yz1 │ 2024-08-18 12:03:28 │ 55m 48s   │ $1.5620    │
+└───────────┴────────────────────────────────────┴────────────────┴──────────────────────────┴─────────────────────┴───────────┴────────────┘
+On page 1/2: n = next, p = prev, q = quit
+```
+
+The table displays key information for each related job:
+- **Status**: Current job state (initializing, running, completed, aborting, aborted, failed)
+- **Name**: Job name assigned when submitted
+- **Owner**: User who submitted the job (first name and last name)
+- **ID**: Job identifier in CloudOS
+- **Submit time**: When the job was submitted (formatted as YYYY-MM-DD HH:MM:SS)
+- **Run time**: Actual execution time (formatted as hours, minutes, seconds)
+- **Total Cost**: Compute cost in USD
+
+**Pagination controls:**
+- Press `n` to navigate to the next page
+- Press `p` to navigate to the previous page
+- Press `q` to quit and return to the terminal
+
+The console automatically clears between pages for a clean viewing experience, displaying 10 jobs per page.
+
+**Export options:**
+
+Save related analyses to JSON for programmatic analysis:
+
+```bash
+cloudos job related --profile my_profile --job-id 66b5e5ded52f33061e2468d5 --output-format json
+
+cat related_analyses.json
+{
+  "66b5e5ded52f33061e2468d5": {
+    "status": "completed",
+    "name": "workflow_analysis_v1",
+    "user_name": "John",
+    "user_surname": "Smith",
+    "_id": "66b5e5ded52f33061e2468d5",
+    "createdAt": "2024-08-09T14:23:10.000Z",
+    "runTime": 2712,
+    "computeCostSpent": 123400
+  },
+  "66b6f2a1e52f33061e246abc": {
+    "status": "completed",
+    "name": "workflow_analysis_v1_resumed",
+    "user_name": "John",
+    "user_surname": "Smith",
+    "_id": "66b6f2a1e52f33061e246abc",
+    "createdAt": "2024-08-10T09:15:22.000Z",
+    "runTime": 725,
+    "computeCostSpent": 32100
+  },
+  ...
+}
+```
+
+The JSON format includes:
+- `status`: Job execution status
+- `name`: Job name
+- `user_name` and `user_surname`: Owner information
+- `_id`: Job identifier
+- `createdAt`: ISO 8601 timestamp of job submission
+- `runTime`: Execution time in seconds
+- `computeCostSpent`: Total cost in cents (divide by 100 for dollars)
+
+**Use cases:**
+
+Related analyses are particularly useful for:
+- **Resumed workflows**: Find previous jobs to continue from checkpoints
+- **Job lineage tracking**: Understand which jobs are part of the same analysis
+- **Cost analysis**: Compare costs across related jobs
+- **Debugging**: Identify failed jobs in a workflow series
+- **Collaboration**: See all jobs from team members working on shared data
+
+> [!NOTE]
+> Related jobs are identified by their shared working directory folder ID. Only jobs within the same workspace that use the same working directory will be displayed.
+
 ### Bash Jobs
 Execute bash scripts on CloudOS for custom processing workflows. Bash jobs allow you to run shell commands with custom parameters and are ideal for data preprocessing or simple computational tasks.
 

{cloudos_cli-2.66.2 → cloudos_cli-2.68.0}/cloudos_cli/__main__.py

@@ -30,6 +30,7 @@ from cloudos_cli.configure.configure import (
     get_shared_config,
     CLOUDOS_URL
 )
+from cloudos_cli.related_analyses.related_analyses import related_analyses
 
 
 # GLOBAL VARS
@@ -1385,6 +1386,49 @@ def job_cost(ctx,
     cost_viewer.display_costs(job_id, workspace_id, output_format, verify_ssl)
 
 
+@job.command('related')
+@click.option('-k',
+              '--apikey',
+              help='Your CloudOS API key',
+              required=True)
+@click.option('-c',
+              '--cloudos-url',
+              help=(f'The CloudOS url you are trying to access to. Default={CLOUDOS_URL}.'),
+              default=CLOUDOS_URL,
+              required=True)
+@click.option('--workspace-id',
+              help='The specific CloudOS workspace id.',
+              required=True)
+@click.option('--job-id',
+              help='The job id in CloudOS to get costs for.',
+              required=True)
+@click.option('--output-format',
+              help='The desired output format. Default=stdout.',
+              type=click.Choice(['stdout', 'json'], case_sensitive=False),
+              default='stdout')
+@click.option('--disable-ssl-verification',
+              help=('Disable SSL certificate verification. Please, remember that this option is ' +
+                    'not generally recommended for security reasons.'),
+              is_flag=True)
+@click.option('--ssl-cert',
+              help='Path to your SSL certificate file.')
+@click.option('--profile', help='Profile to use from the config file', default=None)
+@click.pass_context
+@with_profile_config(required_params=['apikey', 'workspace_id'])
+def related(ctx,
+            apikey,
+            cloudos_url,
+            workspace_id,
+            job_id,
+            output_format,
+            disable_ssl_verification,
+            ssl_cert,
+            profile):
+    """Retrieve related job analyses in CloudOS."""
+    verify_ssl = ssl_selector(disable_ssl_verification, ssl_cert)
+    related_analyses(cloudos_url, apikey, job_id, workspace_id, output_format, verify_ssl)
+
+
 @click.command(help='Clone or resume a job with modified parameters')
 @click.option('-k',
               '--apikey',

cloudos_cli-2.68.0/cloudos_cli/_version.py

@@ -0,0 +1 @@
+__version__ = '2.68.0'

{cloudos_cli-2.66.2 → cloudos_cli-2.68.0}/cloudos_cli/clos.py

@@ -224,8 +224,44 @@ class Cloudos:
         if "resumeWorkDir" not in r_json:
             raise ValueError("Working directories are not available. This may be because the analysis was run without resumable mode enabled, or because intermediate results have since been removed.")
         
-        # Check if logs field exists, if not fall back to original folder-based approach
-        elif "logs" in r_json:
+        # If resumeWorkDir exists, use the folders API to get the shared working directory
+        resume_workdir_id = r_json.get("resumeWorkDir")
+        if resume_workdir_id:
+            try:
+                # Use folders API to get the actual shared working directory
+                workdir_bucket_r = retry_requests_get(f"{cloudos_url}/api/v1/folders",
+                                                        params=dict(id=resume_workdir_id, teamId=workspace_id), 
+                                                        headers=headers, verify=verify)
+                if workdir_bucket_r.status_code == 401:
+                    raise NotAuthorisedException
+                elif workdir_bucket_r.status_code >= 400:
+                    raise BadRequestException(workdir_bucket_r)
+
+                workdir_bucket_o = workdir_bucket_r.json()
+                if len(workdir_bucket_o) > 1:
+                    raise ValueError(f"Request returned more than one result for folder id {resume_workdir_id}")
+                workdir_bucket_info = workdir_bucket_o[0]
+                
+                if workdir_bucket_info["folderType"] == "S3Folder":
+                    bucket_name = workdir_bucket_info["s3BucketName"]
+                    bucket_path = workdir_bucket_info["s3Prefix"]
+                    workdir_path = f"s3://{bucket_name}/{bucket_path}"
+                elif workdir_bucket_info["folderType"] == "AzureBlobFolder":
+                    storage_account = f"az://{workspace_id}.blob.core.windows.net"
+                    container_name = workdir_bucket_info["blobContainerName"]
+                    blob_prefix = workdir_bucket_info["blobPrefix"]
+                    workdir_path = f"{storage_account}/{container_name}/{blob_prefix}"
+                else:
+                    raise ValueError("Unsupported cloud provider")
+                
+                return workdir_path
+            except Exception as e:
+                # If folders API fails, fall back to logs-based approach
+                print(f"Warning: Could not get shared workdir from folders API: {e}")
+                pass
+        
+        # Check if logs field exists for fallback approach
+        if "logs" in r_json:
             # Get workdir information from logs object using the same pattern as get_job_logs
             logs_obj = r_json["logs"]
             cloud_name, cloud_meta, cloud_storage = find_cloud(self.cloudos_url, self.apikey, workspace_id, logs_obj)
@@ -247,6 +283,7 @@ class Cloudos:
                 workdir_path = f"{storage_account_prefix}/{logs_bucket}/{workdir_path_suffix}"
             else:
                 raise ValueError("Unsupported cloud provider")
+            
             return workdir_path
         else:
             # Fallback to original folder-based approach for backward compatibility
@@ -283,6 +320,7 @@ class Cloudos:
                 workdir_path = f"{storage_account}/{container_name}/{blob_prefix}"
             else:
                 raise ValueError("Unsupported cloud provider")
+            
             return workdir_path
 
     def _handle_job_access_denied(self, job_id, workspace_id, verify=True):

{cloudos_cli-2.66.2 → cloudos_cli-2.68.0}/cloudos_cli/jobs/job.py

@@ -13,6 +13,7 @@ import base64
 from cloudos_cli.utils.array_job import classify_pattern, get_file_or_folder_id, extract_project
 import os
 import click
+from datetime import datetime
 
 
 @dataclass
@@ -1265,3 +1266,164 @@ class Job(Cloudos):
         else:
             return obj
 
+    def get_job_relatedness(self, workspace_id, workdir_folder_id, limit=100, verify=True):
+        """Get ALL related jobs that share the same working directory folder.
+
+        This method retrieves all jobs sharing the same working directory folder,
+        using pagination internally to fetch all results from the API.
+
+        Parameters
+        ----------
+        workspace_id : str
+            The CloudOS workspace ID.
+        workdir_folder_id : str
+            The working directory folder ID to filter jobs by.
+        limit : int
+            Batch size for API requests (default: 100). This parameter is kept
+            for backwards compatibility but fetches all jobs regardless.
+        verify : [bool | str], optional
+            Whether to use SSL verification or not. Alternatively, if
+            a string is passed, it will be interpreted as the path to
+            the SSL certificate file. Default is True.
+
+        Returns
+        -------
+        dict
+            A dictionary where keys are job IDs and values are dictionaries
+            containing job details: status, name, user name, user surname,
+            _id, createdAt, runTime, and computeCostSpent.
+
+        Raises
+        ------
+        BadRequestException
+            If the request fails with a status code indicating an error.
+        """
+        headers = {
+            "Content-type": "application/json",
+            "apikey": self.apikey
+        }
+
+        # Fetch ALL related jobs using pagination
+        all_jobs = []
+        current_page = 1
+        batch_size = limit  # API request batch size
+
+        while True:
+            params = {
+                "limit": batch_size,
+                "page": current_page,
+                "sort": "-createdAt",
+                "archived.status": "false",
+                "workDirectory.folderId": workdir_folder_id,
+                "teamId": workspace_id
+            }
+
+            url = f"{self.cloudos_url}/api/v2/jobs"
+            response = retry_requests_get(url, params=params, headers=headers, verify=verify)
+
+            if response.status_code >= 400:
+                raise BadRequestException(response)
+
+            content = json.loads(response.content)
+            jobs = content.get("jobs", [])
+
+            if not jobs:
+                break  # No more jobs to fetch
+
+            all_jobs.extend(jobs)
+
+            if len(jobs) < batch_size:
+                break  # Last page reached (fewer jobs than batch size)
+
+            current_page += 1
+
+        # Create final content with all fetched jobs
+        content = {"jobs": all_jobs}
+
+        # Process the jobs and extract the required fields
+        related_jobs = {}
+
+        for job in content.get("jobs", []):
+            job_id = job.get("_id")
+            if job_id:
+                # Calculate runtime if both startTime and endTime exist
+                run_time = None
+                start_time = job.get("startTime")
+                end_time = job.get("endTime")
+                if start_time and end_time:
+                    try:
+                        start_dt = datetime.fromisoformat(start_time.replace('Z', '+00:00'))
+                        end_dt = datetime.fromisoformat(end_time.replace('Z', '+00:00'))
+                        run_time = (end_dt - start_dt).total_seconds()
+                    except (ValueError, AttributeError):
+                        run_time = None
+
+                # Extract user information
+                user_info = job.get("user", {})
+
+                related_jobs[job_id] = {
+                    "_id": job_id,
+                    "status": job.get("status"),
+                    "name": job.get("name"),
+                    "user_name": user_info.get("name"),
+                    "user_surname": user_info.get("surname"),
+                    "createdAt": job.get("createdAt"),
+                    "runTime": run_time,
+                    "computeCostSpent": job.get("computeCostSpent")
+                }
+
+        return related_jobs
+
+    def get_parent_job(self, workspace_id, folder_id, verify=True):
+        """Get the parent job of a given folder.
+
+        Parameters
+        ----------
+        workspace_id : str
+            The CloudOS workspace ID.
+        folder_id : str
+            The ID of the folder whose parent job is to be retrieved.
+        verify : [bool | str], optional
+            Whether to use SSL verification or not. Alternatively, if
+            a string is passed, it will be interpreted as the path to
+            the SSL certificate file. Default is True.
+
+        Returns
+        -------
+        dict
+            A dictionary containing details of the parent job.
+
+        Raises
+        ------
+        BadRequestException
+            If the request fails with a status code indicating an error.
+        """
+        headers = {
+            "Content-type": "application/json",
+            "apikey": self.apikey
+        }
+
+        params = {
+            "id": folder_id,
+            "status": "ready",
+            "teamId": workspace_id
+        }
+
+        url = f"{self.cloudos_url}/api/v1/folders/"
+        response = retry_requests_get(url, params=params, headers=headers, verify=verify)
+
+        if response.status_code >= 400:
+            raise BadRequestException(response)
+
+        content = json.loads(response.content)
+
+        # The API returns a list of folders; we need to extract the parent job ID from the first item (if present)
+        if isinstance(content, list) and content:
+            parent_job_id = content[0].get("parent", {}).get("id")
+        else:
+            parent_job_id = None
+
+        if not parent_job_id:
+            return None
+        else:
+            return parent_job_id