fosslight-dependency 4.1.1__tar.gz → 4.1.2__tar.gz

{fosslight_dependency-4.1.1 → fosslight_dependency-4.1.2}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: fosslight_dependency
-Version: 4.1.1
+Version: 4.1.2
 Summary: FOSSLight Dependency Scanner
 Home-page: https://github.com/fosslight/fosslight_dependency_scanner
 Author: LG Electronics
@@ -10,23 +10,22 @@ Description: <!--
         Copyright (c) 2021 LG Electronics
         SPDX-License-Identifier: Apache-2.0
          -->
-        # FOSSLight Dependency Scanner
         
-        <img src="https://img.shields.io/pypi/l/fosslight_dependency" alt="License" /> <a href="https://pypi.org/project/fosslight-dependency/"><img src="https://img.shields.io/pypi/v/fosslight_dependency" alt="Current python package version." /></a> <img src="https://img.shields.io/pypi/pyversions/fosslight_dependency" /> [![REUSE status](https://api.reuse.software/badge/github.com/fosslight/fosslight_dependency_scanner)](https://api.reuse.software/info/github.com/fosslight/fosslight_dependency_scanner)
+        # FOSSLight Dependency Scanner
         
+        `<img src="https://img.shields.io/pypi/l/fosslight_dependency" alt="License" />` `<a href="https://pypi.org/project/fosslight-dependency/"><img src="https://img.shields.io/pypi/v/fosslight_dependency" alt="Current python package version." />``</a>` `<img src="https://img.shields.io/pypi/pyversions/fosslight_dependency" />` [![REUSE status](https://api.reuse.software/badge/github.com/fosslight/fosslight_dependency_scanner)](https://api.reuse.software/info/github.com/fosslight/fosslight_dependency_scanner)
         
         ## 💡 Introduction
         
         This is the tool that supports the analysis of dependencies for multiple package managers. It detects the manifest file of package managers automatically and analyzes the dependencies with using open source tools. Then, it generates the report file that contains OSS information of dependencies.
         
-        
         ## 📖 User Guide
         
-        We describe the user guide in the [**FOSSLight Guide page**](https://fosslight.org/fosslight-guide-en/scanner/3_dependency.html).  
+        We describe the user guide in the [**FOSSLight Guide page**](https://fosslight.org/fosslight-guide-en/scanner/3_dependency.html).
         In this user guide, you can see how to install the FOSSLight Dependency Scanner and how to set up the prerequisite step and run it according to the package manager of your project. Also, you can check the results of the FOSSLight Dependency Scanner.
         
-        
         ## 👀 Package Support Level
+        
         <table>
         <thead>
           <tr>
@@ -141,19 +140,25 @@ Description: <!--
             <td>O</td>
             <td>X</td>
           </tr>
+          <tr>
+            <td>Rust</td>
+            <td>Cargo</td>
+            <td>Cargo.toml</td>
+            <td>O</td>
+            <td>O</td>
+            <td>O</td>
+          </tr>
         </tbody>
         </table>
         
-        
         ## 👏 Contributing Guide
         
-        We always welcome your contributions.  
+        We always welcome your contributions.
         Please see the [CONTRIBUTING guide](https://github.com/fosslight/fosslight_dependency_scanner/blob/main/CONTRIBUTING.md) for how to contribute.
         
-        
         ## 📄 License
         
-        Copyright (c) 2020 LG Electronics, Inc.  
+        Copyright (c) 2020 LG Electronics, Inc.
         FOSSLight Dependency Scanner is licensed under Apache-2.0, as found in the [LICENSE](https://github.com/fosslight/fosslight_dependency_scanner/blob/main/LICENSE) file.
         
 Platform: UNKNOWN

{fosslight_dependency-4.1.1 → fosslight_dependency-4.1.2}/README.md

@@ -2,23 +2,22 @@
 Copyright (c) 2021 LG Electronics
 SPDX-License-Identifier: Apache-2.0
  -->
-# FOSSLight Dependency Scanner
 
-<img src="https://img.shields.io/pypi/l/fosslight_dependency" alt="License" /> <a href="https://pypi.org/project/fosslight-dependency/"><img src="https://img.shields.io/pypi/v/fosslight_dependency" alt="Current python package version." /></a> <img src="https://img.shields.io/pypi/pyversions/fosslight_dependency" /> [![REUSE status](https://api.reuse.software/badge/github.com/fosslight/fosslight_dependency_scanner)](https://api.reuse.software/info/github.com/fosslight/fosslight_dependency_scanner)
+# FOSSLight Dependency Scanner
 
+`<img src="https://img.shields.io/pypi/l/fosslight_dependency" alt="License" />` `<a href="https://pypi.org/project/fosslight-dependency/"><img src="https://img.shields.io/pypi/v/fosslight_dependency" alt="Current python package version." />``</a>` `<img src="https://img.shields.io/pypi/pyversions/fosslight_dependency" />` [![REUSE status](https://api.reuse.software/badge/github.com/fosslight/fosslight_dependency_scanner)](https://api.reuse.software/info/github.com/fosslight/fosslight_dependency_scanner)
 
 ## 💡 Introduction
 
 This is the tool that supports the analysis of dependencies for multiple package managers. It detects the manifest file of package managers automatically and analyzes the dependencies with using open source tools. Then, it generates the report file that contains OSS information of dependencies.
 
-
 ## 📖 User Guide
 
-We describe the user guide in the [**FOSSLight Guide page**](https://fosslight.org/fosslight-guide-en/scanner/3_dependency.html).  
+We describe the user guide in the [**FOSSLight Guide page**](https://fosslight.org/fosslight-guide-en/scanner/3_dependency.html).
 In this user guide, you can see how to install the FOSSLight Dependency Scanner and how to set up the prerequisite step and run it according to the package manager of your project. Also, you can check the results of the FOSSLight Dependency Scanner.
 
-
 ## 👀 Package Support Level
+
 <table>
 <thead>
   <tr>
@@ -133,17 +132,23 @@ In this user guide, you can see how to install the FOSSLight Dependency Scanner
     <td>O</td>
     <td>X</td>
   </tr>
+  <tr>
+    <td>Rust</td>
+    <td>Cargo</td>
+    <td>Cargo.toml</td>
+    <td>O</td>
+    <td>O</td>
+    <td>O</td>
+  </tr>
 </tbody>
 </table>
 
-
 ## 👏 Contributing Guide
 
-We always welcome your contributions.  
+We always welcome your contributions.
 Please see the [CONTRIBUTING guide](https://github.com/fosslight/fosslight_dependency_scanner/blob/main/CONTRIBUTING.md) for how to contribute.
 
-
 ## 📄 License
 
-Copyright (c) 2020 LG Electronics, Inc.  
+Copyright (c) 2020 LG Electronics, Inc.
 FOSSLight Dependency Scanner is licensed under Apache-2.0, as found in the [LICENSE](https://github.com/fosslight/fosslight_dependency_scanner/blob/main/LICENSE) file.

{fosslight_dependency-4.1.1 → fosslight_dependency-4.1.2}/setup.py

@@ -35,7 +35,7 @@ if __name__ == "__main__":
 
     setup(
         name=_PACKAEG_NAME,
-        version='4.1.1',
+        version='4.1.2',
         package_dir={"": "src"},
         packages=find_namespace_packages(where='src'),
         description='FOSSLight Dependency Scanner',

{fosslight_dependency-4.1.1 → fosslight_dependency-4.1.2}/src/fosslight_dependency/_analyze_dependency.py

@@ -19,6 +19,7 @@ from fosslight_dependency.package_manager.Go import Go
 from fosslight_dependency.package_manager.Nuget import Nuget
 from fosslight_dependency.package_manager.Helm import Helm
 from fosslight_dependency.package_manager.Unity import Unity
+from fosslight_dependency.package_manager.Cargo import Cargo
 import fosslight_util.constant as constant
 
 logger = logging.getLogger(constant.LOGGER_NAME)
@@ -57,6 +58,8 @@ def analyze_dependency(package_manager_name, input_dir, output_dir, pip_activate
         package_manager = Helm(input_dir, output_dir)
     elif package_manager_name == const.UNITY:
         package_manager = Unity(input_dir, output_dir)
+    elif package_manager_name == const.CARGO:
+        package_manager = Cargo(input_dir, output_dir)
     else:
         logger.error(f"Not supported package manager name: {package_manager_name}")
         ret = False

{fosslight_dependency-4.1.1 → fosslight_dependency-4.1.2}/src/fosslight_dependency/_help.py

@@ -24,13 +24,15 @@ _HELP_MESSAGE_DEPENDENCY = """
         Nuget (.NET)
         Helm (Kubernetes)
         Unity (Unity)
+        Cargo (Rust)
 
     Options:
         Optional
             -h\t\t\t\t    Print help message.
             -v\t\t\t\t    Print the version of the script.
             -m <package_manager>\t    Enter the package manager.
-                                        \t(npm, maven, gradle, pypi, pub, cocoapods, android, swift, carthage, go, nuget, helm)
+                                        \t(npm, maven, gradle, pypi, pub, cocoapods, android, swift, carthage,
+                                        \t go, nuget, helm, unity, cargo)
             -p <input_path>\t\t    Enter the path where the script will be run.
             -e <exclude_path>\t\t    Enter the path where the analysis will not be performed.
             -o <output_path>\t\t    Output path

{fosslight_dependency-4.1.1 → fosslight_dependency-4.1.2}/src/fosslight_dependency/_package_manager.py

@@ -286,6 +286,8 @@ def get_url_to_purl(url, pkg_manager, oss_name='', oss_version=''):
                 elif pkg_manager == 'carthage':
                     if oss_version:
                         purl = f'{purl}@{oss_version}'
+                elif pkg_manager == 'cargo':
+                    purl = f'{purl_prefix}/{oss_name}@{oss_version}'
         except Exception:
             logger.debug('Fail to get purl. So use the link purl({purl}).')
     return purl

{fosslight_dependency-4.1.1 → fosslight_dependency-4.1.2}/src/fosslight_dependency/constant.py

@@ -23,6 +23,7 @@ GO = 'go'
 NUGET = 'nuget'
 HELM = 'helm'
 UNITY = 'unity'
+CARGO = 'cargo'
 
 # Supported package name and manifest file
 SUPPORT_PACKAE = {
@@ -38,7 +39,8 @@ SUPPORT_PACKAE = {
     GO: 'go.mod',
     NUGET: ['packages.config', os.path.join('obj', 'project.assets.json')],
     HELM: 'Chart.yaml',
-    UNITY: os.path.join('Library', 'PackageManager', 'ProjectCache')
+    UNITY: os.path.join('Library', 'PackageManager', 'ProjectCache'),
+    CARGO: 'Cargo.toml'
 }
 
 # default android app name

fosslight_dependency-4.1.2/src/fosslight_dependency/package_manager/Cargo.py

@@ -0,0 +1,143 @@
+#!/usr/bin/env python
+# -*- coding: utf-8 -*-
+# Copyright (c) 2021 LG Electronics Inc.
+# SPDX-License-Identifier: Apache-2.0
+
+import os
+import logging
+import json
+import re
+import subprocess
+import fosslight_util.constant as constant
+import fosslight_dependency.constant as const
+from fosslight_dependency._package_manager import PackageManager
+from fosslight_dependency._package_manager import get_url_to_purl
+from fosslight_dependency.dependency_item import DependencyItem, change_dependson_to_purl
+from fosslight_util.oss_item import OssItem
+logger = logging.getLogger(constant.LOGGER_NAME)
+
+
+class Cargo(PackageManager):
+    package_manager_name = const.CARGO
+
+    dn_url = 'https://crates.io/crates/'
+    input_file_name = 'tmp_cargo_fosslight_output.json'
+    tmp_input_file_flag = False
+    cur_path = ''
+    cargo_lock_f = 'Cargo.lock'
+
+    def __init__(self, input_dir, output_dir):
+        super().__init__(self.package_manager_name, self.dn_url, input_dir, output_dir)
+        self.append_input_package_list_file(self.input_file_name)
+
+    def __del__(self):
+        if self.tmp_input_file_flag:
+            os.remove(self.input_file_name)
+
+    def run_plugin(self):
+        if os.path.exists(self.input_file_name):
+            logger.info(f"Found {self.input_file_name}, skip the flutter cmd to analyze dependency.")
+            return True
+
+        if not os.path.exists(const.SUPPORT_PACKAE.get(self.package_manager_name)):
+            logger.error(f"Cannot find the file({const.SUPPORT_PACKAE.get(self.package_manager_name)})")
+            return False
+
+        if os.path.exists(self.cargo_lock_f):
+            cmd = f'cargo metadata --locked --format-version 1 > {self.input_file_name}'
+        else:
+            cmd = f'cargo metadata --format-version 1 > {self.input_file_name}'
+        ret = subprocess.call(cmd, shell=True)
+        if ret != 0:
+            logger.error(f"Failed to run: {cmd}")
+            os.chdir(self.cur_path)
+            return False
+        self.tmp_input_file_flag = True
+        return True
+
+    def parse_oss_information(self, f_name):
+        json_data = ''
+
+        with open(f_name, 'r', encoding='utf8') as cargo_file:
+            json_f = json.load(cargo_file)
+        try:
+            purl_dict = {}
+            workspace_members_key = 'workspace_members'
+            resolve_key = 'resolve'
+            root_key = 'root'
+            nodes_key = 'nodes'
+            workspace_members = []
+            root = ''
+            resolve_node = []
+
+            if workspace_members_key in json_f:
+                workspace_members = json_f[workspace_members_key]
+
+            if resolve_key in json_f:
+                if root_key in json_f[resolve_key]:
+                    root = json_f[resolve_key][root_key]
+                if nodes_key in json_f[resolve_key]:
+                    resolve_node = json_f[resolve_key][nodes_key]
+                if root and resolve_node:
+                    self.direct_dep_list.extend(get_matched_dependencies(root, resolve_node))
+            else:
+                self.direct_dep = False
+                logger.info('Cannot find dependencies relationship (no resolve nodes.)')
+
+            for json_data in json_f['packages']:
+                dep_item = DependencyItem()
+                oss_item = OssItem()
+                pkg_id = json_data['id']
+                oss_origin_name = json_data['name']
+
+                oss_item.name = f"{self.package_manager_name}:{oss_origin_name}"
+                oss_item.version = json_data['version']
+                oss_item.homepage = f"{self.dn_url}{oss_origin_name}"
+                oss_item.download_location = json_data['repository']
+                if oss_item.download_location is None:
+                    oss_item.download_location = oss_item.homepage
+                dep_item.purl = get_url_to_purl(oss_item.homepage, self.package_manager_name, oss_origin_name, oss_item.version)
+                purl_dict[f'{oss_origin_name}({oss_item.version})'] = dep_item.purl
+                if json_data['license'] is not None:
+                    oss_item.license = json_data['license']
+
+                if self.direct_dep:
+                    if pkg_id == root:
+                        oss_item.comment = 'root package'
+                    if pkg_id in workspace_members:
+                        oss_item.comment = 'local package'
+                    if len(self.direct_dep_list) > 0:
+                        if pkg_id != root:
+                            if f'{oss_origin_name}({oss_item.version})' in self.direct_dep_list:
+                                oss_item.comment = 'direct'
+                            else:
+                                oss_item.comment = 'transitive'
+                    dep_item.depends_on_raw.extend(get_matched_dependencies(pkg_id, resolve_node))
+
+                dep_item.oss_items.append(oss_item)
+                self.dep_items.append(dep_item)
+        except Exception as e:
+            logger.error(f"Fail to parse pub oss information: {e}")
+        if self.direct_dep:
+            self.dep_items = change_dependson_to_purl(purl_dict, self.dep_items)
+
+        return
+
+
+def get_matched_dependencies(match_id, resolve_node):
+    dependencies_list = []
+    for node in resolve_node:
+        if match_id == node['id']:
+            for dep_pkg in node['dependencies']:
+                try:
+                    match = re.findall(r'^.*#(\S*)@(\S*)', dep_pkg)
+                    dependencies_list.append(f'{match[0][0]}({match[0][1]})')
+                except:
+                    try:
+                        match = re.findall(r'^(\S*)\s(\S*)\s', dep_pkg)
+                        dependencies_list.append(f'{match[0][0]}({match[0][1]})')
+                    except:
+                        logger.info(f'cannot find name and version for dependencies: {match_id}')
+                        pass
+            break
+    return dependencies_list

{fosslight_dependency-4.1.1 → fosslight_dependency-4.1.2}/src/fosslight_dependency/run_dependency_scanner.py

@@ -156,7 +156,7 @@ def run_dependency_scanner(package_manager='', input_dir='', output_dir_file='',
         support_packagemanager = list(const.SUPPORT_PACKAE.keys())
 
         if package_manager not in support_packagemanager:
-            logger.error(f"You entered the unsupported package manager({package_manager}).")
+            logger.error(f"(-m option) You entered the unsupported package manager({package_manager}).")
             logger.error("Please enter the supported package manager({0}) with '-m' option."
                          .format(", ".join(support_packagemanager)))
             return False, scan_item
@@ -166,7 +166,7 @@ def run_dependency_scanner(package_manager='', input_dir='', output_dir_file='',
             os.chdir(input_dir)
             input_dir = os.getcwd()
         else:
-            logger.error(f"You entered the wrong input path({input_dir}) to run the script.")
+            logger.error(f"(-p option) You entered the wrong input path({input_dir}) to run the script.")
             logger.error("Please enter the existed input path with '-p' option.")
             return False, scan_item
     else:

{fosslight_dependency-4.1.1 → fosslight_dependency-4.1.2}/src/fosslight_dependency.egg-info/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: fosslight-dependency
-Version: 4.1.1
+Version: 4.1.2
 Summary: FOSSLight Dependency Scanner
 Home-page: https://github.com/fosslight/fosslight_dependency_scanner
 Author: LG Electronics
@@ -10,23 +10,22 @@ Description: <!--
         Copyright (c) 2021 LG Electronics
         SPDX-License-Identifier: Apache-2.0
          -->
-        # FOSSLight Dependency Scanner
         
-        <img src="https://img.shields.io/pypi/l/fosslight_dependency" alt="License" /> <a href="https://pypi.org/project/fosslight-dependency/"><img src="https://img.shields.io/pypi/v/fosslight_dependency" alt="Current python package version." /></a> <img src="https://img.shields.io/pypi/pyversions/fosslight_dependency" /> [![REUSE status](https://api.reuse.software/badge/github.com/fosslight/fosslight_dependency_scanner)](https://api.reuse.software/info/github.com/fosslight/fosslight_dependency_scanner)
+        # FOSSLight Dependency Scanner
         
+        `<img src="https://img.shields.io/pypi/l/fosslight_dependency" alt="License" />` `<a href="https://pypi.org/project/fosslight-dependency/"><img src="https://img.shields.io/pypi/v/fosslight_dependency" alt="Current python package version." />``</a>` `<img src="https://img.shields.io/pypi/pyversions/fosslight_dependency" />` [![REUSE status](https://api.reuse.software/badge/github.com/fosslight/fosslight_dependency_scanner)](https://api.reuse.software/info/github.com/fosslight/fosslight_dependency_scanner)
         
         ## 💡 Introduction
         
         This is the tool that supports the analysis of dependencies for multiple package managers. It detects the manifest file of package managers automatically and analyzes the dependencies with using open source tools. Then, it generates the report file that contains OSS information of dependencies.
         
-        
         ## 📖 User Guide
         
-        We describe the user guide in the [**FOSSLight Guide page**](https://fosslight.org/fosslight-guide-en/scanner/3_dependency.html).  
+        We describe the user guide in the [**FOSSLight Guide page**](https://fosslight.org/fosslight-guide-en/scanner/3_dependency.html).
         In this user guide, you can see how to install the FOSSLight Dependency Scanner and how to set up the prerequisite step and run it according to the package manager of your project. Also, you can check the results of the FOSSLight Dependency Scanner.
         
-        
         ## 👀 Package Support Level
+        
         <table>
         <thead>
           <tr>
@@ -141,19 +140,25 @@ Description: <!--
             <td>O</td>
             <td>X</td>
           </tr>
+          <tr>
+            <td>Rust</td>
+            <td>Cargo</td>
+            <td>Cargo.toml</td>
+            <td>O</td>
+            <td>O</td>
+            <td>O</td>
+          </tr>
         </tbody>
         </table>
         
-        
         ## 👏 Contributing Guide
         
-        We always welcome your contributions.  
+        We always welcome your contributions.
         Please see the [CONTRIBUTING guide](https://github.com/fosslight/fosslight_dependency_scanner/blob/main/CONTRIBUTING.md) for how to contribute.
         
-        
         ## 📄 License
         
-        Copyright (c) 2020 LG Electronics, Inc.  
+        Copyright (c) 2020 LG Electronics, Inc.
         FOSSLight Dependency Scanner is licensed under Apache-2.0, as found in the [LICENSE](https://github.com/fosslight/fosslight_dependency_scanner/blob/main/LICENSE) file.
         
 Platform: UNKNOWN

{fosslight_dependency-4.1.1 → fosslight_dependency-4.1.2}/src/fosslight_dependency.egg-info/SOURCES.txt

@@ -22,6 +22,7 @@ src/fosslight_dependency.egg-info/entry_points.txt
 src/fosslight_dependency.egg-info/requires.txt
 src/fosslight_dependency.egg-info/top_level.txt
 src/fosslight_dependency/package_manager/Android.py
+src/fosslight_dependency/package_manager/Cargo.py
 src/fosslight_dependency/package_manager/Carthage.py
 src/fosslight_dependency/package_manager/Cocoapods.py
 src/fosslight_dependency/package_manager/Go.py