check-dependencies 0.9.0__tar.gz

check_dependencies-0.9.0/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2023 Micha Schoell
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE

check_dependencies-0.9.0/PKG-INFO

@@ -0,0 +1,125 @@
+Metadata-Version: 2.1
+Name: check-dependencies
+Version: 0.9.0
+Summary: 
+Author: Micha Scholl
+Author-email: schollm-git@gmx.com
+Requires-Python: >=3.8
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.8
+Classifier: Programming Language :: Python :: 3.9
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Requires-Dist: toml
+Description-Content-Type: text/markdown
+
+# Check Dependencies
+Check all imports from python files and compares them against the declared imports of a pyproject dependency list of expected imports. 
+It can be used as a stand-alone or as part of a CI/CD to check if an application has all the necessary, but no superfluous imports.
+
+## Usage
+```commandline
+usage: check_imports [-h] [--config-file CONFIG_FILE] [--include-dev] [--verbose] [--all] [--extra EXTRA] [--ignore IGNORE] file_name [file_name ...]
+
+Find undeclared and unused (or all) imports in Python files
+
+positional arguments:
+  file_name             Python Source file to analyse
+
+optional arguments:
+  -h, --help            show this help message and exit
+  --config-file CONFIG_FILE
+                        Location of pyproject.toml file, can be file or a directory containing pyproject.toml file
+  --include-dev         Include dev dependencies
+  --verbose             Show every import of a package
+  --all                 Show all imports (including correct ones)
+  --extra EXTRA         Comma seperated list of extra requirements. Assume they are part of the requirements
+  --ignore IGNORE       Comma seperated list of requirements to ignore. Assume they are not part of the requirements
+```
+
+```commandline
+> python -m  --config-file --all project/ project/src/**/*.py
+  pandas
+! matplotlib
+  numpy
++ requests
+
+> python -m check_dependencies --config-file --verbose project/ project/src/**/*.py
+!NA matplotlib project/src/main.py:4
++EXTRA project/pyproject.toml requests 
+
+> python -m check_dependencies --config-file --verbose --all project/ project/src/**/*.py
+ OK project/src/data.py:5 pandas
+ OK project/src/main.py:3 pandas
+ OK project/src/plotting.py:4 pandas
+!NA project/src/plotting.py:5 matplotlib
+ OK project/src/plotting.py:6 numpy
+ 
+ **** Dependencies in config file not used in application:
++EXTRA project/pyproject.toml requests 
+
+```
+
+### Configuration
+The configuration is read from `pyproject.toml` file. The configuration file
+supports two entries, `[tool.check_dependencies.extra-requirements]` that can be used to
+add extra dependencies to the list of requirements to be treated as existing
+requirements.
+The second entry, `[tool.check_dependencies.ignore-requirements]` does the opposite, it will
+ignore extra requirements that are not used in the application.
+
+```toml
+[tool.check_dependencies]
+extra-requirements = [
+  undeclared_package,
+  another_package
+]
+ignore-requirements = [
+  package_as_extra_for_another_package,
+  yet_another_package
+]
+```
+
+### Output
+The output is a list of imports with a prefix indicating the status of the import.
+- `!` - Undeclared import
+- `+` - Extra import, declared in pyproject.toml, but not used in the file
+- `  ` - Correct import (only shown with `--all`)
+
+In case of `--verbose`, the output is a list of all imports in the file, prefixed with:
+- `!NA` - Undeclared import
+- `+EXTRA` - Extra import, declared in pyproject.toml, but not used in the file
+- `  OK` - Correct import (only shown with `--all`)
+
+In case of `--verbose`, each import is prefixed with the file name and line number
+where it is declared. 
+
+#### Exit code
+- 0: No missing or superfluous dependencies found
+- 2: Missing (used, but not declared in pyproject.toml) dependencies found
+- 4: Extra (declared in pyproject.toml, but unused) dependencies found
+- 6: Both missing and superfluous dependencies found
+- 1: Another error occured
+
+
+## Development
+Feature requests and merge requests are welcome. For major changes, please open an 
+issue first to discuss what you would like to change.
+
+Please make sure to update tests as appropriate. Also with this project, I want
+to keep the dependencies to a minimum, so please keep that in mind when proposing
+a change. Currently, the only dependencies is `toml` to support Python 3.10 and below.
+
+### Coding Standards
+
+| **Type**      | Package  | Comment                         |
+|---------------|----------|---------------------------------|
+| **Linter**    | `black`  | Also for auto-formatted modules |
+| **Logging**   | `logger` | Minimize additional packages    |
+| **Packaging** | `poetry` |                                 |
+| **Tests**     | `pytest` |                                 |
+| **Typing**    | `mypy`   | Type all methods                |
+| **Linting**   | `flake8` |                 |
+| **Imports**   | `isort`  |                                 |
+

check_dependencies-0.9.0/README.md

@@ -0,0 +1,108 @@
+# Check Dependencies
+Check all imports from python files and compares them against the declared imports of a pyproject dependency list of expected imports. 
+It can be used as a stand-alone or as part of a CI/CD to check if an application has all the necessary, but no superfluous imports.
+
+## Usage
+```commandline
+usage: check_imports [-h] [--config-file CONFIG_FILE] [--include-dev] [--verbose] [--all] [--extra EXTRA] [--ignore IGNORE] file_name [file_name ...]
+
+Find undeclared and unused (or all) imports in Python files
+
+positional arguments:
+  file_name             Python Source file to analyse
+
+optional arguments:
+  -h, --help            show this help message and exit
+  --config-file CONFIG_FILE
+                        Location of pyproject.toml file, can be file or a directory containing pyproject.toml file
+  --include-dev         Include dev dependencies
+  --verbose             Show every import of a package
+  --all                 Show all imports (including correct ones)
+  --extra EXTRA         Comma seperated list of extra requirements. Assume they are part of the requirements
+  --ignore IGNORE       Comma seperated list of requirements to ignore. Assume they are not part of the requirements
+```
+
+```commandline
+> python -m  --config-file --all project/ project/src/**/*.py
+  pandas
+! matplotlib
+  numpy
++ requests
+
+> python -m check_dependencies --config-file --verbose project/ project/src/**/*.py
+!NA matplotlib project/src/main.py:4
++EXTRA project/pyproject.toml requests 
+
+> python -m check_dependencies --config-file --verbose --all project/ project/src/**/*.py
+ OK project/src/data.py:5 pandas
+ OK project/src/main.py:3 pandas
+ OK project/src/plotting.py:4 pandas
+!NA project/src/plotting.py:5 matplotlib
+ OK project/src/plotting.py:6 numpy
+ 
+ **** Dependencies in config file not used in application:
++EXTRA project/pyproject.toml requests 
+
+```
+
+### Configuration
+The configuration is read from `pyproject.toml` file. The configuration file
+supports two entries, `[tool.check_dependencies.extra-requirements]` that can be used to
+add extra dependencies to the list of requirements to be treated as existing
+requirements.
+The second entry, `[tool.check_dependencies.ignore-requirements]` does the opposite, it will
+ignore extra requirements that are not used in the application.
+
+```toml
+[tool.check_dependencies]
+extra-requirements = [
+  undeclared_package,
+  another_package
+]
+ignore-requirements = [
+  package_as_extra_for_another_package,
+  yet_another_package
+]
+```
+
+### Output
+The output is a list of imports with a prefix indicating the status of the import.
+- `!` - Undeclared import
+- `+` - Extra import, declared in pyproject.toml, but not used in the file
+- `  ` - Correct import (only shown with `--all`)
+
+In case of `--verbose`, the output is a list of all imports in the file, prefixed with:
+- `!NA` - Undeclared import
+- `+EXTRA` - Extra import, declared in pyproject.toml, but not used in the file
+- `  OK` - Correct import (only shown with `--all`)
+
+In case of `--verbose`, each import is prefixed with the file name and line number
+where it is declared. 
+
+#### Exit code
+- 0: No missing or superfluous dependencies found
+- 2: Missing (used, but not declared in pyproject.toml) dependencies found
+- 4: Extra (declared in pyproject.toml, but unused) dependencies found
+- 6: Both missing and superfluous dependencies found
+- 1: Another error occured
+
+
+## Development
+Feature requests and merge requests are welcome. For major changes, please open an 
+issue first to discuss what you would like to change.
+
+Please make sure to update tests as appropriate. Also with this project, I want
+to keep the dependencies to a minimum, so please keep that in mind when proposing
+a change. Currently, the only dependencies is `toml` to support Python 3.10 and below.
+
+### Coding Standards
+
+| **Type**      | Package  | Comment                         |
+|---------------|----------|---------------------------------|
+| **Linter**    | `black`  | Also for auto-formatted modules |
+| **Logging**   | `logger` | Minimize additional packages    |
+| **Packaging** | `poetry` |                                 |
+| **Tests**     | `pytest` |                                 |
+| **Typing**    | `mypy`   | Type all methods                |
+| **Linting**   | `flake8` |                 |
+| **Imports**   | `isort`  |                                 |

check_dependencies-0.9.0/pyproject.toml

@@ -0,0 +1,33 @@
+[tool.poetry]
+name = "check-dependencies"
+version = "0.9.0"
+description = ""
+authors = ["Micha Scholl <schollm-git@gmx.com>"]
+readme = "README.md"
+
+[tool.poetry.dependencies]
+python = ">=3.8"
+toml = "*"
+
+[tool.poetry.group.dev.dependencies]
+pytest = "^6.2"
+mypy = "^1.10.0"
+black = "^24.4.2"
+isort = "^5.13.2"
+pylint = "^3.2.3"
+pytest-cov = "^5.0.0"
+
+[build-system]
+requires = ["poetry-core"]
+build-backend = "poetry.core.masonry.api"
+
+[tool.black]
+line-length = 88
+target-version = ['py39']
+
+[tool.isort]
+sections = ['FUTURE', 'STDLIB', 'THIRDPARTY', 'FIRSTPARTY', 'LOCALFOLDER']
+multi_line_output = 3
+line_length = 88
+include_trailing_comma = 'True'
+profile = "black"

check_dependencies-0.9.0/src/check_dependencies/__main__.py

@@ -0,0 +1,84 @@
+"""CLI entry point for check_dependencies."""
+
+import argparse
+import logging
+import sys
+
+from check_dependencies.lib import Config
+from check_dependencies.main import yield_wrong_imports
+
+logging.basicConfig(
+    level=logging.INFO,
+    format="%(filename)s: "
+    "%(levelname)-8s: "
+    "%(funcName)s(): "
+    "%(lineno)d:\t"
+    "%(message)s",
+)
+
+parser = argparse.ArgumentParser(
+    "check_dependencies",
+    description="Find undeclared and unused (or all) imports in Python files",
+    add_help=True,
+)
+
+parser.add_argument(
+    "file_name", type=str, nargs="+", help="Python Source file to analyse"
+)
+parser.add_argument(
+    "--config-file",
+    type=str,
+    required=False,
+    default="",
+    help="Location of pyproject.toml file, can be file or a directory"
+    " containing pyproject.toml file",
+)
+parser.add_argument(
+    "--include-dev",
+    action="store_true",
+    default=False,
+    help="Include dev dependencies",
+)
+parser.add_argument(
+    "--verbose",
+    action="store_true",
+    default=False,
+    help="Show every import of a package",
+)
+parser.add_argument(
+    "--all",
+    action="store_true",
+    default=False,
+    help="Show all imports (including correct ones)",
+)
+parser.add_argument(
+    "--extra",
+    type=str,
+    help="Comma seperated list of extra requirements."
+    " Assume they are part of the requirements",
+    default="",
+)
+parser.add_argument(
+    "--ignore",
+    type=str,
+    help="Comma seperated list of requirements to ignore."
+    " Assume they are not part of the requirements",
+    default="",
+)
+args = parser.parse_args()
+
+cfg = Config(
+    file=args.config_file,
+    include_dev=args.include_dev,
+    verbose=args.verbose,
+    show_all=args.all,
+    extra_requirements=args.extra.split(","),
+    ignore_requirements=args.ignore.split(","),
+)
+
+wrong_import_lines = yield_wrong_imports(args.file_name, cfg)
+try:
+    while True:
+        print(next(wrong_import_lines))
+except StopIteration as ex:  # Return value is the exit status
+    sys.exit(ex.value)

check_dependencies-0.9.0/src/check_dependencies/builtin_module.py

@@ -0,0 +1,329 @@
+"""A list of all builtin modules"""
+
+from __future__ import annotations
+
+import sys
+
+BUILTINS: set[str]
+if sys.version_info >= (3, 10):
+    BUILTINS = set(sys.stdlib_module_names)  # pylint: disable=no-member
+else:
+    # Use the list of builtins from Python 3.9
+    BUILTINS = set(
+        """\
+__future__
+_abc
+_aix_support
+_ast
+_asyncio
+_bisect
+_blake2
+_bootlocale
+_bootsubprocess
+_bz2
+_codecs
+_codecs_cn
+_codecs_hk
+_codecs_iso2022
+_codecs_jp
+_codecs_kr
+_codecs_tw
+_collections
+_collections_abc
+_compat_pickle
+_compression
+_contextvars
+_crypt
+_csv
+_ctypes
+_ctypes_test
+_curses
+_curses_panel
+_datetime
+_dbm
+_decimal
+_distutils_hack
+_elementtree
+_functools
+_gdbm
+_hashlib
+_heapq
+_imp
+_io
+_json
+_locale
+_lsprof
+_lzma
+_markupbase
+_md5
+_multibytecodec
+_multiprocessing
+_opcode
+_operator
+_osx_support
+_peg_parser
+_pickle
+_posixshmem
+_posixsubprocess
+_py_abc
+_pydecimal
+_pyio
+_queue
+_random
+_scproxy
+_sha1
+_sha256
+_sha3
+_sha512
+_signal
+_sitebuiltins
+_socket
+_sqlite3
+_sre
+_ssl
+_stat
+_statistics
+_string
+_strptime
+_struct
+_symtable
+_sysconfigdata__darwin_darwin
+_testbuffer
+_testcapi
+_testimportmultiple
+_testinternalcapi
+_testmultiphase
+_thread
+_threading_local
+_tkinter
+_tracemalloc
+_uuid
+_virtualenv
+_warnings
+_weakref
+_weakrefset
+_xxsubinterpreters
+_xxtestfuzz
+_zoneinfo
+abc
+aifc
+antigravity
+argparse
+array
+ast
+asynchat
+asyncio
+asyncore
+atexit
+audioop
+base64
+bdb
+binascii
+binhex
+bisect
+builtins
+bz2
+cProfile
+calendar
+cgi
+cgitb
+chunk
+cmath
+cmd
+code
+codecs
+codeop
+collections
+colorsys
+compileall
+concurrent
+configparser
+contextlib
+contextvars
+copy
+copyreg
+crypt
+csv
+ctypes
+curses
+dataclasses
+datetime
+dbm
+decimal
+difflib
+dis
+distutils
+doctest
+email
+encodings
+ensurepip
+enum
+errno
+faulthandler
+fcntl
+filecmp
+fileinput
+fnmatch
+formatter
+fractions
+ftplib
+functools
+gc
+genericpath
+getopt
+getpass
+gettext
+glob
+graphlib
+grp
+gzip
+hashlib
+heapq
+hmac
+html
+http
+idlelib
+imaplib
+imghdr
+imp
+importlib
+inspect
+io
+ipaddress
+itertools
+json
+keyword
+lib2to3
+linecache
+locale
+logging
+lzma
+mailbox
+mailcap
+marshal
+math
+memray
+mimetypes
+mmap
+modulefinder
+multiprocessing
+netrc
+nis
+nntplib
+ntpath
+nturl2path
+numbers
+opcode
+operator
+optparse
+os
+parser
+pathlib
+pdb
+pickle
+pickletools
+pip
+pipes
+pkg_resources
+pkgutil
+platform
+plistlib
+poplib
+posix
+posixpath
+pprint
+profile
+pstats
+pty
+pwd
+py_compile
+pyclbr
+pydoc
+pydoc_data
+pyexpat
+queue
+quopri
+random
+re
+readline
+reprlib
+resource
+rlcompleter
+runpy
+sched
+secrets
+select
+selectors
+setuptools
+shelve
+shlex
+shutil
+signal
+site
+smtpd
+smtplib
+sndhdr
+socket
+socketserver
+sqlite3
+sre_compile
+sre_constants
+sre_parse
+ssl
+stat
+statistics
+string
+stringprep
+struct
+subprocess
+sunau
+symbol
+symtable
+sys
+sysconfig
+syslog
+tabnanny
+tarfile
+telnetlib
+tempfile
+termios
+test
+textwrap
+this
+threading
+time
+timeit
+tkinter
+token
+tokenize
+trace
+traceback
+tracemalloc
+tty
+turtle
+turtledemo
+types
+typing
+unicodedata
+unittest
+urllib
+uu
+uuid
+venv
+warnings
+wave
+weakref
+webbrowser
+wheel
+wsgiref
+xdrlib
+xml
+xmlrpc
+xxlimited
+xxsubtype
+zipapp
+zipfile
+zipimport
+zlib
+zoneinfo""".split()
+    )

check_dependencies-0.9.0/src/check_dependencies/lib.py

@@ -0,0 +1,144 @@
+"""
+Library for check_dependencies
+"""
+
+from __future__ import annotations
+
+import ast
+import logging
+from dataclasses import dataclass
+from enum import Enum
+from pathlib import Path
+from typing import Any, Callable, List, Optional, Sequence, cast
+
+import toml
+
+logger = logging.getLogger("check_dependencies.lib")
+
+
+class Dependency(Enum):
+    """Possible depdendency state"""
+
+    NA = "!"  # Not Available
+    EXTRA = "+"  # Extra dependency in config file
+    OK = " "  # Correct import (declared in config file)
+
+
+@dataclass()
+class Config:
+    """Application config and helper functions"""
+
+    file: Optional[str] = None
+    include_dev: bool = False
+    verbose: bool = False
+    show_all: bool = False
+    extra_requirements: Sequence[str] = ()
+    ignore_requirements: Sequence[str] = ()
+
+    def __post_init__(self) -> None:
+        self.extra_requirements = list(filter(None, self.extra_requirements or []))
+        self.ignore_requirements = list(filter(None, self.ignore_requirements or []))
+        if self.file and Path(self.file).is_dir():
+            self.file = (Path(self.file) / "pyproject.toml").as_posix()
+        if self.file:
+            try:
+                cfg = toml.load(Path(self.file))
+            except FileNotFoundError:
+                logger.fatal("Could not find config file: %s. Set to None", self.file)
+                raise
+
+            extra_cfg = _nested_item(cfg, "tool.check_dependencies.extra-requirements")
+            self.extra_requirements += cast(List[str], list(extra_cfg or []))
+
+            ignore_cfg = _nested_item(
+                cfg, "tool.check_dependencies.ignore-requirements"
+            )
+            self.ignore_requirements += cast(List[str], list(ignore_cfg))
+        else:
+            logger.info("Config file unset, showing all imports")
+            self.show_all = True
+            self.include_dev = False
+            self.include_dev = False
+            self.ignore_requirements = ()
+            self.extra_requirements = ()
+
+    def get_declared_dependencies(self) -> set[str]:
+        """
+        Get dependencies from pyproject.toml file.
+        ! Currently only poetry style dependencies are supported
+        """
+        if not self.file:
+            return set()
+        if (cfg_pth := Path(self.file)).is_dir():
+            cfg_pth /= "pyproject.toml"
+        try:
+            cfg = toml.load(cfg_pth)
+        except FileNotFoundError:
+            return set()
+
+        deps = set(_nested_item(cfg, "tool.poetry.dependencies"))
+        if self_name := _nested_item(cfg, "tool.poetry.name"):
+            cast(List[str], self.extra_requirements).append(_canonical_pkg(self_name))
+        if self.include_dev:
+            deps |= set(_nested_item(cfg, "tool.poetry.group.dev.dependencies"))
+            deps |= set(_nested_item(cfg, "tool.poetry.dev-dependencies"))
+        return {_canonical_pkg(x) for x in deps} - {"python"}
+
+    def mk_src_formatter(
+        self,
+    ) -> Callable[[str, Dependency, str, Optional[ast.stmt]], Optional[str]]:
+        """Formatter for missing or used dependencies"""
+        cache: set[str] = set()
+
+        def src_cause_formatter(
+            file: str, cause: Dependency, module: str, stmt: Optional[ast.stmt]
+        ) -> Optional[str]:
+            if not self.file:
+                if self.verbose:
+                    location = f"{file}:{getattr(stmt, 'lineno', -1)}"
+                    return f"{location} {module}"
+                if (pkg_ := pkg(module)) not in cache:
+                    cache.add(pkg_)
+                    return pkg_
+            if self.verbose:
+                location = f"{file}:{getattr(stmt, 'lineno', -1)}"
+                cause_str = f"{cause.value}{cause.name}" if self.file else ""
+                if self.show_all or not self.file or cause == Dependency.NA:
+                    return f"{cause_str} {location} {module}"
+            else:
+                if (pkg_ := pkg(module)) not in cache:
+                    cache.add(pkg_)
+                    cause_str = cause.value if self.file else " "
+                    if self.show_all or not self.file or cause == Dependency.NA:
+                        return f"{cause_str} {pkg_}"
+            return None
+
+        return src_cause_formatter
+
+    def mk_unused_formatter(self) -> Callable[[str], Optional[str]]:
+        """Formatter for unused but declared dependencies"""
+
+        def unused_formatter(module: str) -> Optional[str]:
+            if not self.file:
+                return None
+            if self.verbose:
+                return f"{Dependency.EXTRA.value}{Dependency.EXTRA.name} {module}"
+            return f"{Dependency.EXTRA.value} {module}"
+
+        return unused_formatter
+
+
+def pkg(module: str) -> str:
+    """Get the installable module name from an import statement"""
+    return module.split(".")[0]
+
+
+def _nested_item(obj: dict[str, Any], keys: str) -> Any:
+    """Get items from a nested dictionary where the keys are dot-separated"""
+    for a in keys.split("."):
+        obj = obj.get(a, {})
+    return obj
+
+
+def _canonical_pkg(name: str) -> str:
+    return name.replace("-", "_")

check_dependencies-0.9.0/src/check_dependencies/main.py

@@ -0,0 +1,105 @@
+"""Main module for check_dependencies"""
+
+from __future__ import annotations
+
+import ast
+import logging
+from pathlib import Path
+from typing import Generator, Iterator, Sequence
+
+from check_dependencies.builtin_module import BUILTINS
+from check_dependencies.lib import Config, Dependency, pkg
+
+logger = logging.getLogger("check_dependencies")
+
+
+def yield_wrong_imports(
+    file_names: Sequence[str], cfg: Config
+) -> Generator[str, None, int]:
+    """Yield output lines of missing/unused imports (or all imports in case of cfg.show_all)"""
+    declared_deps = cfg.get_declared_dependencies()
+    used_deps: set[str] = set()
+    missing_fmt = cfg.mk_src_formatter()
+    exit_status = 0
+    for file_name in _collect_files(file_names):
+        for cause, module, stmt in _missing_imports_iter(
+            Path(file_name),
+            declared_deps | BUILTINS | set(cfg.extra_requirements),
+            seen=used_deps,
+        ):
+            if cause != Dependency.OK:
+                exit_status |= 2
+            used_deps.add(pkg(module))
+            if f := missing_fmt(file_name, cause, module, stmt):
+                yield f
+
+    if cfg.file:
+        unused_fmt = cfg.mk_unused_formatter()
+        errs = [
+            err
+            for dep in sorted(declared_deps - used_deps - set(cfg.ignore_requirements))
+            if (err := unused_fmt(dep))
+        ]
+        if errs:
+            exit_status |= 4
+            if cfg.verbose:
+                yield ""
+                yield "### Dependencies in config file not used in application:"
+                yield f"# Config file: {cfg.file}"
+            yield from errs
+    return exit_status
+
+
+def _collect_files(file_names: Sequence[str]) -> Iterator[str]:
+    """
+    Collect all Python files in a list of files or directories.
+    Ensure no file is visited more than once
+    """
+    seen = set()
+    for p in map(Path, file_names):
+        if (p_resolved := p.resolve()) in seen:
+            continue
+        seen.add(p_resolved)
+        if p.is_dir():
+            for p_sub in p.rglob("*.py"):
+                if (p_sub_resolved := p_sub.resolve()) in seen:
+                    continue
+                seen.add(p_sub_resolved)
+                yield p_sub.as_posix()
+        else:
+            yield p.as_posix()
+
+
+def _missing_imports_iter(
+    file: Path, dependencies: set[str], seen: set[str]
+) -> Iterator[tuple[Dependency, str, ast.stmt]]:
+    """
+    Find missing imports in a Python file
+    :param file: Pyton file to analyse
+    :param dependencies: Declared dependencies
+    :param seen: Cache of seen packages - this is changed during the iteration
+    :yields: Tuple of status, module name and optional import statement
+    """
+    try:
+        parsed = ast.parse(file.read_text(), filename=str(file))
+    except SyntaxError as exc:
+        logger.error("Could not parse %s: %s", file, exc)
+        return
+    for module, stmt in _imports_iter(parsed.body):
+        pkg_ = pkg(module)
+        status = Dependency.OK if pkg_ in dependencies else Dependency.NA
+        seen.add(pkg_)
+        yield status, module, stmt
+
+
+def _imports_iter(body: list[ast.stmt]) -> Iterator[tuple[str, ast.stmt]]:
+    """Yield all import statements from a body of code"""
+    for x in body:
+        if isinstance(x, ast.Import):
+            for alias in x.names:
+                yield alias.name, x  # yield x, not alias to get lineno
+        elif isinstance(x, ast.ImportFrom) and x.level == 0:
+            # level > 0 means relative import
+            yield x.module or "", x
+        elif hasattr(x, "body"):
+            yield from _imports_iter(x.body)