PyReprism 0.0.3__tar.gz → 0.0.4__tar.gz

{pyreprism-0.0.3 → pyreprism-0.0.4}/CONTRIBUTING.md

@@ -61,5 +61,5 @@ When you're finished with the changes, create a pull request, also known as a PR
 
 ### Your PR is merged!
 
-Congratulations :tada::tada: <br />
+Congratulations :tada: :tada: <br />
 The PyReprism team thanks you :sparkles:.

pyreprism-0.0.4/PKG-INFO

@@ -0,0 +1,98 @@
+Metadata-Version: 2.3
+Name: PyReprism
+Version: 0.0.4
+Summary: Framework for Source Code Preprocessing
+Project-URL: Homepage, https://github.com/unlv-evol/PyReprism
+Project-URL: Documentation, https://pyreprism.readthedocs.io
+Project-URL: Issues, https://github.com/unlv-evol/PyReprism/issues
+Author-email: UNLV EVOL LAB <ogenrwot@unlv.nevada.edu>
+License: MIT License
+        
+        Copyright (c) 2024 UNLV EVOL
+        
+        Permission is hereby granted, free of charge, to any person obtaining a copy
+        of this software and associated documentation files (the "Software"), to deal
+        in the Software without restriction, including without limitation the rights
+        to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+        copies of the Software, and to permit persons to whom the Software is
+        furnished to do so, subject to the following conditions:
+        
+        The above copyright notice and this permission notice shall be included in all
+        copies or substantial portions of the Software.
+        
+        THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+        IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+        FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+        AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+        LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+        OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+        SOFTWARE.
+License-File: LICENSE
+Classifier: Development Status :: 5 - Production/Stable
+Classifier: Environment :: Console
+Classifier: Intended Audience :: Developers
+Classifier: Intended Audience :: Science/Research
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Operating System :: OS Independent
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.12
+Requires-Python: >=3.6
+Provides-Extra: dev
+Requires-Dist: flake8; extra == 'dev'
+Requires-Dist: pytest; extra == 'dev'
+Requires-Dist: pytest-cov; extra == 'dev'
+Description-Content-Type: text/x-rst
+
+.. _intro_toplevel:
+
+==================
+Overview / Install
+==================
+
+PyReprism is a Python framework that helps researchers and developers the task of source code preprocessing. With PyReprism, you can easily match, extract, count, and remove comments, whitespaces, operators, numbers and other language specific constructs from over 150 programming languages and file extensions.
+
+
+Requirements
+============
+
+* `Python`_ 3.6 or newer
+* `Git`_
+
+.. _Python: https://www.python.org
+.. _Git: https://git-scm.com/
+
+Installing PyReprism
+====================
+
+Installing PyReprism is easily done using `pip`_. Assuming it is installed, just run the following from the command-line:
+
+.. _pip: https://pip.pypa.io/en/latest/installing.html
+
+.. sourcecode:: none
+
+    $ pip install PyReprism
+
+Source Code
+===========
+
+PyReprism's git repo is available on GitHub, which can be browsed at:
+
+ * https://github.com/unlv-evol/PyReprism.git
+
+and cloned using::
+
+    $ git clone https://github.com/unlv-evol/PyReprism.git
+    $ cd PyReprism
+
+Optionally (but suggested), make use of virtual environment. Therefore, before installing the requirements run::
+    
+    $ python3 -m venv venv
+    $ source venv/bin/activate
+
+Install the requirements::
+    
+    $ pip install -r requirements.txt
+
+and run the tests using pytest::
+
+    $ pytest

{pyreprism-0.0.3 → pyreprism-0.0.4}/README.md

@@ -4,11 +4,16 @@
 [![FOSSA Status](https://app.fossa.com/api/projects/custom%2B46484%2Fgithub.com%2Funlv-evol%2FPyReprism.svg?type=shield&issueType=security)](https://app.fossa.com/projects/custom%2B46484%2Fgithub.com%2Funlv-evol%2FPyReprism?ref=badge_shield&issueType=security)
 [![Documentation Status](https://readthedocs.org/projects/pyreprism/badge/?version=latest)](https://pyreprism.readthedocs.io/en/latest/?badge=latest)
 ![PyPI - Python Version](https://img.shields.io/pypi/pyversions/PyReprism)
-<!-- [![codecov](https://codecov.io/gh/unlv-evol/PyReprism/graph/badge.svg?token=J2JV31837H)](https://codecov.io/gh/unlv-evol/PyReprism) -->
+![CI](https://github.com/unlv-evol/PyReprism/actions/workflows/ci.yml/badge.svg)
+![Publish](https://github.com/unlv-evol/PyReprism/actions/workflows/publish.yml/badge.svg)
+[![codecov](https://codecov.io/gh/unlv-evol/PyReprism/graph/badge.svg?token=J2JV31837H)](https://codecov.io/gh/unlv-evol/PyReprism)
+![PyPI - Version](https://img.shields.io/pypi/v/pyreprism)
+![GitHub last commit (branch)](https://img.shields.io/github/last-commit/unlv-evol/pyreprism/main)
+[![SWH](https://archive.softwareheritage.org/badge/origin/https://pypi.org/project/PyReprism//)](https://archive.softwareheritage.org/browse/origin/?origin_url=https://pypi.org/project/PyReprism/)
 
 # PyReprism
 
-PyReprism is a suite of essential methods designed for common preprocessing tasks in code clone detection research.
+PyReprism is a Python framework that helps researchers and developers the task of source code preprocessing. With PyReprism, you can easily match, extract, count, and remove comments, whitespaces, operators, numbers and other language specific constructs from over **150 programming languages and file extensions**.
 
 ## Install
 ```shell

pyreprism-0.0.3/requirements.txt → pyreprism-0.0.4/dev-requirements.txt

@@ -4,4 +4,6 @@ pytest-cov
 build
 twine
 hatchling
-hatch-vcs
+hatch-vcs
+sphinx
+sphinx_rtd_theme

pyreprism-0.0.4/docs/intro.rst

@@ -0,0 +1,53 @@
+.. _intro_toplevel:
+
+==================
+Overview / Install
+==================
+
+PyReprism is a Python framework that helps researchers and developers the task of source code preprocessing. With PyReprism, you can easily match, extract, count, and remove comments, whitespaces, operators, numbers and other language specific constructs from over 150 programming languages and file extensions.
+
+
+Requirements
+============
+
+* `Python`_ 3.6 or newer
+* `Git`_
+
+.. _Python: https://www.python.org
+.. _Git: https://git-scm.com/
+
+Installing PyReprism
+====================
+
+Installing PyReprism is easily done using `pip`_. Assuming it is installed, just run the following from the command-line:
+
+.. _pip: https://pip.pypa.io/en/latest/installing.html
+
+.. sourcecode:: none
+
+    $ pip install PyReprism
+
+Source Code
+===========
+
+PyReprism's git repo is available on GitHub, which can be browsed at:
+
+ * https://github.com/unlv-evol/PyReprism.git
+
+and cloned using::
+
+    $ git clone https://github.com/unlv-evol/PyReprism.git
+    $ cd PyReprism
+
+Optionally (but suggested), make use of virtual environment. Therefore, before installing the requirements run::
+    
+    $ python3 -m venv venv
+    $ source venv/bin/activate
+
+Install the requirements::
+    
+    $ pip install -r requirements.txt
+
+and run the tests using pytest::
+
+    $ pytest

{pyreprism-0.0.3 → pyreprism-0.0.4}/pyproject.toml

@@ -4,7 +4,7 @@ build-backend = "hatchling.build"
 
 [project]
 name = "PyReprism"
-version = "0.0.3"
+version = "0.0.4"
 authors = [
   { name= "UNLV EVOL LAB", email="ogenrwot@unlv.nevada.edu" },
 ]
@@ -12,11 +12,11 @@ authors = [
 license={file="LICENSE" }
 python_requires = ">=3.5"
 description = "Framework for Source Code Preprocessing"
-readme = "README.md"
+readme = "docs/intro.rst"
 requires-python = ">=3.6"
 classifiers = [
     "Environment :: Console",
-    "Development Status :: 4 - Beta",
+    "Development Status :: 5 - Production/Stable",
     "Intended Audience :: Developers",
     "Intended Audience :: Science/Research",
     "Programming Language :: Python :: 3",
@@ -43,4 +43,5 @@ dev = [
 
 [project.urls]
 Homepage = "https://github.com/unlv-evol/PyReprism"
+Documentation = "https://pyreprism.readthedocs.io"
 Issues = "https://github.com/unlv-evol/PyReprism/issues"

pyreprism-0.0.4/requirements.txt

@@ -0,0 +1,3 @@
+pytest
+flake8
+pytest-cov

pyreprism-0.0.4/src/PyReprism/__init__.py

@@ -0,0 +1 @@
+__version__ = "0.0.4"

pyreprism-0.0.4/src/PyReprism/languages/c.py

@@ -0,0 +1,113 @@
+import re
+from PyReprism.utils import extension
+
+
+class C:
+    def __init__():
+        pass
+
+    @staticmethod
+    def file_extension() -> str:
+        """
+        Return the file extension used for C files.
+
+        :return: The file extension for C files.
+        :rtype: str
+        """
+        return extension.c
+
+    @staticmethod
+    def keywords() -> list:
+        """
+        Return a list of C keywords and built-in functions.
+
+        :return: A list of C keywords and built-in function names.
+        :rtype: list
+        """
+        keyword = '_Alignas|_Alignof|_Atomic|_Bool|_Complex|_Generic|_Imaginary|_Noreturn|_Static_assert|_Thread_local|asm|typeof|inline|auto|break|case|char|const|continue|default|do|double|else|enum|extern|float|for|goto|if|int|long|register|return|short|signed|sizeof|static|struct|switch|typedef|union|unsigned|void|volatile|while|define|defined|elif|else|endif|error|ifdef|ifndef|if|import|include|line|pragma|undef|using|__FILE__|__LINE__|__DATE__|__TIME__|__TIMESTAMP__|__func__|EOF|NULL|SEEK_CUR|SEEK_END|SEEK_SET|stdin|stdout|stderr'.split('|')
+        return keyword
+
+    @staticmethod
+    def comment_regex() -> re.Pattern:
+        """
+        Compile and return a regular expression pattern to identify different types of comments and non-comment code in C source files.
+
+        :return: A compiled regex pattern with named groups to match single-line comments, multiline comments, and non-comment code elements.
+        :rtype: re.Pattern
+        """
+        pattern = re.compile(r'(?P<comment>//.*?$|/\*[^*]*\*+(?:[^/*][^*]*\*+)*?/)|(?P<noncomment>[^/]+)', re.DOTALL | re.MULTILINE)
+        return pattern
+
+    @staticmethod
+    def number_regex() -> re.Pattern:
+        """
+        Compile and return a regular expression pattern to identify numeric literals in C code.
+
+        :return: A compiled regex pattern to match C numeric literals, including integers, floats, and complex numbers.
+        :rtype: re.Pattern
+        """
+        pattern = re.compile(r'(?:\b0x[\da-f]+|(?:\b\d+\.?\d*|\B\.\d+)(?:e[+-]?\d+)?)[ful]*')
+        return pattern
+
+    @staticmethod
+    def operator_regex() -> re.Pattern:
+        """
+        Compile and return a regular expression pattern to identify C operators.
+
+        :return: A compiled regex pattern to match various C operators and logical keywords.
+        :rtype: re.Pattern
+        """
+        pattern = re.compile(r'-[>-]?|\+\+?|!=?|<<?=?|>>?=?|==?|&&?|\|\|?|[~^%?*\/]')
+        return pattern
+
+    @staticmethod
+    def keywords_regex() -> re.Pattern:
+        """
+        Compile and return a regular expression pattern to identify C keywords.
+
+        :return: A compiled regex pattern to match C keywords.
+        :rtype: re.Pattern
+        """
+        return re.compile(r'\b(' + '|'.join(C.keywords()) + r')\b')
+
+    @staticmethod
+    def boolean_regex() -> re.Pattern:
+        """
+        Compile and return a regular expression pattern to identify C boolean literals.
+
+        :return: A compiled regex pattern to match C boolean literals.
+        :rtype: re.Pattern
+        """
+        return re.compile(r'\b(?:true|false)\b')
+
+    @staticmethod
+    def delimiters_regex() -> re.Pattern:
+        """
+        Compile and return a regular expression pattern to identify C and C++ delimiters.
+
+        :return: A compiled regex pattern to match C and C++ delimiters.
+        :rtype: re.Pattern
+        """
+        return re.compile(r'[()\[\]{}.,:;@<>*&]')
+
+    @staticmethod
+    def remove_comments(source_code: str) -> str:
+        """
+        Remove comments from the provided C source code string.
+
+        :param str source_code: The C source code from which to remove comments.
+        :return: The source code with all comments removed.
+        :rtype: str
+        """
+        return C.comment_regex().sub(lambda match: match.group('noncomment') if match.group('noncomment') else '', source_code).strip()
+
+    @staticmethod
+    def remove_keywords(source: str) -> str:
+        """
+        Remove all C keywords from the provided source code string.
+
+        :param str source: The source code string from which to remove C keywords.
+        :return: The source code string with all C keywords removed.
+        :rtype: str
+        """
+        return re.sub(re.compile(C.keywords_regex()), '', source)

pyreprism-0.0.4/src/PyReprism/languages/cpp.py

@@ -0,0 +1,113 @@
+import re
+from PyReprism.utils import extension
+
+
+class CPP:
+    def __init__(self):
+        pass
+
+    @staticmethod
+    def file_extension() -> str:
+        """
+        Return the file extension used for C++ files.
+
+        :return: The file extension for C++ files.
+        :rtype: str
+        """
+        return extension.cpp
+
+    @staticmethod
+    def keywords() -> list:
+        """
+        Return a list of C++ keywords and built-in functions.
+
+        :return: A list of C++ keywords and built-in function names.
+        :rtype: list
+        """
+        keyword = 'alignas|alignof|asm|auto|bool|break|case|catch|char|char16_t|char32_t|class|compl|const|constexpr|const_cast|continue|decltype|default|delete|do|double|dynamic_cast|else|enum|explicit|export|extern|float|for|friend|goto|if|inline|int|int8_t|int16_t|int32_t|int64_t|uint8_t|uint16_t|uint32_t|uint64_t|long|mutable|namespace|new|noexcept|nullptr|operator|private|protected|public|register|reinterpret_cast|return|short|signed|sizeof|static|static_assert|static_cast|struct|switch|template|this|thread_local|throw|try|typedef|typeid|typename|union|unsigned|using|virtual|void|volatile|wchar_t|while|true|false'.split('|')
+        return keyword
+
+    @staticmethod
+    def comment_regex() -> re.Pattern:
+        """
+        Compile and return a regular expression pattern to identify different types of comments and non-comment code in C source files.
+
+        :return: A compiled regex pattern with named groups to match single-line comments, multiline comments, and non-comment code elements.
+        :rtype: re.Pattern
+        """
+        pattern = re.compile(r'(?P<comment>//.*?$|/\*[^*]*\*+(?:[^/*][^*]*\*+)*?/)|(?P<noncomment>[^/]+)', re.DOTALL | re.MULTILINE)
+        return pattern
+
+    @staticmethod
+    def number_regex() -> re.Pattern:
+        """
+        Compile and return a regular expression pattern to identify numeric literals in C++ code.
+
+        :return: A compiled regex pattern to match C++ numeric literals, including integers, floats, and complex numbers.
+        :rtype: re.Pattern
+        """
+        pattern = re.compile(r'(?:\b0x[\da-f]+|(?:\b\d+\.?\d*|\B\.\d+)(?:e[+-]?\d+)?)[ful]*')
+        return pattern
+
+    @staticmethod
+    def operator_regex() -> re.Pattern:
+        """
+        Compile and return a regular expression pattern to identify C++ operators.
+
+        :return: A compiled regex pattern to match various C++ operators and logical keywords.
+        :rtype: re.Pattern
+        """
+        pattern = re.compile(r'--?|\+\+?|!=?|<{1,2}=?|>{1,2}=?|->|:{1,2}|={1,2}|\^|~|%|&{1,2}|\|\|?|\?|\*|\/|\b(?:and|and_eq|bitand|bitor|not|not_eq|or|or_eq|xor|xor_eq)\b')
+        return pattern
+
+    @staticmethod
+    def keywords_regex() -> re.Pattern:
+        """
+        Return a list of C++ keywords and built-in functions.
+
+        :return: A list of C++ keywords and built-in function names.
+        :rtype: list
+        """
+        return re.compile(r'\b(' + '|'.join(CPP.keywords()) + r')\b')
+
+    @staticmethod
+    def boolean_regex() -> re.Pattern:
+        """
+        Compile and return a regular expression pattern to identify C++ boolean literals.
+
+        :return: A compiled regex pattern to match C++ boolean literals.
+        :rtype: re.Pattern
+        """
+        return re.compile(r'\b(?:true|false)\b')
+
+    @staticmethod
+    def delimiters_regex() -> re.Pattern:
+        """
+        Compile and return a regular expression pattern to identify C and C++ delimiters.
+
+        :return: A compiled regex pattern to match C and C++ delimiters.
+        :rtype: re.Pattern
+        """
+        return re.compile(r'[()\[\]{}.,:;@<>*&]')
+
+    @staticmethod
+    def remove_comments(source_code: str) -> str:
+        """
+        Remove comments from the provided C++ source code string.
+
+        :param str source_code: The C++ source code from which to remove comments.
+        :return: The source code with all comments removed.
+        :rtype: str
+        """
+        return CPP.comment_regex().sub(lambda match: match.group('noncomment') if match.group('noncomment') else '', source_code).strip()
+
+    @staticmethod
+    def remove_keywords(source: str) -> str:
+        """
+        Remove all C++ keywords from the provided source code string.
+
+        :param str source: The source code string from which to remove C++ keywords.
+        :return: The source code string with all C++ keywords removed.
+        :rtype: str
+        """
+        return re.sub(re.compile(CPP.keywords_regex()), '', source)

{pyreprism-0.0.3 → pyreprism-0.0.4}/src/PyReprism/languages/csharp.py

@@ -34,8 +34,41 @@ class CSharp:
     def keywords_regex():
         return re.compile(r'\b(' + '|'.join(CSharp.keywords()) + r')\b')
 
+    @staticmethod
+    def boolean_regex() -> re.Pattern:
+        """
+        Compile and return a regular expression pattern to identify C# boolean literals.
+
+        This function generates a regular expression that matches the C# boolean literals `true`, `false`, and the special constant `null`.
+
+        :return: A compiled regex pattern to match C# boolean literals and `null`.
+        :rtype: re.Pattern
+        """
+        return re.compile(r'\b(?:true|false|null)\b', re.IGNORECASE)
+
+    @staticmethod
+    def delimiters_regex() -> re.Pattern:
+        """
+        Compile and return a regular expression pattern to identify C# delimiters.
+
+        This function generates a regular expression that matches C# language delimiters, which include parentheses `()`, brackets `[]`, braces `{}`, commas `,`, colons `:`, periods `.`, semicolons `;`, at symbols `@`, angle brackets `<`, `>`, and the question mark `?`.
+
+        :return: A compiled regex pattern to match C# delimiters.
+        :rtype: re.Pattern
+        """
+        return re.compile(r'[()\[\]{}.,:;@<>?]')
+
     @staticmethod
     def remove_comments(source_code: str, isList: bool = False) -> str:
+        """
+        Remove comments from the provided Python source code string.
+
+        :param str source_code: The Python source code from which to remove comments.
+        :param bool isList: (Optional) A flag indicating if the input is a list of source code lines. This parameter is not used in the function logic.
+        :return: The source code with all comments removed.
+        :rtype: str
+        """
+        return CSharp.comment_regex().sub(lambda match: match.group('noncomment') if match.group('noncomment') else '', source_code).strip()
         result = []
         for match in CSharp.comment_regex().finditer(source_code):
             if match.group('noncomment'):

{pyreprism-0.0.3 → pyreprism-0.0.4}/src/PyReprism/languages/dart.py

@@ -34,8 +34,33 @@ class Dart:
     def keywords_regex():
         return re.compile(r'\b(' + '|'.join(Dart.keywords()) + r')\b')
 
+    @staticmethod
+    def delimiters_regex() -> re.Pattern:
+        """
+        Compile and return a regular expression pattern to identify Dart language delimiters.
+
+        This function generates a regular expression that matches Dart language delimiters, which include parentheses `()`, brackets `[]`, braces `{}`, commas `,`, colons `:`, periods `.`, semicolons `;`, and angle brackets `<`, `>`.
+
+        :return: A compiled regex pattern to match Dart delimiters.
+        :rtype: re.Pattern
+        """
+        return re.compile(r'[()\[\]{}.,:;<>]')
+
+    @staticmethod
+    def boolean_regex() -> re.Pattern:
+        """
+        Compile and return a regular expression pattern to identify Dart boolean literals.
+
+        This function generates a regular expression that matches the Dart boolean literals `true`, `false`, and the special constant `null`.
+
+        :return: A compiled regex pattern to match Dart boolean literals and `null`.
+        :rtype: re.Pattern
+        """
+        return re.compile(r'\b(?:true|false|null)\b')
+
     @staticmethod
     def remove_comments(source_code: str, isList: bool = False) -> str:
+        return Dart.comment_regex().sub(lambda match: match.group('noncomment') if match.group('noncomment') else '', source_code).strip()
         result = []
         for match in Dart.comment_regex().finditer(source_code):
             if match.group('noncomment'):

pyreprism-0.0.4/src/PyReprism/languages/django.py

@@ -0,0 +1,124 @@
+import re
+from PyReprism.utils import extension
+
+
+class Django:
+    def __init__(self):
+        pass
+
+    @staticmethod
+    def file_extension() -> str:
+        """
+        Return the file extension used for Python files.
+
+        :return: The file extension for Python files.
+        :rtype: str
+        """
+        return extension.django
+
+    @staticmethod
+    def keywords() -> list:
+        """
+        Return a list of Python keywords and built-in functions.
+
+        :return: A list of Python keywords and built-in function names.
+        :rtype: list
+        """
+        keyword = 'load|verbatim|widthratio|ssi|firstof|for|url|ifchanged|csrf_token|lorem|ifnotequal|autoescape|now|templatetag|debug|cycle|ifequal|regroup|comment|filter|endfilter|if|spaceless|with|extends|block|include|else|empty|endif|endfor|as|endblock|endautoescape|endverbatim|trans|endtrans|[Tt]rue|[Ff]alse|[Nn]one|in|is|static|macro|endmacro|call|endcall|set|endset|raw|endraw'.split('|')
+        return keyword
+
+    @staticmethod
+    def functions() -> list:
+        """
+        Return a list of Python keywords and built-in functions.
+
+        :return: A list of Python keywords and built-in function names.
+        :rtype: list
+        """
+        func = 'abs|add|addslashes|attr|batch|callable|capfirst|capitalize|center|count|cut|d|date|default|default_if_none|defined|dictsort|dictsortreversed|divisibleby|e|equalto|escape|escaped|escapejs|even|filesizeformat|first|float|floatformat|force_escape|forceescape|format|get_digit|groupby|indent|int|iriencode|iterable|join|last|length|length_is|linebreaks|linebreaksbr|linenumbers|list|ljust|lower|make_list|map|mapping|number|odd|phone2numeric|pluralize|pprint|random|reject|rejectattr|removetags|replace|reverse|rjust|round|safe|safeseq|sameas|select|selectattr|sequence|slice|slugify|sort|string|stringformat|striptags|sum|time|timesince|timeuntil|title|trim|truncate|truncatechars|truncatechars_html|truncatewords|truncatewords_html|undefined|unordered_list|upper|urlencode|urlize|urlizetrunc|wordcount|wordwrap|xmlattr|yesno'.split('|')
+        return func
+
+    @staticmethod
+    def comment_regex() -> re.Pattern:
+        """
+        Compile and return a regular expression pattern to identify different types of comments and non-comment code in Python source files.
+
+        :return: A compiled regex pattern with named groups to match single-line comments, multiline comments, and non-comment code elements.
+        :rtype: re.Pattern
+        """
+        pattern = re.compile(r'(?P<comment>#.*?$)|'r'(?P<multilinecomment1>""".*?""")|'r'(?P<multilinecomment2>\'\'\'.*?\'\'\')|'r'(?P<noncomment>\'(\\.|[^\\\'])*\'|"(\\.|[^\\"])*"|.[^#\'"]*)', re.DOTALL | re.MULTILINE)
+        return pattern
+
+    @staticmethod
+    def number_regex() -> re.Pattern:
+        """
+        Compile and return a regular expression pattern to identify numeric literals in Python code.
+
+        :return: A compiled regex pattern to match Python numeric literals, including integers, floats, and complex numbers.
+        :rtype: re.Pattern
+        """
+        pattern = re.compile(r'')
+        return pattern
+
+    @staticmethod
+    def operator_regex() -> re.Pattern:
+        """
+        Compile and return a regular expression pattern to identify Python operators.
+
+        :return: Regex pattern to match various Python operators and logical keywords.
+        :rtype: re.Pattern
+        """
+        pattern = re.compile(r'')
+        return pattern
+
+    @staticmethod
+    def keywords_regex() -> re.Pattern:
+        """
+        Compile and return a regular expression pattern to identify Python keywords.
+
+        :return: A compiled regex pattern to match Python keywords.
+        :rtype: re.Pattern
+        """
+        return re.compile(r'\b(' + '|'.join(Django.keywords()) + r')\b')
+
+    @staticmethod
+    def boolean_regex() -> re.Pattern:
+        """
+        Compile and return a regular expression pattern to identify Python boolean literals.
+
+        :return: A compiled regex pattern to match Python boolean literals and `None`.
+        :rtype: re.Pattern
+        """
+        return re.compile(r'\b(?:True|False|None)\b')
+
+    @staticmethod
+    def delimiters_regex() -> re.Pattern:
+        """
+        Compile and return a regular expression pattern to identify Python delimiters.
+
+        :return: A compiled regex pattern to match Python delimiters.
+        :rtype: re.Pattern
+        """
+        return re.compile(r'[()\[\]{}.,:;@]')
+
+    @staticmethod
+    def remove_comments(source_code: str) -> str:
+        """
+        Remove comments from the provided Python source code string.
+
+        :param str source_code: The Python source code from which to remove comments.
+        :return: The source code with all comments removed.
+        :rtype: str
+        """
+        return Django.comment_regex().sub(lambda match: match.group('noncomment') if match.group('noncomment') else '', source_code).strip()
+
+    @staticmethod
+    def remove_keywords(source: str) -> str:
+        """
+        Remove all Python keywords from the provided source code string.
+
+        :param str source: The source code string from which to remove Python keywords.
+        :return: The source code string with all Python keywords removed.
+        :rtype: str
+        """
+        return re.sub(re.compile(Django.keywords_regex()), '', source)