dev-laiser 0.2.2__tar.gz

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (15) hide show
  1. dev_laiser-0.2.2/LICENSE +30 -0
  2. dev_laiser-0.2.2/PKG-INFO +147 -0
  3. dev_laiser-0.2.2/README.md +106 -0
  4. dev_laiser-0.2.2/dev_laiser.egg-info/PKG-INFO +147 -0
  5. dev_laiser-0.2.2/dev_laiser.egg-info/SOURCES.txt +13 -0
  6. dev_laiser-0.2.2/dev_laiser.egg-info/dependency_links.txt +1 -0
  7. dev_laiser-0.2.2/dev_laiser.egg-info/requires.txt +18 -0
  8. dev_laiser-0.2.2/dev_laiser.egg-info/top_level.txt +1 -0
  9. dev_laiser-0.2.2/laiser/__init__.py +0 -0
  10. dev_laiser-0.2.2/laiser/llm_methods.py +382 -0
  11. dev_laiser-0.2.2/laiser/params.py +60 -0
  12. dev_laiser-0.2.2/laiser/skill_extractor.py +367 -0
  13. dev_laiser-0.2.2/laiser/utils.py +122 -0
  14. dev_laiser-0.2.2/setup.cfg +4 -0
  15. dev_laiser-0.2.2/setup.py +39 -0
dev_laiser-0.2.2/LICENSE ADDED
@@ -0,0 +1,30 @@
1
+ Copyright (c) 2025, LAiSER.
2
+ All rights reserved.
3
+
4
+ Redistribution and use in source and binary forms, with or without
5
+ modification, are permitted provided that the following conditions are
6
+ met:
7
+
8
+ * Redistributions of source code must retain the above copyright
9
+ notice, this list of conditions and the following disclaimer.
10
+
11
+ * Redistributions in binary form must reproduce the above
12
+ copyright notice, this list of conditions and the following
13
+ disclaimer in the documentation and/or other materials provided
14
+ with the distribution.
15
+
16
+ * Neither the name of the LAiSER nor the names of any
17
+ contributors may be used to endorse or promote products derived
18
+ from this software without specific prior written permission.
19
+
20
+ THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
21
+ "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
22
+ LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR
23
+ A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT
24
+ OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL,
25
+ SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT
26
+ LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,
27
+ DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
28
+ THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
29
+ (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
30
+ OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
dev_laiser-0.2.2/PKG-INFO ADDED
@@ -0,0 +1,147 @@
1
+ Metadata-Version: 2.2
2
+ Name: dev-laiser
3
+ Version: 0.2.2
4
+ Summary: LAiSER (Leveraging Artificial Intelligence for Skill Extraction & Research) is a tool designed to help learners, educators, and employers extract and share trusted information about skills. It uses a fine-tuned language model to extract raw skill keywords from text, then aligns them with a predefined taxonomy. You can find more technical details in the project’s paper.md and an overview in the README.md.
5
+ Home-page: https://github.com/LAiSER-Software/extract-module
6
+ Author: Satya Phanindra Kumar Kalaga, Bharat Khandelwal, Prudhvi Chekuri
7
+ Author-email: phanindra.connect@gmail.com
8
+ Classifier: Programming Language :: Python :: 3
9
+ Classifier: License :: OSI Approved :: BSD License
10
+ Classifier: Operating System :: OS Independent
11
+ Requires-Python: >=3.6
12
+ Description-Content-Type: text/markdown
13
+ License-File: LICENSE
14
+ Requires-Dist: numpy
15
+ Requires-Dist: pandas
16
+ Requires-Dist: psutil
17
+ Requires-Dist: scikit_learn
18
+ Requires-Dist: skillNer
19
+ Requires-Dist: spacy
20
+ Requires-Dist: transformers
21
+ Requires-Dist: accelerate
22
+ Requires-Dist: bitsandbytes
23
+ Requires-Dist: datasets
24
+ Requires-Dist: huggingface_hub
25
+ Requires-Dist: peft
26
+ Requires-Dist: torch
27
+ Requires-Dist: trl
28
+ Requires-Dist: ipython
29
+ Requires-Dist: python-dotenv
30
+ Requires-Dist: vllm
31
+ Requires-Dist: tqdm
32
+ Dynamic: author
33
+ Dynamic: author-email
34
+ Dynamic: classifier
35
+ Dynamic: description
36
+ Dynamic: description-content-type
37
+ Dynamic: home-page
38
+ Dynamic: requires-dist
39
+ Dynamic: requires-python
40
+ Dynamic: summary
41
+
42
+ <div align="center">
43
+ <img src="https://i.imgur.com/XznvjNi.png" width="70%"/>
44
+ <h2>Leveraging ​Artificial ​Intelligence for ​Skill ​Extraction &​ Research (LAiSER)</h2>
45
+ </div>
46
+
47
+ ### Contents
48
+ LAiSER is a tool that helps learners, educators and employers share trusted and mutually intelligible information about skills​.
49
+
50
+ - [About](#about)
51
+ - [Requirements](#requirements)
52
+ - [Setup and Installation](#setup-and-installation)
53
+ - [i. Download the repository](#i-download-the-repository)
54
+ - [ii. Install the dependencies](#ii-install-the-dependencies)
55
+ - [Usage](#usage)
56
+ - [Google Colab Setup(preferred)](#google-colab-setuppreferred)
57
+ - [Command Line Setup](#command-line-setup)
58
+ - [Funding](#funding)
59
+ - [Authors](#authors)
60
+ - [Partners](#partners)
61
+ <!-- - [Examples](#examples) -->
62
+ - [Funding](#funding)
63
+ - [Authors](#authors)
64
+ - [Partners](#partners)
65
+
66
+ ## About
67
+ ## Requirements
68
+ - Python version >= Python 3.12.
69
+ - A GPU with atelast 15GB video memory is essential for running this tool on large datasets.
70
+
71
+
72
+ ## Setup and Installation
73
+
74
+ ### i. Download the repository
75
+ Before proceeding to LAiSER, you'd want to follow the steps below to install the required dependencies:
76
+ - Clone the repository using
77
+ ```shell
78
+ git clone https://github.com/Micah-Sanders/LAiSER.git
79
+ ```
80
+ or download the [zip(link)](https://github.com/Micah-Sanders/LAiSER/archive/refs/heads/main.zip) file and extract it.
81
+
82
+ ### ii. Install the dependencies
83
+ > [!NOTE]
84
+ > If you intend to use the Jupyter Notebook interface, you can skip this step as the dependencies will be installed seperately in the Google Colab environment.
85
+
86
+ Install the required dependencies using the command below:
87
+ ```shell
88
+ pip install -r requirements.txt
89
+ ```
90
+ **NOTE**: Python 3.9 or later, *preferably 3.12*, is expected to be installed on your system. If you don't have Python installed, you can download it from [here](https://www.python.org/downloads/).
91
+
92
+
93
+ ## Usage
94
+
95
+ As of now LAiSER can be used a command line tool or from the Jupyter notebook(Google Colab). The steps to setup the tool are as follows:
96
+
97
+ ### Google Colab Setup(preferred)
98
+ LAiSER's Jupyter notebook is, currently, the fastest way to get started with the tool. You can access the notebook [here](https://github.com/LAiSER-Software/extract-module/blob/main/dev_space/Extract%20Function%20Colab%20Execution.ipynb).
99
+
100
+ - Once the notebook is imported in google colaboratory, connect to a GPU-accelerated runtime(T4 GPU) and run the cells in the notebook.
101
+
102
+ ### Command Line Setup
103
+ To use LAiSER as a command line tool, follow the steps below:
104
+
105
+ - Navigate to the root directory of the repository and run the command below:
106
+ ```shell
107
+ pip install laiser-dev
108
+ ```
109
+
110
+ - Once the installation is complete, you can run the tool using the command below:
111
+ <!-- TODO: add an example of importing and initiating the skillExtractor class -->
112
+ ```shell
113
+ TODO: add an example of importing and initiating the skillExtractor class
114
+ ```
115
+
116
+ <!-- > [!CAUTION]
117
+ > - If you encounter any `*.dll` file missing errors, make sure you downgrade the pytorch version to `2.2.2`.
118
+ ```shell
119
+ pip install pytorch=2.2.2
120
+ ``` -->
121
+
122
+
123
+ <!-- ## Examples -->
124
+
125
+
126
+ ## Funding
127
+ <div align="center">
128
+ <img src="https://i.imgur.com/XtgngBz.png" width="100px"/>
129
+ <img src="https://i.imgur.com/a2SNYma.jpeg" width="130px"/>
130
+ </div>
131
+
132
+ ## Authors
133
+ <a href="https://github.com/LAiSER-Software/extract-module/graphs/contributors">
134
+ <img src="https://contrib.rocks/image?repo=LAiSER-Software/extract-module" />
135
+ </a>
136
+
137
+ ## Partners
138
+ <div align="center">
139
+ <img src="https://i.imgur.com/hMb5n6T.png" width="120px"/>
140
+ <img src="https://i.imgur.com/dxz2Udo.png" width="70px"/>
141
+ <img src="https://i.imgur.com/5O1EuFU.png" width="100px"/>
142
+ </div>
143
+
144
+
145
+
146
+ </br>
147
+ <!-- <p align='center'> <b> Made with Passion💖, Data Science📊, and a little magic!🪄 </b></p> -->
dev_laiser-0.2.2/README.md ADDED
@@ -0,0 +1,106 @@
1
+ <div align="center">
2
+ <img src="https://i.imgur.com/XznvjNi.png" width="70%"/>
3
+ <h2>Leveraging ​Artificial ​Intelligence for ​Skill ​Extraction &​ Research (LAiSER)</h2>
4
+ </div>
5
+
6
+ ### Contents
7
+ LAiSER is a tool that helps learners, educators and employers share trusted and mutually intelligible information about skills​.
8
+
9
+ - [About](#about)
10
+ - [Requirements](#requirements)
11
+ - [Setup and Installation](#setup-and-installation)
12
+ - [i. Download the repository](#i-download-the-repository)
13
+ - [ii. Install the dependencies](#ii-install-the-dependencies)
14
+ - [Usage](#usage)
15
+ - [Google Colab Setup(preferred)](#google-colab-setuppreferred)
16
+ - [Command Line Setup](#command-line-setup)
17
+ - [Funding](#funding)
18
+ - [Authors](#authors)
19
+ - [Partners](#partners)
20
+ <!-- - [Examples](#examples) -->
21
+ - [Funding](#funding)
22
+ - [Authors](#authors)
23
+ - [Partners](#partners)
24
+
25
+ ## About
26
+ ## Requirements
27
+ - Python version >= Python 3.12.
28
+ - A GPU with atelast 15GB video memory is essential for running this tool on large datasets.
29
+
30
+
31
+ ## Setup and Installation
32
+
33
+ ### i. Download the repository
34
+ Before proceeding to LAiSER, you'd want to follow the steps below to install the required dependencies:
35
+ - Clone the repository using
36
+ ```shell
37
+ git clone https://github.com/Micah-Sanders/LAiSER.git
38
+ ```
39
+ or download the [zip(link)](https://github.com/Micah-Sanders/LAiSER/archive/refs/heads/main.zip) file and extract it.
40
+
41
+ ### ii. Install the dependencies
42
+ > [!NOTE]
43
+ > If you intend to use the Jupyter Notebook interface, you can skip this step as the dependencies will be installed seperately in the Google Colab environment.
44
+
45
+ Install the required dependencies using the command below:
46
+ ```shell
47
+ pip install -r requirements.txt
48
+ ```
49
+ **NOTE**: Python 3.9 or later, *preferably 3.12*, is expected to be installed on your system. If you don't have Python installed, you can download it from [here](https://www.python.org/downloads/).
50
+
51
+
52
+ ## Usage
53
+
54
+ As of now LAiSER can be used a command line tool or from the Jupyter notebook(Google Colab). The steps to setup the tool are as follows:
55
+
56
+ ### Google Colab Setup(preferred)
57
+ LAiSER's Jupyter notebook is, currently, the fastest way to get started with the tool. You can access the notebook [here](https://github.com/LAiSER-Software/extract-module/blob/main/dev_space/Extract%20Function%20Colab%20Execution.ipynb).
58
+
59
+ - Once the notebook is imported in google colaboratory, connect to a GPU-accelerated runtime(T4 GPU) and run the cells in the notebook.
60
+
61
+ ### Command Line Setup
62
+ To use LAiSER as a command line tool, follow the steps below:
63
+
64
+ - Navigate to the root directory of the repository and run the command below:
65
+ ```shell
66
+ pip install laiser-dev
67
+ ```
68
+
69
+ - Once the installation is complete, you can run the tool using the command below:
70
+ <!-- TODO: add an example of importing and initiating the skillExtractor class -->
71
+ ```shell
72
+ TODO: add an example of importing and initiating the skillExtractor class
73
+ ```
74
+
75
+ <!-- > [!CAUTION]
76
+ > - If you encounter any `*.dll` file missing errors, make sure you downgrade the pytorch version to `2.2.2`.
77
+ ```shell
78
+ pip install pytorch=2.2.2
79
+ ``` -->
80
+
81
+
82
+ <!-- ## Examples -->
83
+
84
+
85
+ ## Funding
86
+ <div align="center">
87
+ <img src="https://i.imgur.com/XtgngBz.png" width="100px"/>
88
+ <img src="https://i.imgur.com/a2SNYma.jpeg" width="130px"/>
89
+ </div>
90
+
91
+ ## Authors
92
+ <a href="https://github.com/LAiSER-Software/extract-module/graphs/contributors">
93
+ <img src="https://contrib.rocks/image?repo=LAiSER-Software/extract-module" />
94
+ </a>
95
+
96
+ ## Partners
97
+ <div align="center">
98
+ <img src="https://i.imgur.com/hMb5n6T.png" width="120px"/>
99
+ <img src="https://i.imgur.com/dxz2Udo.png" width="70px"/>
100
+ <img src="https://i.imgur.com/5O1EuFU.png" width="100px"/>
101
+ </div>
102
+
103
+
104
+
105
+ </br>
106
+ <!-- <p align='center'> <b> Made with Passion💖, Data Science📊, and a little magic!🪄 </b></p> -->
dev_laiser-0.2.2/dev_laiser.egg-info/PKG-INFO ADDED
@@ -0,0 +1,147 @@
1
+ Metadata-Version: 2.2
2
+ Name: dev-laiser
3
+ Version: 0.2.2
4
+ Summary: LAiSER (Leveraging Artificial Intelligence for Skill Extraction & Research) is a tool designed to help learners, educators, and employers extract and share trusted information about skills. It uses a fine-tuned language model to extract raw skill keywords from text, then aligns them with a predefined taxonomy. You can find more technical details in the project’s paper.md and an overview in the README.md.
5
+ Home-page: https://github.com/LAiSER-Software/extract-module
6
+ Author: Satya Phanindra Kumar Kalaga, Bharat Khandelwal, Prudhvi Chekuri
7
+ Author-email: phanindra.connect@gmail.com
8
+ Classifier: Programming Language :: Python :: 3
9
+ Classifier: License :: OSI Approved :: BSD License
10
+ Classifier: Operating System :: OS Independent
11
+ Requires-Python: >=3.6
12
+ Description-Content-Type: text/markdown
13
+ License-File: LICENSE
14
+ Requires-Dist: numpy
15
+ Requires-Dist: pandas
16
+ Requires-Dist: psutil
17
+ Requires-Dist: scikit_learn
18
+ Requires-Dist: skillNer
19
+ Requires-Dist: spacy
20
+ Requires-Dist: transformers
21
+ Requires-Dist: accelerate
22
+ Requires-Dist: bitsandbytes
23
+ Requires-Dist: datasets
24
+ Requires-Dist: huggingface_hub
25
+ Requires-Dist: peft
26
+ Requires-Dist: torch
27
+ Requires-Dist: trl
28
+ Requires-Dist: ipython
29
+ Requires-Dist: python-dotenv
30
+ Requires-Dist: vllm
31
+ Requires-Dist: tqdm
32
+ Dynamic: author
33
+ Dynamic: author-email
34
+ Dynamic: classifier
35
+ Dynamic: description
36
+ Dynamic: description-content-type
37
+ Dynamic: home-page
38
+ Dynamic: requires-dist
39
+ Dynamic: requires-python
40
+ Dynamic: summary
41
+
42
+ <div align="center">
43
+ <img src="https://i.imgur.com/XznvjNi.png" width="70%"/>
44
+ <h2>Leveraging ​Artificial ​Intelligence for ​Skill ​Extraction &​ Research (LAiSER)</h2>
45
+ </div>
46
+
47
+ ### Contents
48
+ LAiSER is a tool that helps learners, educators and employers share trusted and mutually intelligible information about skills​.
49
+
50
+ - [About](#about)
51
+ - [Requirements](#requirements)
52
+ - [Setup and Installation](#setup-and-installation)
53
+ - [i. Download the repository](#i-download-the-repository)
54
+ - [ii. Install the dependencies](#ii-install-the-dependencies)
55
+ - [Usage](#usage)
56
+ - [Google Colab Setup(preferred)](#google-colab-setuppreferred)
57
+ - [Command Line Setup](#command-line-setup)
58
+ - [Funding](#funding)
59
+ - [Authors](#authors)
60
+ - [Partners](#partners)
61
+ <!-- - [Examples](#examples) -->
62
+ - [Funding](#funding)
63
+ - [Authors](#authors)
64
+ - [Partners](#partners)
65
+
66
+ ## About
67
+ ## Requirements
68
+ - Python version >= Python 3.12.
69
+ - A GPU with atelast 15GB video memory is essential for running this tool on large datasets.
70
+
71
+
72
+ ## Setup and Installation
73
+
74
+ ### i. Download the repository
75
+ Before proceeding to LAiSER, you'd want to follow the steps below to install the required dependencies:
76
+ - Clone the repository using
77
+ ```shell
78
+ git clone https://github.com/Micah-Sanders/LAiSER.git
79
+ ```
80
+ or download the [zip(link)](https://github.com/Micah-Sanders/LAiSER/archive/refs/heads/main.zip) file and extract it.
81
+
82
+ ### ii. Install the dependencies
83
+ > [!NOTE]
84
+ > If you intend to use the Jupyter Notebook interface, you can skip this step as the dependencies will be installed seperately in the Google Colab environment.
85
+
86
+ Install the required dependencies using the command below:
87
+ ```shell
88
+ pip install -r requirements.txt
89
+ ```
90
+ **NOTE**: Python 3.9 or later, *preferably 3.12*, is expected to be installed on your system. If you don't have Python installed, you can download it from [here](https://www.python.org/downloads/).
91
+
92
+
93
+ ## Usage
94
+
95
+ As of now LAiSER can be used a command line tool or from the Jupyter notebook(Google Colab). The steps to setup the tool are as follows:
96
+
97
+ ### Google Colab Setup(preferred)
98
+ LAiSER's Jupyter notebook is, currently, the fastest way to get started with the tool. You can access the notebook [here](https://github.com/LAiSER-Software/extract-module/blob/main/dev_space/Extract%20Function%20Colab%20Execution.ipynb).
99
+
100
+ - Once the notebook is imported in google colaboratory, connect to a GPU-accelerated runtime(T4 GPU) and run the cells in the notebook.
101
+
102
+ ### Command Line Setup
103
+ To use LAiSER as a command line tool, follow the steps below:
104
+
105
+ - Navigate to the root directory of the repository and run the command below:
106
+ ```shell
107
+ pip install laiser-dev
108
+ ```
109
+
110
+ - Once the installation is complete, you can run the tool using the command below:
111
+ <!-- TODO: add an example of importing and initiating the skillExtractor class -->
112
+ ```shell
113
+ TODO: add an example of importing and initiating the skillExtractor class
114
+ ```
115
+
116
+ <!-- > [!CAUTION]
117
+ > - If you encounter any `*.dll` file missing errors, make sure you downgrade the pytorch version to `2.2.2`.
118
+ ```shell
119
+ pip install pytorch=2.2.2
120
+ ``` -->
121
+
122
+
123
+ <!-- ## Examples -->
124
+
125
+
126
+ ## Funding
127
+ <div align="center">
128
+ <img src="https://i.imgur.com/XtgngBz.png" width="100px"/>
129
+ <img src="https://i.imgur.com/a2SNYma.jpeg" width="130px"/>
130
+ </div>
131
+
132
+ ## Authors
133
+ <a href="https://github.com/LAiSER-Software/extract-module/graphs/contributors">
134
+ <img src="https://contrib.rocks/image?repo=LAiSER-Software/extract-module" />
135
+ </a>
136
+
137
+ ## Partners
138
+ <div align="center">
139
+ <img src="https://i.imgur.com/hMb5n6T.png" width="120px"/>
140
+ <img src="https://i.imgur.com/dxz2Udo.png" width="70px"/>
141
+ <img src="https://i.imgur.com/5O1EuFU.png" width="100px"/>
142
+ </div>
143
+
144
+
145
+
146
+ </br>
147
+ <!-- <p align='center'> <b> Made with Passion💖, Data Science📊, and a little magic!🪄 </b></p> -->
dev_laiser-0.2.2/dev_laiser.egg-info/SOURCES.txt ADDED
@@ -0,0 +1,13 @@
1
+ LICENSE
2
+ README.md
3
+ setup.py
4
+ dev_laiser.egg-info/PKG-INFO
5
+ dev_laiser.egg-info/SOURCES.txt
6
+ dev_laiser.egg-info/dependency_links.txt
7
+ dev_laiser.egg-info/requires.txt
8
+ dev_laiser.egg-info/top_level.txt
9
+ laiser/__init__.py
10
+ laiser/llm_methods.py
11
+ laiser/params.py
12
+ laiser/skill_extractor.py
13
+ laiser/utils.py
dev_laiser-0.2.2/dev_laiser.egg-info/requires.txt ADDED
@@ -0,0 +1,18 @@
1
+ numpy
2
+ pandas
3
+ psutil
4
+ scikit_learn
5
+ skillNer
6
+ spacy
7
+ transformers
8
+ accelerate
9
+ bitsandbytes
10
+ datasets
11
+ huggingface_hub
12
+ peft
13
+ torch
14
+ trl
15
+ ipython
16
+ python-dotenv
17
+ vllm
18
+ tqdm
dev_laiser-0.2.2/dev_laiser.egg-info/top_level.txt ADDED
@@ -0,0 +1 @@
1
+ laiser
dev_laiser-0.2.2/laiser/__init__.py ADDED
File without changes