dev-laiser 0.0.1__tar.gz

This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Files changed (15) hide show
  1. dev_laiser-0.0.1/LICENSE +30 -0
  2. dev_laiser-0.0.1/PKG-INFO +125 -0
  3. dev_laiser-0.0.1/README.md +85 -0
  4. dev_laiser-0.0.1/dev_laiser.egg-info/PKG-INFO +125 -0
  5. dev_laiser-0.0.1/dev_laiser.egg-info/SOURCES.txt +13 -0
  6. dev_laiser-0.0.1/dev_laiser.egg-info/dependency_links.txt +1 -0
  7. dev_laiser-0.0.1/dev_laiser.egg-info/requires.txt +17 -0
  8. dev_laiser-0.0.1/dev_laiser.egg-info/top_level.txt +1 -0
  9. dev_laiser-0.0.1/laiser/__init__.py +0 -0
  10. dev_laiser-0.0.1/laiser/llm_methods.py +451 -0
  11. dev_laiser-0.0.1/laiser/params.py +58 -0
  12. dev_laiser-0.0.1/laiser/skill_extractor.py +461 -0
  13. dev_laiser-0.0.1/laiser/utils.py +122 -0
  14. dev_laiser-0.0.1/setup.cfg +4 -0
  15. dev_laiser-0.0.1/setup.py +38 -0
dev_laiser-0.0.1/LICENSE ADDED
@@ -0,0 +1,30 @@
1
+ Copyright (c) 2025, LAiSER.
2
+ All rights reserved.
3
+
4
+ Redistribution and use in source and binary forms, with or without
5
+ modification, are permitted provided that the following conditions are
6
+ met:
7
+
8
+ * Redistributions of source code must retain the above copyright
9
+ notice, this list of conditions and the following disclaimer.
10
+
11
+ * Redistributions in binary form must reproduce the above
12
+ copyright notice, this list of conditions and the following
13
+ disclaimer in the documentation and/or other materials provided
14
+ with the distribution.
15
+
16
+ * Neither the name of the LAiSER nor the names of any
17
+ contributors may be used to endorse or promote products derived
18
+ from this software without specific prior written permission.
19
+
20
+ THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
21
+ "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
22
+ LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR
23
+ A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT
24
+ OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL,
25
+ SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT
26
+ LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,
27
+ DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
28
+ THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
29
+ (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
30
+ OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
dev_laiser-0.0.1/PKG-INFO ADDED
@@ -0,0 +1,125 @@
1
+ Metadata-Version: 2.2
2
+ Name: dev-laiser
3
+ Version: 0.0.1
4
+ Summary: LAiSER (Leveraging Artificial Intelligence for Skill Extraction & Research) is a tool designed to help learners, educators, and employers extract and share trusted information about skills. It uses a fine-tuned language model to extract raw skill keywords from text, then aligns them with a predefined taxonomy. You can find more technical details in the project’s paper.md and an overview in the README.md.
5
+ Home-page: https://github.com/LAiSER-Software/extract-module
6
+ Author: Satya Phanindra Kumar Kalaga, Bharat Khandelwal, Prudhvi Chekuri
7
+ Author-email: phanindra.connect@gmail.com
8
+ Classifier: Programming Language :: Python :: 3
9
+ Classifier: License :: OSI Approved :: BSD License
10
+ Classifier: Operating System :: OS Independent
11
+ Requires-Python: >=3.6
12
+ Description-Content-Type: text/markdown
13
+ License-File: LICENSE
14
+ Requires-Dist: numpy
15
+ Requires-Dist: pandas
16
+ Requires-Dist: psutil
17
+ Requires-Dist: skillNer
18
+ Requires-Dist: spacy
19
+ Requires-Dist: tokenizers
20
+ Requires-Dist: accelerate
21
+ Requires-Dist: bitsandbytes
22
+ Requires-Dist: datasets
23
+ Requires-Dist: huggingface_hub
24
+ Requires-Dist: peft
25
+ Requires-Dist: torch
26
+ Requires-Dist: trl
27
+ Requires-Dist: ipython
28
+ Requires-Dist: python-dotenv
29
+ Requires-Dist: tqdm
30
+ Requires-Dist: triton
31
+ Dynamic: author
32
+ Dynamic: author-email
33
+ Dynamic: classifier
34
+ Dynamic: description
35
+ Dynamic: description-content-type
36
+ Dynamic: home-page
37
+ Dynamic: requires-dist
38
+ Dynamic: requires-python
39
+ Dynamic: summary
40
+
41
+ <div align="center">
42
+ <img src="https://i.imgur.com/XznvjNi.png" width="70%"/>
43
+ <h2>Leveraging ​Artificial ​Intelligence for ​Skill ​Extraction &​ Research (LAiSER)</h2>
44
+ </div>
45
+
46
+ ### Contents
47
+ LAiSER is a tool that helps learners, educators and employers share trusted and mutually intelligible information about skills​.
48
+
49
+ - [About](#about)
50
+ - [Requirements](#requirements)
51
+ - [Setup and Installation](#setup-and-installation)
52
+ - [Install LAiSER](#install-LAiSER)
53
+ - [Usage](#usage)
54
+ - [Google Colab Setup(preferred)](#google-colab-setuppreferred)
55
+ - [Funding](#funding)
56
+ - [Authors](#authors)
57
+ - [Partners](#partners)
58
+
59
+ ## About
60
+
61
+ LAiSER is an innovative tool that harnesses the power of artificial intelligence to simplify the extraction and analysis of skills. It is designed for learners, educators, and employers who want to gain reliable insights into skill sets, ensuring that the information shared is both trusted and mutually intelligible across various sectors.
62
+
63
+ By leveraging state-of-the-art AI models, LAiSER automates the process of identifying and classifying skills from diverse data sources. This not only saves time but also enhances accuracy, making it easier for users to discover emerging trends and in-demand skills.
64
+
65
+ The tool emphasizes standardization and transparency, offering a common framework that bridges the communication gap between different stakeholders. With LAiSER, educators can better align their teaching methods with industry requirements, and employers can more effectively identify the competencies required for their teams. The result is a more efficient and strategic approach to skill development, benefiting the entire ecosystem.
66
+
67
+ ## Requirements
68
+ - Python version >= Python 3.9.
69
+ - A GPU with atleast 15GB video memory is essential for running this tool on large datasets.
70
+
71
+ ## Setup and Installation
72
+
73
+ - Install LAiSER using pip:
74
+
75
+ ```shell
76
+ pip install uv
77
+ uv pip install laiser
78
+ ```
79
+ **NOTE**: Python 3.9 or later, *preferably 3.12*, is expected to be installed on your system. If you don't have Python installed, you can download it from [here](https://www.python.org/downloads/).
80
+
81
+ ## Usage
82
+
83
+ As of now LAiSER can be used a python package in Google Colab or a local machine with GPU access. The steps to setup the tool are as follows:
84
+
85
+ ### Google Colab Setup (preferred)
86
+ LAiSER's Jupyter notebook is, currently, the fastest way to get started with the tool. You can access the notebook [here](https://github.com/LAiSER-Software/extract-module/blob/main/dev_space/Extract%20Function%20Colab%20Execution.ipynb).
87
+
88
+ - Once the notebook is imported in google colaboratory, connect to a GPU-accelerated runtime(T4 GPU) and run the cells in the notebook.
89
+
90
+ - Sample code to import and verify laiser module
91
+ ```shell
92
+ from laiser.skill_extractor import Skill_Extractor
93
+ print('\n\nInitializing the Skill Extractor...')
94
+ # Replace 'your_model_id' and 'your_hf_token' with your actual credentials.
95
+ AI_MODEL_ID = "your_model_id" # e.g., "bert-base-uncased"
96
+ HF_TOKEN = "your_hf_token"
97
+ use_gpu = True # Change to False if you are not using a GPU
98
+ se = Skill_Extractor(AI_MODEL_ID=AI_MODEL_ID, HF_TOKEN=HF_TOKEN, use_gpu=use_gpu)
99
+ print('The Skill Extractor has been initialized successfully!\n')
100
+ print("LAiSER package loaded successfully!")
101
+ ```
102
+
103
+
104
+ ## Funding
105
+ <div align="center">
106
+ <img src="https://i.imgur.com/XtgngBz.png" width="100px"/>
107
+ <img src="https://i.imgur.com/a2SNYma.jpeg" width="130px"/>
108
+ </div>
109
+
110
+ ## Authors
111
+ <a href="https://github.com/LAiSER-Software/extract-module/graphs/contributors">
112
+ <img src="https://contrib.rocks/image?repo=LAiSER-Software/extract-module" />
113
+ </a>
114
+
115
+ ## Partners
116
+ <div align="center">
117
+ <img src="https://i.imgur.com/hMb5n6T.png" width="120px"/>
118
+ <img src="https://i.imgur.com/dxz2Udo.png" width="70px"/>
119
+ <img src="https://i.imgur.com/5O1EuFU.png" width="100px"/>
120
+ </div>
121
+
122
+
123
+
124
+ </br>
125
+ <!-- <p align='center'> <b> Made with Passion💖, Data Science📊, and a little magic!🪄 </b></p> -->
dev_laiser-0.0.1/README.md ADDED
@@ -0,0 +1,85 @@
1
+ <div align="center">
2
+ <img src="https://i.imgur.com/XznvjNi.png" width="70%"/>
3
+ <h2>Leveraging ​Artificial ​Intelligence for ​Skill ​Extraction &​ Research (LAiSER)</h2>
4
+ </div>
5
+
6
+ ### Contents
7
+ LAiSER is a tool that helps learners, educators and employers share trusted and mutually intelligible information about skills​.
8
+
9
+ - [About](#about)
10
+ - [Requirements](#requirements)
11
+ - [Setup and Installation](#setup-and-installation)
12
+ - [Install LAiSER](#install-LAiSER)
13
+ - [Usage](#usage)
14
+ - [Google Colab Setup(preferred)](#google-colab-setuppreferred)
15
+ - [Funding](#funding)
16
+ - [Authors](#authors)
17
+ - [Partners](#partners)
18
+
19
+ ## About
20
+
21
+ LAiSER is an innovative tool that harnesses the power of artificial intelligence to simplify the extraction and analysis of skills. It is designed for learners, educators, and employers who want to gain reliable insights into skill sets, ensuring that the information shared is both trusted and mutually intelligible across various sectors.
22
+
23
+ By leveraging state-of-the-art AI models, LAiSER automates the process of identifying and classifying skills from diverse data sources. This not only saves time but also enhances accuracy, making it easier for users to discover emerging trends and in-demand skills.
24
+
25
+ The tool emphasizes standardization and transparency, offering a common framework that bridges the communication gap between different stakeholders. With LAiSER, educators can better align their teaching methods with industry requirements, and employers can more effectively identify the competencies required for their teams. The result is a more efficient and strategic approach to skill development, benefiting the entire ecosystem.
26
+
27
+ ## Requirements
28
+ - Python version >= Python 3.9.
29
+ - A GPU with atleast 15GB video memory is essential for running this tool on large datasets.
30
+
31
+ ## Setup and Installation
32
+
33
+ - Install LAiSER using pip:
34
+
35
+ ```shell
36
+ pip install uv
37
+ uv pip install laiser
38
+ ```
39
+ **NOTE**: Python 3.9 or later, *preferably 3.12*, is expected to be installed on your system. If you don't have Python installed, you can download it from [here](https://www.python.org/downloads/).
40
+
41
+ ## Usage
42
+
43
+ As of now LAiSER can be used a python package in Google Colab or a local machine with GPU access. The steps to setup the tool are as follows:
44
+
45
+ ### Google Colab Setup (preferred)
46
+ LAiSER's Jupyter notebook is, currently, the fastest way to get started with the tool. You can access the notebook [here](https://github.com/LAiSER-Software/extract-module/blob/main/dev_space/Extract%20Function%20Colab%20Execution.ipynb).
47
+
48
+ - Once the notebook is imported in google colaboratory, connect to a GPU-accelerated runtime(T4 GPU) and run the cells in the notebook.
49
+
50
+ - Sample code to import and verify laiser module
51
+ ```shell
52
+ from laiser.skill_extractor import Skill_Extractor
53
+ print('\n\nInitializing the Skill Extractor...')
54
+ # Replace 'your_model_id' and 'your_hf_token' with your actual credentials.
55
+ AI_MODEL_ID = "your_model_id" # e.g., "bert-base-uncased"
56
+ HF_TOKEN = "your_hf_token"
57
+ use_gpu = True # Change to False if you are not using a GPU
58
+ se = Skill_Extractor(AI_MODEL_ID=AI_MODEL_ID, HF_TOKEN=HF_TOKEN, use_gpu=use_gpu)
59
+ print('The Skill Extractor has been initialized successfully!\n')
60
+ print("LAiSER package loaded successfully!")
61
+ ```
62
+
63
+
64
+ ## Funding
65
+ <div align="center">
66
+ <img src="https://i.imgur.com/XtgngBz.png" width="100px"/>
67
+ <img src="https://i.imgur.com/a2SNYma.jpeg" width="130px"/>
68
+ </div>
69
+
70
+ ## Authors
71
+ <a href="https://github.com/LAiSER-Software/extract-module/graphs/contributors">
72
+ <img src="https://contrib.rocks/image?repo=LAiSER-Software/extract-module" />
73
+ </a>
74
+
75
+ ## Partners
76
+ <div align="center">
77
+ <img src="https://i.imgur.com/hMb5n6T.png" width="120px"/>
78
+ <img src="https://i.imgur.com/dxz2Udo.png" width="70px"/>
79
+ <img src="https://i.imgur.com/5O1EuFU.png" width="100px"/>
80
+ </div>
81
+
82
+
83
+
84
+ </br>
85
+ <!-- <p align='center'> <b> Made with Passion💖, Data Science📊, and a little magic!🪄 </b></p> -->
dev_laiser-0.0.1/dev_laiser.egg-info/PKG-INFO ADDED
@@ -0,0 +1,125 @@
1
+ Metadata-Version: 2.2
2
+ Name: dev-laiser
3
+ Version: 0.0.1
4
+ Summary: LAiSER (Leveraging Artificial Intelligence for Skill Extraction & Research) is a tool designed to help learners, educators, and employers extract and share trusted information about skills. It uses a fine-tuned language model to extract raw skill keywords from text, then aligns them with a predefined taxonomy. You can find more technical details in the project’s paper.md and an overview in the README.md.
5
+ Home-page: https://github.com/LAiSER-Software/extract-module
6
+ Author: Satya Phanindra Kumar Kalaga, Bharat Khandelwal, Prudhvi Chekuri
7
+ Author-email: phanindra.connect@gmail.com
8
+ Classifier: Programming Language :: Python :: 3
9
+ Classifier: License :: OSI Approved :: BSD License
10
+ Classifier: Operating System :: OS Independent
11
+ Requires-Python: >=3.6
12
+ Description-Content-Type: text/markdown
13
+ License-File: LICENSE
14
+ Requires-Dist: numpy
15
+ Requires-Dist: pandas
16
+ Requires-Dist: psutil
17
+ Requires-Dist: skillNer
18
+ Requires-Dist: spacy
19
+ Requires-Dist: tokenizers
20
+ Requires-Dist: accelerate
21
+ Requires-Dist: bitsandbytes
22
+ Requires-Dist: datasets
23
+ Requires-Dist: huggingface_hub
24
+ Requires-Dist: peft
25
+ Requires-Dist: torch
26
+ Requires-Dist: trl
27
+ Requires-Dist: ipython
28
+ Requires-Dist: python-dotenv
29
+ Requires-Dist: tqdm
30
+ Requires-Dist: triton
31
+ Dynamic: author
32
+ Dynamic: author-email
33
+ Dynamic: classifier
34
+ Dynamic: description
35
+ Dynamic: description-content-type
36
+ Dynamic: home-page
37
+ Dynamic: requires-dist
38
+ Dynamic: requires-python
39
+ Dynamic: summary
40
+
41
+ <div align="center">
42
+ <img src="https://i.imgur.com/XznvjNi.png" width="70%"/>
43
+ <h2>Leveraging ​Artificial ​Intelligence for ​Skill ​Extraction &​ Research (LAiSER)</h2>
44
+ </div>
45
+
46
+ ### Contents
47
+ LAiSER is a tool that helps learners, educators and employers share trusted and mutually intelligible information about skills​.
48
+
49
+ - [About](#about)
50
+ - [Requirements](#requirements)
51
+ - [Setup and Installation](#setup-and-installation)
52
+ - [Install LAiSER](#install-LAiSER)
53
+ - [Usage](#usage)
54
+ - [Google Colab Setup(preferred)](#google-colab-setuppreferred)
55
+ - [Funding](#funding)
56
+ - [Authors](#authors)
57
+ - [Partners](#partners)
58
+
59
+ ## About
60
+
61
+ LAiSER is an innovative tool that harnesses the power of artificial intelligence to simplify the extraction and analysis of skills. It is designed for learners, educators, and employers who want to gain reliable insights into skill sets, ensuring that the information shared is both trusted and mutually intelligible across various sectors.
62
+
63
+ By leveraging state-of-the-art AI models, LAiSER automates the process of identifying and classifying skills from diverse data sources. This not only saves time but also enhances accuracy, making it easier for users to discover emerging trends and in-demand skills.
64
+
65
+ The tool emphasizes standardization and transparency, offering a common framework that bridges the communication gap between different stakeholders. With LAiSER, educators can better align their teaching methods with industry requirements, and employers can more effectively identify the competencies required for their teams. The result is a more efficient and strategic approach to skill development, benefiting the entire ecosystem.
66
+
67
+ ## Requirements
68
+ - Python version >= Python 3.9.
69
+ - A GPU with atleast 15GB video memory is essential for running this tool on large datasets.
70
+
71
+ ## Setup and Installation
72
+
73
+ - Install LAiSER using pip:
74
+
75
+ ```shell
76
+ pip install uv
77
+ uv pip install laiser
78
+ ```
79
+ **NOTE**: Python 3.9 or later, *preferably 3.12*, is expected to be installed on your system. If you don't have Python installed, you can download it from [here](https://www.python.org/downloads/).
80
+
81
+ ## Usage
82
+
83
+ As of now LAiSER can be used a python package in Google Colab or a local machine with GPU access. The steps to setup the tool are as follows:
84
+
85
+ ### Google Colab Setup (preferred)
86
+ LAiSER's Jupyter notebook is, currently, the fastest way to get started with the tool. You can access the notebook [here](https://github.com/LAiSER-Software/extract-module/blob/main/dev_space/Extract%20Function%20Colab%20Execution.ipynb).
87
+
88
+ - Once the notebook is imported in google colaboratory, connect to a GPU-accelerated runtime(T4 GPU) and run the cells in the notebook.
89
+
90
+ - Sample code to import and verify laiser module
91
+ ```shell
92
+ from laiser.skill_extractor import Skill_Extractor
93
+ print('\n\nInitializing the Skill Extractor...')
94
+ # Replace 'your_model_id' and 'your_hf_token' with your actual credentials.
95
+ AI_MODEL_ID = "your_model_id" # e.g., "bert-base-uncased"
96
+ HF_TOKEN = "your_hf_token"
97
+ use_gpu = True # Change to False if you are not using a GPU
98
+ se = Skill_Extractor(AI_MODEL_ID=AI_MODEL_ID, HF_TOKEN=HF_TOKEN, use_gpu=use_gpu)
99
+ print('The Skill Extractor has been initialized successfully!\n')
100
+ print("LAiSER package loaded successfully!")
101
+ ```
102
+
103
+
104
+ ## Funding
105
+ <div align="center">
106
+ <img src="https://i.imgur.com/XtgngBz.png" width="100px"/>
107
+ <img src="https://i.imgur.com/a2SNYma.jpeg" width="130px"/>
108
+ </div>
109
+
110
+ ## Authors
111
+ <a href="https://github.com/LAiSER-Software/extract-module/graphs/contributors">
112
+ <img src="https://contrib.rocks/image?repo=LAiSER-Software/extract-module" />
113
+ </a>
114
+
115
+ ## Partners
116
+ <div align="center">
117
+ <img src="https://i.imgur.com/hMb5n6T.png" width="120px"/>
118
+ <img src="https://i.imgur.com/dxz2Udo.png" width="70px"/>
119
+ <img src="https://i.imgur.com/5O1EuFU.png" width="100px"/>
120
+ </div>
121
+
122
+
123
+
124
+ </br>
125
+ <!-- <p align='center'> <b> Made with Passion💖, Data Science📊, and a little magic!🪄 </b></p> -->
dev_laiser-0.0.1/dev_laiser.egg-info/SOURCES.txt ADDED
@@ -0,0 +1,13 @@
1
+ LICENSE
2
+ README.md
3
+ setup.py
4
+ dev_laiser.egg-info/PKG-INFO
5
+ dev_laiser.egg-info/SOURCES.txt
6
+ dev_laiser.egg-info/dependency_links.txt
7
+ dev_laiser.egg-info/requires.txt
8
+ dev_laiser.egg-info/top_level.txt
9
+ laiser/__init__.py
10
+ laiser/llm_methods.py
11
+ laiser/params.py
12
+ laiser/skill_extractor.py
13
+ laiser/utils.py
dev_laiser-0.0.1/dev_laiser.egg-info/requires.txt ADDED
@@ -0,0 +1,17 @@
1
+ numpy
2
+ pandas
3
+ psutil
4
+ skillNer
5
+ spacy
6
+ tokenizers
7
+ accelerate
8
+ bitsandbytes
9
+ datasets
10
+ huggingface_hub
11
+ peft
12
+ torch
13
+ trl
14
+ ipython
15
+ python-dotenv
16
+ tqdm
17
+ triton
dev_laiser-0.0.1/dev_laiser.egg-info/top_level.txt ADDED
@@ -0,0 +1 @@
1
+ laiser
dev_laiser-0.0.1/laiser/__init__.py ADDED
File without changes