keras-hub-nightly 0.15.0.dev20240823171555__tar.gz

keras_hub_nightly-0.15.0.dev20240823171555/PKG-INFO

@@ -0,0 +1,34 @@
+Metadata-Version: 2.1
+Name: keras-hub-nightly
+Version: 0.15.0.dev20240823171555
+Summary: 🚧🚧🚧 Work in progress. 🚧🚧🚧 More details soon!
+Home-page: https://github.com/keras-team/keras-hub
+Author: Keras team
+Author-email: keras-hub@google.com
+License: Apache License 2.0
+Classifier: Development Status :: 3 - Alpha
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.8
+Classifier: Programming Language :: Python :: 3.9
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3 :: Only
+Classifier: Operating System :: Unix
+Classifier: Operating System :: Microsoft :: Windows
+Classifier: Operating System :: MacOS
+Classifier: Intended Audience :: Science/Research
+Classifier: Topic :: Scientific/Engineering
+Classifier: Topic :: Software Development
+Requires-Python: >=3.9
+Requires-Dist: absl-py
+Requires-Dist: numpy
+Requires-Dist: packaging
+Requires-Dist: regex
+Requires-Dist: rich
+Requires-Dist: kagglehub
+Requires-Dist: tensorflow-text; platform_system != "Darwin"
+Provides-Extra: extras
+Requires-Dist: rouge-score; extra == "extras"
+Requires-Dist: sentencepiece; extra == "extras"
+
+🚧🚧🚧 Work in progress. 🚧🚧🚧 More details soon!

keras_hub_nightly-0.15.0.dev20240823171555/README.md

@@ -0,0 +1,162 @@
+# KerasHub: Multi-framework NLP Models
+[![](https://github.com/keras-team/keras-hub/workflows/Tests/badge.svg?branch=master)](https://github.com/keras-team/keras-hub/actions?query=workflow%3ATests+branch%3Amaster)
+![Python](https://img.shields.io/badge/python-v3.9.0+-success.svg)
+[![contributions welcome](https://img.shields.io/badge/contributions-welcome-brightgreen.svg?style=flat)](https://github.com/keras-team/keras-hub/issues)
+
+KerasHub is a natural language processing library that works natively
+with TensorFlow, JAX, or PyTorch. KerasHub provides a repository of pre-trained
+models and a collection of lower-level building blocks for language modeling.
+Built on Keras 3, models can be trained and serialized in any framework
+and re-used in another without costly migrations.
+
+This library is an extension of the core Keras API; all high-level modules are
+Layers and Models that receive that same level of polish as core Keras.
+If you are familiar with Keras, congratulations! You already understand most of
+KerasHub.
+
+All models support JAX, TensorFlow, and PyTorch from a single model
+definition and can be fine-tuned on GPUs and TPUs out of the box. Models can
+be trained on individual accelerators with built-in PEFT techniques, or
+fine-tuned at scale with model and data parallel training. See our
+[Getting Started guide](https://keras.io/guides/keras_hub/getting_started)
+to start learning our API. Browse our models on
+[Kaggle](https://www.kaggle.com/organizations/keras/models).
+We welcome contributions.
+
+## Quick Links
+
+### For everyone
+
+- [Home Page](https://keras.io/keras_hub)
+- [Developer Guides](https://keras.io/guides/keras_hub)
+- [API Reference](https://keras.io/api/keras_hub)
+- [Pre-trained Models](https://www.kaggle.com/organizations/keras/models)
+
+### For contributors
+
+- [Contributing Guide](CONTRIBUTING.md)
+- [Roadmap](ROADMAP.md)
+- [Style Guide](STYLE_GUIDE.md)
+- [API Design Guide](API_DESIGN_GUIDE.md)
+- [Call for Contributions](https://github.com/keras-team/keras-hub/issues?q=is%3Aissue+is%3Aopen+label%3A%22contributions+welcome%22)
+
+## Quickstart
+
+Fine-tune BERT on IMDb movie reviews:
+
+```python
+import os
+os.environ["KERAS_BACKEND"] = "jax"  # Or "tensorflow" or "torch"!
+
+import keras_hub
+import tensorflow_datasets as tfds
+
+imdb_train, imdb_test = tfds.load(
+    "imdb_reviews",
+    split=["train", "test"],
+    as_supervised=True,
+    batch_size=16,
+)
+# Load a BERT model.
+classifier = keras_hub.models.Classifier.from_preset(
+    "bert_base_en", 
+    num_classes=2,
+    activation="softmax",
+)
+# Fine-tune on IMDb movie reviews.
+classifier.fit(imdb_train, validation_data=imdb_test)
+# Predict two new examples.
+classifier.predict(["What an amazing movie!", "A total waste of my time."])
+```
+
+Try it out [in a colab](https://colab.research.google.com/gist/mattdangerw/e457e42d5ea827110c8d5cb4eb9d9a07/kerasnlp-quickstart.ipynb).
+For more in depth guides and examples, visit
+[keras.io/keras_hub](https://keras.io/keras_hub/).
+
+## Installation
+
+To install the latest KerasHub release with Keras 3, simply run:
+
+```
+pip install --upgrade keras-hub
+```
+
+To install the latest nightly changes for both KerasHub and Keras, you can use
+our nightly package.
+
+```
+pip install --upgrade keras-hub-nightly
+```
+
+Note that currently, installing KerasHub will always pull in TensorFlow for use
+of the `tf.data` API for preprocessing. Even when pre-processing with `tf.data`,
+training can still happen on any backend.
+
+Read [Getting started with Keras](https://keras.io/getting_started/) for more
+information on installing Keras 3 and compatibility with different frameworks.
+
+> [!IMPORTANT]
+> We recommend using KerasHub with TensorFlow 2.16 or later, as TF 2.16 packages
+> Keras 3 by default.
+
+## Configuring your backend
+
+If you have Keras 3 installed in your environment (see installation above),
+you can use KerasHub with any of JAX, TensorFlow and PyTorch. To do so, set the
+`KERAS_BACKEND` environment variable. For example:
+
+```shell
+export KERAS_BACKEND=jax
+```
+
+Or in Colab, with:
+
+```python
+import os
+os.environ["KERAS_BACKEND"] = "jax"
+
+import keras_hub
+```
+
+> [!IMPORTANT]
+> Make sure to set the `KERAS_BACKEND` before import any Keras libraries, it
+> will be used to set up Keras when it is first imported.
+
+## Compatibility
+
+We follow [Semantic Versioning](https://semver.org/), and plan to
+provide backwards compatibility guarantees both for code and saved models built
+with our components. While we continue with pre-release `0.y.z` development, we
+may break compatibility at any time and APIs should not be consider stable.
+
+## Disclaimer
+
+KerasHub provides access to pre-trained models via the `keras_hub.models` API.
+These pre-trained models are provided on an "as is" basis, without warranties
+or conditions of any kind. The following underlying models are provided by third
+parties, and subject to separate licenses:
+BART, BLOOM, DeBERTa, DistilBERT, GPT-2, Llama, Mistral, OPT, RoBERTa, Whisper,
+and XLM-RoBERTa.
+
+## Citing KerasHub
+
+If KerasHub helps your research, we appreciate your citations.
+Here is the BibTeX entry:
+
+```bibtex
+@misc{kerasnlp2022,
+  title={KerasHub},
+  author={Watson, Matthew, and Qian, Chen, and Bischof, Jonathan and Chollet, 
+  Fran\c{c}ois and others},
+  year={2022},
+  howpublished={\url{https://github.com/keras-team/keras-hub}},
+}
+```
+
+## Acknowledgements
+
+Thank you to all of our wonderful contributors!
+
+<a href="https://github.com/keras-team/keras-hub/graphs/contributors">
+  <img src="https://contrib.rocks/image?repo=keras-team/keras-hub" />
+</a>

keras_hub_nightly-0.15.0.dev20240823171555/keras_hub/__init__.py

@@ -0,0 +1,52 @@
+# Copyright 2024 The KerasHub Authors
+#
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#     https://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+"""DO NOT EDIT.
+
+This file was autogenerated. Do not edit it by hand,
+since your modifications would be overwritten.
+"""
+
+import os
+
+# sentencepiece segfaults on some version of tensorflow if tf is imported first.
+try:
+    import sentencepiece
+except ImportError:
+    pass
+
+# Import everything from /api/ into keras.
+from keras_hub.api import *  # noqa: F403
+from keras_hub.api import __version__  # Import * ignores names start with "_".
+
+# Add everything in /api/ to the module search path.
+__path__.append(os.path.join(os.path.dirname(__file__), "api"))  # noqa: F405
+
+# Don't pollute namespace.
+del os
+
+
+# Never autocomplete `.src` or `.api` on an imported keras object.
+def __dir__():
+    keys = dict.fromkeys((globals().keys()))
+    keys.pop("src")
+    keys.pop("api")
+    return list(keys)
+
+
+# Don't import `.src` or `.api` during `from keras import *`.
+__all__ = [
+    name
+    for name in globals().keys()
+    if not (name.startswith("_") or name in ("src", "api"))
+]

keras_hub_nightly-0.15.0.dev20240823171555/keras_hub/api/__init__.py

@@ -0,0 +1,27 @@
+# Copyright 2024 The KerasHub Authors
+#
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#     https://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+"""DO NOT EDIT.
+
+This file was autogenerated. Do not edit it by hand,
+since your modifications would be overwritten.
+"""
+
+from keras_hub.api import layers
+from keras_hub.api import metrics
+from keras_hub.api import models
+from keras_hub.api import samplers
+from keras_hub.api import tokenizers
+from keras_hub.src.utils.preset_utils import upload_preset
+from keras_hub.src.version_utils import __version__
+from keras_hub.src.version_utils import version

keras_hub_nightly-0.15.0.dev20240823171555/keras_hub/api/layers/__init__.py

@@ -0,0 +1,47 @@
+# Copyright 2024 The KerasHub Authors
+#
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#     https://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+"""DO NOT EDIT.
+
+This file was autogenerated. Do not edit it by hand,
+since your modifications would be overwritten.
+"""
+
+from keras_hub.src.layers.modeling.alibi_bias import AlibiBias
+from keras_hub.src.layers.modeling.cached_multi_head_attention import (
+    CachedMultiHeadAttention,
+)
+from keras_hub.src.layers.modeling.f_net_encoder import FNetEncoder
+from keras_hub.src.layers.modeling.masked_lm_head import MaskedLMHead
+from keras_hub.src.layers.modeling.position_embedding import PositionEmbedding
+from keras_hub.src.layers.modeling.reversible_embedding import (
+    ReversibleEmbedding,
+)
+from keras_hub.src.layers.modeling.rotary_embedding import RotaryEmbedding
+from keras_hub.src.layers.modeling.sine_position_encoding import (
+    SinePositionEncoding,
+)
+from keras_hub.src.layers.modeling.token_and_position_embedding import (
+    TokenAndPositionEmbedding,
+)
+from keras_hub.src.layers.modeling.transformer_decoder import TransformerDecoder
+from keras_hub.src.layers.modeling.transformer_encoder import TransformerEncoder
+from keras_hub.src.layers.preprocessing.masked_lm_mask_generator import (
+    MaskedLMMaskGenerator,
+)
+from keras_hub.src.layers.preprocessing.multi_segment_packer import (
+    MultiSegmentPacker,
+)
+from keras_hub.src.layers.preprocessing.random_deletion import RandomDeletion
+from keras_hub.src.layers.preprocessing.random_swap import RandomSwap
+from keras_hub.src.layers.preprocessing.start_end_packer import StartEndPacker

keras_hub_nightly-0.15.0.dev20240823171555/keras_hub/api/metrics/__init__.py

@@ -0,0 +1,24 @@
+# Copyright 2024 The KerasHub Authors
+#
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#     https://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+"""DO NOT EDIT.
+
+This file was autogenerated. Do not edit it by hand,
+since your modifications would be overwritten.
+"""
+
+from keras_hub.src.metrics.bleu import Bleu
+from keras_hub.src.metrics.edit_distance import EditDistance
+from keras_hub.src.metrics.perplexity import Perplexity
+from keras_hub.src.metrics.rouge_l import RougeL
+from keras_hub.src.metrics.rouge_n import RougeN

keras_hub_nightly-0.15.0.dev20240823171555/keras_hub/api/models/__init__.py

@@ -0,0 +1,249 @@
+# Copyright 2024 The KerasHub Authors
+#
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#     https://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+"""DO NOT EDIT.
+
+This file was autogenerated. Do not edit it by hand,
+since your modifications would be overwritten.
+"""
+
+from keras_hub.src.models.albert.albert_backbone import AlbertBackbone
+from keras_hub.src.models.albert.albert_classifier import AlbertClassifier
+from keras_hub.src.models.albert.albert_masked_lm import AlbertMaskedLM
+from keras_hub.src.models.albert.albert_masked_lm_preprocessor import (
+    AlbertMaskedLMPreprocessor,
+)
+from keras_hub.src.models.albert.albert_preprocessor import AlbertPreprocessor
+from keras_hub.src.models.albert.albert_tokenizer import AlbertTokenizer
+from keras_hub.src.models.backbone import Backbone
+from keras_hub.src.models.bart.bart_backbone import BartBackbone
+from keras_hub.src.models.bart.bart_preprocessor import BartPreprocessor
+from keras_hub.src.models.bart.bart_seq_2_seq_lm import BartSeq2SeqLM
+from keras_hub.src.models.bart.bart_seq_2_seq_lm_preprocessor import (
+    BartSeq2SeqLMPreprocessor,
+)
+from keras_hub.src.models.bart.bart_tokenizer import BartTokenizer
+from keras_hub.src.models.bert.bert_backbone import BertBackbone
+from keras_hub.src.models.bert.bert_classifier import BertClassifier
+from keras_hub.src.models.bert.bert_masked_lm import BertMaskedLM
+from keras_hub.src.models.bert.bert_masked_lm_preprocessor import (
+    BertMaskedLMPreprocessor,
+)
+from keras_hub.src.models.bert.bert_preprocessor import BertPreprocessor
+from keras_hub.src.models.bert.bert_tokenizer import BertTokenizer
+from keras_hub.src.models.bloom.bloom_backbone import BloomBackbone
+from keras_hub.src.models.bloom.bloom_causal_lm import BloomCausalLM
+from keras_hub.src.models.bloom.bloom_causal_lm_preprocessor import (
+    BloomCausalLMPreprocessor,
+)
+from keras_hub.src.models.bloom.bloom_preprocessor import BloomPreprocessor
+from keras_hub.src.models.bloom.bloom_tokenizer import BloomTokenizer
+from keras_hub.src.models.causal_lm import CausalLM
+from keras_hub.src.models.classifier import Classifier
+from keras_hub.src.models.csp_darknet.csp_darknet_backbone import (
+    CSPDarkNetBackbone,
+)
+from keras_hub.src.models.csp_darknet.csp_darknet_image_classifier import (
+    CSPDarkNetImageClassifier,
+)
+from keras_hub.src.models.deberta_v3.deberta_v3_backbone import (
+    DebertaV3Backbone,
+)
+from keras_hub.src.models.deberta_v3.deberta_v3_classifier import (
+    DebertaV3Classifier,
+)
+from keras_hub.src.models.deberta_v3.deberta_v3_masked_lm import (
+    DebertaV3MaskedLM,
+)
+from keras_hub.src.models.deberta_v3.deberta_v3_masked_lm_preprocessor import (
+    DebertaV3MaskedLMPreprocessor,
+)
+from keras_hub.src.models.deberta_v3.deberta_v3_preprocessor import (
+    DebertaV3Preprocessor,
+)
+from keras_hub.src.models.deberta_v3.deberta_v3_tokenizer import (
+    DebertaV3Tokenizer,
+)
+from keras_hub.src.models.densenet.densenet_backbone import DenseNetBackbone
+from keras_hub.src.models.densenet.densenet_image_classifier import (
+    DenseNetImageClassifier,
+)
+from keras_hub.src.models.distil_bert.distil_bert_backbone import (
+    DistilBertBackbone,
+)
+from keras_hub.src.models.distil_bert.distil_bert_classifier import (
+    DistilBertClassifier,
+)
+from keras_hub.src.models.distil_bert.distil_bert_masked_lm import (
+    DistilBertMaskedLM,
+)
+from keras_hub.src.models.distil_bert.distil_bert_masked_lm_preprocessor import (
+    DistilBertMaskedLMPreprocessor,
+)
+from keras_hub.src.models.distil_bert.distil_bert_preprocessor import (
+    DistilBertPreprocessor,
+)
+from keras_hub.src.models.distil_bert.distil_bert_tokenizer import (
+    DistilBertTokenizer,
+)
+from keras_hub.src.models.electra.electra_backbone import ElectraBackbone
+from keras_hub.src.models.electra.electra_preprocessor import (
+    ElectraPreprocessor,
+)
+from keras_hub.src.models.electra.electra_tokenizer import ElectraTokenizer
+from keras_hub.src.models.f_net.f_net_backbone import FNetBackbone
+from keras_hub.src.models.f_net.f_net_classifier import FNetClassifier
+from keras_hub.src.models.f_net.f_net_masked_lm import FNetMaskedLM
+from keras_hub.src.models.f_net.f_net_masked_lm_preprocessor import (
+    FNetMaskedLMPreprocessor,
+)
+from keras_hub.src.models.f_net.f_net_preprocessor import FNetPreprocessor
+from keras_hub.src.models.f_net.f_net_tokenizer import FNetTokenizer
+from keras_hub.src.models.falcon.falcon_backbone import FalconBackbone
+from keras_hub.src.models.falcon.falcon_causal_lm import FalconCausalLM
+from keras_hub.src.models.falcon.falcon_causal_lm_preprocessor import (
+    FalconCausalLMPreprocessor,
+)
+from keras_hub.src.models.falcon.falcon_preprocessor import FalconPreprocessor
+from keras_hub.src.models.falcon.falcon_tokenizer import FalconTokenizer
+from keras_hub.src.models.feature_pyramid_backbone import FeaturePyramidBackbone
+from keras_hub.src.models.gemma.gemma_backbone import GemmaBackbone
+from keras_hub.src.models.gemma.gemma_causal_lm import GemmaCausalLM
+from keras_hub.src.models.gemma.gemma_causal_lm_preprocessor import (
+    GemmaCausalLMPreprocessor,
+)
+from keras_hub.src.models.gemma.gemma_preprocessor import GemmaPreprocessor
+from keras_hub.src.models.gemma.gemma_tokenizer import GemmaTokenizer
+from keras_hub.src.models.gpt2.gpt2_backbone import GPT2Backbone
+from keras_hub.src.models.gpt2.gpt2_causal_lm import GPT2CausalLM
+from keras_hub.src.models.gpt2.gpt2_causal_lm_preprocessor import (
+    GPT2CausalLMPreprocessor,
+)
+from keras_hub.src.models.gpt2.gpt2_preprocessor import GPT2Preprocessor
+from keras_hub.src.models.gpt2.gpt2_tokenizer import GPT2Tokenizer
+from keras_hub.src.models.gpt_neo_x.gpt_neo_x_backbone import GPTNeoXBackbone
+from keras_hub.src.models.gpt_neo_x.gpt_neo_x_causal_lm import GPTNeoXCausalLM
+from keras_hub.src.models.gpt_neo_x.gpt_neo_x_causal_lm_preprocessor import (
+    GPTNeoXCausalLMPreprocessor,
+)
+from keras_hub.src.models.gpt_neo_x.gpt_neo_x_preprocessor import (
+    GPTNeoXPreprocessor,
+)
+from keras_hub.src.models.gpt_neo_x.gpt_neo_x_tokenizer import GPTNeoXTokenizer
+from keras_hub.src.models.image_classifier import ImageClassifier
+from keras_hub.src.models.llama3.llama3_backbone import Llama3Backbone
+from keras_hub.src.models.llama3.llama3_causal_lm import Llama3CausalLM
+from keras_hub.src.models.llama3.llama3_causal_lm_preprocessor import (
+    Llama3CausalLMPreprocessor,
+)
+from keras_hub.src.models.llama3.llama3_preprocessor import Llama3Preprocessor
+from keras_hub.src.models.llama3.llama3_tokenizer import Llama3Tokenizer
+from keras_hub.src.models.llama.llama_backbone import LlamaBackbone
+from keras_hub.src.models.llama.llama_causal_lm import LlamaCausalLM
+from keras_hub.src.models.llama.llama_causal_lm_preprocessor import (
+    LlamaCausalLMPreprocessor,
+)
+from keras_hub.src.models.llama.llama_preprocessor import LlamaPreprocessor
+from keras_hub.src.models.llama.llama_tokenizer import LlamaTokenizer
+from keras_hub.src.models.masked_lm import MaskedLM
+from keras_hub.src.models.mistral.mistral_backbone import MistralBackbone
+from keras_hub.src.models.mistral.mistral_causal_lm import MistralCausalLM
+from keras_hub.src.models.mistral.mistral_causal_lm_preprocessor import (
+    MistralCausalLMPreprocessor,
+)
+from keras_hub.src.models.mistral.mistral_preprocessor import (
+    MistralPreprocessor,
+)
+from keras_hub.src.models.mistral.mistral_tokenizer import MistralTokenizer
+from keras_hub.src.models.mix_transformer.mix_transformer_backbone import (
+    MiTBackbone,
+)
+from keras_hub.src.models.mix_transformer.mix_transformer_classifier import (
+    MiTImageClassifier,
+)
+from keras_hub.src.models.opt.opt_backbone import OPTBackbone
+from keras_hub.src.models.opt.opt_causal_lm import OPTCausalLM
+from keras_hub.src.models.opt.opt_causal_lm_preprocessor import (
+    OPTCausalLMPreprocessor,
+)
+from keras_hub.src.models.opt.opt_preprocessor import OPTPreprocessor
+from keras_hub.src.models.opt.opt_tokenizer import OPTTokenizer
+from keras_hub.src.models.pali_gemma.pali_gemma_backbone import (
+    PaliGemmaBackbone,
+)
+from keras_hub.src.models.pali_gemma.pali_gemma_causal_lm import (
+    PaliGemmaCausalLM,
+)
+from keras_hub.src.models.pali_gemma.pali_gemma_causal_lm_preprocessor import (
+    PaliGemmaCausalLMPreprocessor,
+)
+from keras_hub.src.models.pali_gemma.pali_gemma_tokenizer import (
+    PaliGemmaTokenizer,
+)
+from keras_hub.src.models.phi3.phi3_backbone import Phi3Backbone
+from keras_hub.src.models.phi3.phi3_causal_lm import Phi3CausalLM
+from keras_hub.src.models.phi3.phi3_causal_lm_preprocessor import (
+    Phi3CausalLMPreprocessor,
+)
+from keras_hub.src.models.phi3.phi3_preprocessor import Phi3Preprocessor
+from keras_hub.src.models.phi3.phi3_tokenizer import Phi3Tokenizer
+from keras_hub.src.models.preprocessor import Preprocessor
+from keras_hub.src.models.resnet.resnet_backbone import ResNetBackbone
+from keras_hub.src.models.resnet.resnet_image_classifier import (
+    ResNetImageClassifier,
+)
+from keras_hub.src.models.roberta.roberta_backbone import RobertaBackbone
+from keras_hub.src.models.roberta.roberta_classifier import RobertaClassifier
+from keras_hub.src.models.roberta.roberta_masked_lm import RobertaMaskedLM
+from keras_hub.src.models.roberta.roberta_masked_lm_preprocessor import (
+    RobertaMaskedLMPreprocessor,
+)
+from keras_hub.src.models.roberta.roberta_preprocessor import (
+    RobertaPreprocessor,
+)
+from keras_hub.src.models.roberta.roberta_tokenizer import RobertaTokenizer
+from keras_hub.src.models.seq_2_seq_lm import Seq2SeqLM
+from keras_hub.src.models.t5.t5_backbone import T5Backbone
+from keras_hub.src.models.t5.t5_tokenizer import T5Tokenizer
+from keras_hub.src.models.task import Task
+from keras_hub.src.models.vgg.vgg_backbone import VGGBackbone
+from keras_hub.src.models.vgg.vgg_image_classifier import VGGImageClassifier
+from keras_hub.src.models.vit_det.vit_det_backbone import ViTDetBackbone
+from keras_hub.src.models.whisper.whisper_audio_feature_extractor import (
+    WhisperAudioFeatureExtractor,
+)
+from keras_hub.src.models.whisper.whisper_backbone import WhisperBackbone
+from keras_hub.src.models.whisper.whisper_preprocessor import (
+    WhisperPreprocessor,
+)
+from keras_hub.src.models.whisper.whisper_tokenizer import WhisperTokenizer
+from keras_hub.src.models.xlm_roberta.xlm_roberta_backbone import (
+    XLMRobertaBackbone,
+)
+from keras_hub.src.models.xlm_roberta.xlm_roberta_classifier import (
+    XLMRobertaClassifier,
+)
+from keras_hub.src.models.xlm_roberta.xlm_roberta_masked_lm import (
+    XLMRobertaMaskedLM,
+)
+from keras_hub.src.models.xlm_roberta.xlm_roberta_masked_lm_preprocessor import (
+    XLMRobertaMaskedLMPreprocessor,
+)
+from keras_hub.src.models.xlm_roberta.xlm_roberta_preprocessor import (
+    XLMRobertaPreprocessor,
+)
+from keras_hub.src.models.xlm_roberta.xlm_roberta_tokenizer import (
+    XLMRobertaTokenizer,
+)
+from keras_hub.src.models.xlnet.xlnet_backbone import XLNetBackbone
+from keras_hub.src.tokenizers.tokenizer import Tokenizer

keras_hub_nightly-0.15.0.dev20240823171555/keras_hub/api/samplers/__init__.py

@@ -0,0 +1,29 @@
+# Copyright 2024 The KerasHub Authors
+#
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#     https://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+"""DO NOT EDIT.
+
+This file was autogenerated. Do not edit it by hand,
+since your modifications would be overwritten.
+"""
+
+from keras_hub.src.samplers.beam_sampler import BeamSampler
+from keras_hub.src.samplers.contrastive_sampler import ContrastiveSampler
+from keras_hub.src.samplers.greedy_sampler import GreedySampler
+from keras_hub.src.samplers.random_sampler import RandomSampler
+from keras_hub.src.samplers.sampler import Sampler
+from keras_hub.src.samplers.serialization import deserialize
+from keras_hub.src.samplers.serialization import get
+from keras_hub.src.samplers.serialization import serialize
+from keras_hub.src.samplers.top_k_sampler import TopKSampler
+from keras_hub.src.samplers.top_p_sampler import TopPSampler

keras_hub_nightly-0.15.0.dev20240823171555/keras_hub/api/tokenizers/__init__.py

@@ -0,0 +1,35 @@
+# Copyright 2024 The KerasHub Authors
+#
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#     https://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+"""DO NOT EDIT.
+
+This file was autogenerated. Do not edit it by hand,
+since your modifications would be overwritten.
+"""
+
+from keras_hub.src.tokenizers.byte_pair_tokenizer import BytePairTokenizer
+from keras_hub.src.tokenizers.byte_tokenizer import ByteTokenizer
+from keras_hub.src.tokenizers.sentence_piece_tokenizer import (
+    SentencePieceTokenizer,
+)
+from keras_hub.src.tokenizers.sentence_piece_tokenizer_trainer import (
+    compute_sentence_piece_proto,
+)
+from keras_hub.src.tokenizers.tokenizer import Tokenizer
+from keras_hub.src.tokenizers.unicode_codepoint_tokenizer import (
+    UnicodeCodepointTokenizer,
+)
+from keras_hub.src.tokenizers.word_piece_tokenizer import WordPieceTokenizer
+from keras_hub.src.tokenizers.word_piece_tokenizer_trainer import (
+    compute_word_piece_vocabulary,
+)

keras_hub_nightly-0.15.0.dev20240823171555/keras_hub/src/__init__.py

@@ -0,0 +1,13 @@
+# Copyright 2024 The KerasHub Authors
+#
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#     https://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.