ngclearn 1.0b0__tar.gz

ngclearn-1.0b0/AUTHORS

@@ -0,0 +1,15 @@
+# This file contains an official list of authors of this framework.
+
+# Names should be added to this file as:
+# Name or Organization <email address>
+# The email address is not required for organizations.
+
+Core Team
+Alexander Ororbia <ago@cs.rit.edu>
+Ankur Mali <aam35@psu.edu>
+William Gebhardt <wdg1351@rit.edu>
+
+Contributors
+Maxbeth2 (Ohas)
+pagrawal-psu
+pulinagrawal

ngclearn-1.0b0/LICENSE

@@ -0,0 +1,29 @@
+BSD 3-Clause License
+
+Copyright (c) 2021, The Neural Adaptive Computing Laboratory
+All rights reserved.
+
+Redistribution and use in source and binary forms, with or without
+modification, are permitted provided that the following conditions are met:
+
+1. Redistributions of source code must retain the above copyright notice, this
+   list of conditions and the following disclaimer.
+
+2. Redistributions in binary form must reproduce the above copyright notice,
+   this list of conditions and the following disclaimer in the documentation
+   and/or other materials provided with the distribution.
+
+3. Neither the name of the copyright holder nor the names of its
+   contributors may be used to endorse or promote products derived from
+   this software without specific prior written permission.
+
+THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS"
+AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
+IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
+DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE
+FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
+DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR
+SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER
+CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY,
+OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
+OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

ngclearn-1.0b0/PKG-INFO

@@ -0,0 +1,188 @@
+Metadata-Version: 2.1
+Name: ngclearn
+Version: 1.0b0
+Summary: Simulation software for building and analyzing arbitrary predictive coding, spiking network, and biomimetic neural systems.
+Author-email: Alexander Ororbia <ago@cs.rit.edu>, William Gebhardt <wdg1351@rit.edu>
+License: BSD-3-Clause License
+Project-URL: Homepage, https://github.com/NACLab/ngc-learn
+Project-URL: Documentation, https://ngc-learn.readthedocs.io/
+Project-URL: Lab Page, https://www.cs.rit.edu/~ago/nac_lab.html
+Project-URL: Changelog, https://github.com/NACLab/ngc-learn/blob/main/history.txt
+Keywords: python,ngc-learn,predictive-processing,predictive-coding,jax,spiking-neural-networks,biomimetics,bionics,computational-neuroscience
+Classifier: Development Status :: 4 - Beta
+Classifier: Intended Audience :: Education
+Classifier: Intended Audience :: Science/Research
+Classifier: Intended Audience :: Developers
+Classifier: License :: OSI Approved :: BSD License
+Classifier: Topic :: Scientific/Engineering
+Classifier: Topic :: Scientific/Engineering :: Mathematics
+Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
+Classifier: Programming Language :: Python
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Operating System :: Unix
+Requires-Python: >=3.10
+Description-Content-Type: text/markdown
+License-File: LICENSE
+License-File: AUTHORS
+Requires-Dist: numpy>=1.26.0
+Requires-Dist: scikit-learn>=0.24.2
+Requires-Dist: scipy>=1.7.0
+Requires-Dist: matplotlib>=3.8.0
+Requires-Dist: patchify
+Requires-Dist: jax>=0.4.18
+Requires-Dist: jaxlib>=0.4.18
+Requires-Dist: ngcsimlib>=0.2.b1
+Requires-Dist: imageio>=2.31.5
+
+[![Python Version](https://img.shields.io/badge/python-3.9%20%7C%203.10-blue.svg)](https://www.python.org/downloads)[![License](https://img.shields.io/badge/License-BSD_3--Clause-blue.svg)](https://opensource.org/licenses/BSD-3-Clause)[![Maintenance](https://img.shields.io/badge/Maintained%3F-yes-green.svg)](https://GitHub.com/Naereen/StrapDown.js/graphs/commit-activity)[![Documentation Status](https://readthedocs.org/projects/ngc-learn/badge/?version=latest)](http://ngc-learn.readthedocs.io/en/latest/?badge=latest)[![DOI](https://zenodo.org/badge/483413212.svg)](https://zenodo.org/badge/latestdoi/483413212)
+
+<img src="docs/images/ngc-learn-logo.png" width="300">
+
+<b>ngc-learn</b> is a Python library for building, simulating, and analyzing
+biomimetic systems, neurobiological agents, spiking neuronal networks,
+predictive coding circuitry, and models that learn via biologically-plausible
+forms of credit assignment. This simulation toolkit is built on top of JAX and is
+distributed under the 3-Clause BSD license.
+
+It is currently maintained by the
+<a href="https://www.cs.rit.edu/~ago/nac_lab.html">Neural Adaptive Computing (NAC) laboratory</a>.
+
+## <b>Documentation</b>
+
+Official documentation, including tutorials, can be found
+<a href="https://ngc-learn.readthedocs.io/en/latest/#">here</a>.
+
+The official blog-post related to the source paper behind this software library
+can be found
+<a href="https://go.nature.com/3rgl1K8">here</a>.<br>
+You can find the related paper <a href="https://www.nature.com/articles/s41467-022-29632-7">right here</a>, which
+was selected to appear in the Nature <i>Neuromorphic Hardware and Computing Collection</i> in 2023 and was
+chosen as one of the <i>Editors' Highlights for Applied Physics and Mathematics</i> in 2022.
+
+<!--The technical report going over the theoretical underpinnings of the
+    NGC framework can be found here. TO BE RELEASED SOON. -->
+
+## Installation
+
+### Dependencies
+
+ngc-learn requires:
+1) Python (>=3.10)
+2) NumPy (>=1.26.0)
+3) SciPy (>=1.7.0)
+4) ngcsimlib (>=0.2.b1), (visit official page <a href="https://github.com/NACLab/ngc-sim-lib">here</a>)
+5) JAX (>= 0.4.18) (to enable GPU use, make sure to install one of the CUDA variants)
+<!--
+5) scikit-learn (>=1.3.1) if using `ngclearn.utils.density`
+6) matplotlib (>=3.4.3) if using `ngclearn.utils.viz`
+6) networkx  (>=2.6.3) (currently optional but required if using `ngclearn.utils.experimental.viz_utils`)
+7) pyviz (>=0.2.0) (currently optional but required if using `ngclearn.utils.experimental.viz_utils`)
+-->
+
+---
+ngc-learn 1.0.beta0 and later require Python 3.10 or newer as well as ngcsimlib >=0.2.b1.
+ngc-learn's plotting capabilities (routines within `ngclearn.utils.viz`) require
+Matplotlib (>=3.8.0) and imageio (>=2.31.5) and both plotting and density estimation
+tools (routines within ``ngclearn.utils.density``) will require Scikit-learn (>=0.24.2).
+Many of the tutorials will require Matplotlib (>=3.8.0), imageio (>=2.31.5), and Scikit-learn (>=0.24.2).
+<!-- (Note: if using the `_generate_patch_set()` within the
+image patching utilities, then Patchify will be needed).-->
+
+### User Installation
+
+<i>Setup</i>: The easiest way to install ngc-learn (CPU version) is through <code>pip</code>:
+<pre>
+$ python install ngclearn
+</pre>
+
+The documentation includes more detailed
+<a href="https://ngc-learn.readthedocs.io/en/latest/installation.html">installation instructions</a>.
+Note that this library was developed on Ubuntu 20.04 and tested on Ubuntu(s) 18.04 and 20.04.
+
+<!--
+<i>Setup:</i> To install ngc-learn, you can run (at the top-level of the
+the <code>ngclearn</code> directory) the following bash command:
+<pre>
+$ python install .
+</pre>
+
+Running the above pip install will automatically install the CPU
+version of JAX. If you want to use the GPU version instead, make sure to,
+before running the above, to install JAX via the correct pip command
+with the proper CUDA flags (depending on which CUDA is configured for your system)
+as per their
+<a href="https://jax.readthedocs.io/en/latest/installation.html">installation instructions</a>.
+-->
+
+<!--
+(If you want to set up/install dependencies a priori, try running
+`$ pip install -r requirements.txt` first before pip installing ngc-learn.)
+-->
+
+If the installation was successful, you should see the following if you test
+it against your Python interpreter, i.e., run the <code>$ python</code> command
+and complete the following sequence of steps as depicted in the screenshot below:<br>
+<img src="docs/images/test_ngclearn_install.png" width="512">
+
+<i>Note:</i> For access to the previous Tensorflow-2 version of ngc-learn (of
+which we no longer support), please visit the repo for
+<a href="https://github.com/NACLab/ngc-learn-legacy"><i>ngc-learn-legacy</i></a>.
+
+## <b>Attribution:</b>
+
+If you use this code in any form in your project(s), please cite its source
+paper (as well as ngc-learn's official software citation):
+<pre>
+@article{Ororbia2022,
+  author={Ororbia, Alexander and Kifer, Daniel},
+  title={The neural coding framework for learning generative models},
+  journal={Nature Communications},
+  year={2022},
+  month={Apr},
+  day={19},
+  volume={13},
+  number={1},
+  pages={2064},
+  issn={2041-1723},
+  doi={10.1038/s41467-022-29632-7},
+  url={https://doi.org/10.1038/s41467-022-29632-7}
+}
+</pre>
+
+## <b>Development:</b>
+
+We warmly welcome community contributions to this project. For details on how to
+make a contribution to ngc-learn, please see our
+[contributing guidelines](CONTRIBUTING.md).
+
+<b>Source Code</b>
+You can check/pull the latest source code for this library via:
+<pre>
+$ git clone https://github.com/NACLab/ngc-learn.git
+</pre>
+
+If you are working on and developing with ngc-learn pulled from the github
+repo, then run the following command to set up an editable install:
+<pre>
+$ python install -e .
+</pre>
+
+**Version:**<br>
+1.0.0-Beta <!-- -Alpha -->
+
+Author:
+Alexander G. Ororbia II<br>
+Director, Neural Adaptive Computing (NAC) Laboratory<br>
+Rochester Institute of Technology, Department of Computer Science
+
+## <b>Copyright:</b>
+
+Copyright (C) 2021 The Neural Adaptive Computing Laboratory - All Rights Reserved<br>
+You may use, distribute and modify this code under the
+terms of the BSD 3-clause license.
+
+You should have received a copy of the BSD 3-clause license with
+this software.<br>
+If not, please [email us](mailto:ago@cs.rit.edu)

ngclearn-1.0b0/README.md

@@ -0,0 +1,150 @@
+[![Python Version](https://img.shields.io/badge/python-3.9%20%7C%203.10-blue.svg)](https://www.python.org/downloads)[![License](https://img.shields.io/badge/License-BSD_3--Clause-blue.svg)](https://opensource.org/licenses/BSD-3-Clause)[![Maintenance](https://img.shields.io/badge/Maintained%3F-yes-green.svg)](https://GitHub.com/Naereen/StrapDown.js/graphs/commit-activity)[![Documentation Status](https://readthedocs.org/projects/ngc-learn/badge/?version=latest)](http://ngc-learn.readthedocs.io/en/latest/?badge=latest)[![DOI](https://zenodo.org/badge/483413212.svg)](https://zenodo.org/badge/latestdoi/483413212)
+
+<img src="docs/images/ngc-learn-logo.png" width="300">
+
+<b>ngc-learn</b> is a Python library for building, simulating, and analyzing
+biomimetic systems, neurobiological agents, spiking neuronal networks,
+predictive coding circuitry, and models that learn via biologically-plausible
+forms of credit assignment. This simulation toolkit is built on top of JAX and is
+distributed under the 3-Clause BSD license.
+
+It is currently maintained by the
+<a href="https://www.cs.rit.edu/~ago/nac_lab.html">Neural Adaptive Computing (NAC) laboratory</a>.
+
+## <b>Documentation</b>
+
+Official documentation, including tutorials, can be found
+<a href="https://ngc-learn.readthedocs.io/en/latest/#">here</a>.
+
+The official blog-post related to the source paper behind this software library
+can be found
+<a href="https://go.nature.com/3rgl1K8">here</a>.<br>
+You can find the related paper <a href="https://www.nature.com/articles/s41467-022-29632-7">right here</a>, which
+was selected to appear in the Nature <i>Neuromorphic Hardware and Computing Collection</i> in 2023 and was
+chosen as one of the <i>Editors' Highlights for Applied Physics and Mathematics</i> in 2022.
+
+<!--The technical report going over the theoretical underpinnings of the
+    NGC framework can be found here. TO BE RELEASED SOON. -->
+
+## Installation
+
+### Dependencies
+
+ngc-learn requires:
+1) Python (>=3.10)
+2) NumPy (>=1.26.0)
+3) SciPy (>=1.7.0)
+4) ngcsimlib (>=0.2.b1), (visit official page <a href="https://github.com/NACLab/ngc-sim-lib">here</a>)
+5) JAX (>= 0.4.18) (to enable GPU use, make sure to install one of the CUDA variants)
+<!--
+5) scikit-learn (>=1.3.1) if using `ngclearn.utils.density`
+6) matplotlib (>=3.4.3) if using `ngclearn.utils.viz`
+6) networkx  (>=2.6.3) (currently optional but required if using `ngclearn.utils.experimental.viz_utils`)
+7) pyviz (>=0.2.0) (currently optional but required if using `ngclearn.utils.experimental.viz_utils`)
+-->
+
+---
+ngc-learn 1.0.beta0 and later require Python 3.10 or newer as well as ngcsimlib >=0.2.b1.
+ngc-learn's plotting capabilities (routines within `ngclearn.utils.viz`) require
+Matplotlib (>=3.8.0) and imageio (>=2.31.5) and both plotting and density estimation
+tools (routines within ``ngclearn.utils.density``) will require Scikit-learn (>=0.24.2).
+Many of the tutorials will require Matplotlib (>=3.8.0), imageio (>=2.31.5), and Scikit-learn (>=0.24.2).
+<!-- (Note: if using the `_generate_patch_set()` within the
+image patching utilities, then Patchify will be needed).-->
+
+### User Installation
+
+<i>Setup</i>: The easiest way to install ngc-learn (CPU version) is through <code>pip</code>:
+<pre>
+$ python install ngclearn
+</pre>
+
+The documentation includes more detailed
+<a href="https://ngc-learn.readthedocs.io/en/latest/installation.html">installation instructions</a>.
+Note that this library was developed on Ubuntu 20.04 and tested on Ubuntu(s) 18.04 and 20.04.
+
+<!--
+<i>Setup:</i> To install ngc-learn, you can run (at the top-level of the
+the <code>ngclearn</code> directory) the following bash command:
+<pre>
+$ python install .
+</pre>
+
+Running the above pip install will automatically install the CPU
+version of JAX. If you want to use the GPU version instead, make sure to,
+before running the above, to install JAX via the correct pip command
+with the proper CUDA flags (depending on which CUDA is configured for your system)
+as per their
+<a href="https://jax.readthedocs.io/en/latest/installation.html">installation instructions</a>.
+-->
+
+<!--
+(If you want to set up/install dependencies a priori, try running
+`$ pip install -r requirements.txt` first before pip installing ngc-learn.)
+-->
+
+If the installation was successful, you should see the following if you test
+it against your Python interpreter, i.e., run the <code>$ python</code> command
+and complete the following sequence of steps as depicted in the screenshot below:<br>
+<img src="docs/images/test_ngclearn_install.png" width="512">
+
+<i>Note:</i> For access to the previous Tensorflow-2 version of ngc-learn (of
+which we no longer support), please visit the repo for
+<a href="https://github.com/NACLab/ngc-learn-legacy"><i>ngc-learn-legacy</i></a>.
+
+## <b>Attribution:</b>
+
+If you use this code in any form in your project(s), please cite its source
+paper (as well as ngc-learn's official software citation):
+<pre>
+@article{Ororbia2022,
+  author={Ororbia, Alexander and Kifer, Daniel},
+  title={The neural coding framework for learning generative models},
+  journal={Nature Communications},
+  year={2022},
+  month={Apr},
+  day={19},
+  volume={13},
+  number={1},
+  pages={2064},
+  issn={2041-1723},
+  doi={10.1038/s41467-022-29632-7},
+  url={https://doi.org/10.1038/s41467-022-29632-7}
+}
+</pre>
+
+## <b>Development:</b>
+
+We warmly welcome community contributions to this project. For details on how to
+make a contribution to ngc-learn, please see our
+[contributing guidelines](CONTRIBUTING.md).
+
+<b>Source Code</b>
+You can check/pull the latest source code for this library via:
+<pre>
+$ git clone https://github.com/NACLab/ngc-learn.git
+</pre>
+
+If you are working on and developing with ngc-learn pulled from the github
+repo, then run the following command to set up an editable install:
+<pre>
+$ python install -e .
+</pre>
+
+**Version:**<br>
+1.0.0-Beta <!-- -Alpha -->
+
+Author:
+Alexander G. Ororbia II<br>
+Director, Neural Adaptive Computing (NAC) Laboratory<br>
+Rochester Institute of Technology, Department of Computer Science
+
+## <b>Copyright:</b>
+
+Copyright (C) 2021 The Neural Adaptive Computing Laboratory - All Rights Reserved<br>
+You may use, distribute and modify this code under the
+terms of the BSD 3-clause license.
+
+You should have received a copy of the BSD 3-clause license with
+this software.<br>
+If not, please [email us](mailto:ago@cs.rit.edu)

ngclearn-1.0b0/ngclearn/__init__.py

@@ -0,0 +1,23 @@
+import sys
+import subprocess
+import pkg_resources
+from pkg_resources import get_distribution
+#from pathlib import Path
+#from sys import argv
+
+__version__ = get_distribution('ngclearn').version
+
+#required = {'ngcsimlib', 'jax', 'jaxlib'} ## list of core ngclearn dependencies
+required = {'ngcsimlib', 'jax', 'jaxlib'}
+installed = {pkg.key for pkg in pkg_resources.working_set}
+missing = required - installed
+
+for key in required:
+    if key in missing:
+        raise ImportError(str(key) + ", a core dependency of ngclearn, is not " \
+                          "currently installed!")
+
+
+## Needed to preload is called before anything in ngclearn
+import ngcsimlib
+from ngcsimlib.controller import Controller

ngclearn-1.0b0/ngclearn/commands/__init__.py

@@ -0,0 +1 @@
+from ngcsimlib.commands import *

ngclearn-1.0b0/ngclearn/components/__init__.py

@@ -0,0 +1,19 @@
+## point to rate-coded cell componet types
+from .neurons.graded.rateCell import RateCell
+from .neurons.graded.gaussianErrorCell import GaussianErrorCell
+from .neurons.graded.laplacianErrorCell import LaplacianErrorCell
+## point to standard spiking cell component types
+from .neurons.spiking.sLIFCell import SLIFCell
+from .neurons.spiking.LIFCell import LIFCell
+from .neurons.spiking.quadLIFCell import QuadLIFCell
+from .neurons.spiking.izhikevichCell import IzhikevichCell
+## point to transformer/operater component types
+from .other.varTrace import VarTrace
+from .other.expKernel import ExpKernel
+## point to input encoder component types
+from .input_encoders.bernoulliCell import BernoulliCell
+from .input_encoders.poissonCell import PoissonCell
+## point to synapse component types
+from .synapses.hebbian.hebbianSynapse import HebbianSynapse
+from .synapses.hebbian.traceSTDPSynapse import TraceSTDPSynapse
+from .synapses.hebbian.expSTDPSynapse import ExpSTDPSynapse

ngclearn-1.0b0/ngclearn/components/baseComponentTemplate.py

@@ -0,0 +1,47 @@
+from ngcsimlib.component import Component
+from jax import random
+import time
+
+
+class COMPONENT_TEMPLATE(Component):
+  ## Class Methods for Compartment Names
+  @classmethod
+  def DEFAULTCompartmentName(cls):
+    return 'DEFAULT'
+
+  ## Bind Properties to Compartments for ease of use
+  @property
+  def DEFAULTCompartment(self):
+    return self.compartments.get(self.DEFAULTCompartmentName(), None)
+
+  @DEFAULTCompartment.setter
+  def DEFAULTCompartment(self, x):
+    if x is not None:
+      if True:
+        raise RuntimeError("")
+    self.compartments[self.DEFAULTCompartmentName()] = x
+
+
+  # Define Functions
+  def __init__(self, name, key=None, useVerboseDict=False, **kwargs):
+    super().__init__(name, useVerboseDict, **kwargs)
+
+    ##Random Number Set up
+    self.key = key
+    if self.key is None:
+      self.key = random.PRNGKey(time.time_ns())
+
+    ##Reset to initialize stuff
+    self.reset()
+
+  def verify_connections(self):
+    pass
+
+  def advance_state(self, **kwargs):
+    pass
+
+  def reset(self, **kwargs):
+    pass
+
+  def save(self, directory, **kwargs):
+      pass

ngclearn-1.0b0/ngclearn/components/input_encoders/__init__.py

@@ -0,0 +1,2 @@
+from .bernoulliCell import BernoulliCell
+from .poissonCell import PoissonCell

ngclearn-1.0b0/ngclearn/components/input_encoders/bernoulliCell.py

@@ -0,0 +1,123 @@
+from ngcsimlib.component import Component
+from jax import numpy as jnp, random, jit
+from functools import partial
+import time
+
+@jit
+def update_times(t, s, tols):
+    """
+    Updates time-of-last-spike (tols) variable.
+
+    Args:
+        t: current time (a scalar/int value)
+
+        s: binary spike vector
+
+        tols: current time-of-last-spike variable
+
+    Returns:
+        updated tols variable
+    """
+    _tols = (1. - s) * tols + (s * t)
+    return _tols
+
+@jit
+def sample_bernoulli(dkey, data):
+    """
+    Samples a Bernoulli spike train on-the-fly
+
+    Args:
+        data: sensory data (vector/matrix)
+
+        dt: integration time constant
+
+    Returns:
+        binary spikes
+    """
+    s_t = random.bernoulli(dkey, p=data).astype(jnp.float32)
+    return s_t
+
+class BernoulliCell(Component):
+    """
+    A Bernoulli cell that produces Bernoulli-distributed spikes on-the-fly.
+
+    Args:
+        name: the string name of this cell
+
+        n_units: number of cellular entities (neural population size)
+
+        key: PRNG key to control determinism of any underlying synapses
+            associated with this cell
+
+        useVerboseDict: triggers slower, verbose dictionary mode (Default: False)
+    """
+
+    ## Class Methods for Compartment Names
+    @classmethod
+    def inputCompartmentName(cls):
+        return 'in'
+
+    @classmethod
+    def outputCompartmentName(cls):
+        return 'out'
+
+    @classmethod
+    def timeOfLastSpikeCompartmentName(cls):
+        return 'tols'
+
+    ## Bind Properties to Compartments for ease of use
+    @property
+    def inputCompartment(self):
+        return self.compartments.get(self.inputCompartmentName(), None)
+
+    @inputCompartment.setter
+    def inputCompartment(self, inp):
+        self.compartments[self.inputCompartmentName()] = inp
+
+    @property
+    def outputCompartment(self):
+        return self.compartments.get(self.outputCompartmentName(), None)
+
+    @outputCompartment.setter
+    def outputCompartment(self, out):
+        self.compartments[self.outputCompartmentName()] = out
+
+    @property
+    def timeOfLastSpike(self):
+        return self.compartments.get(self.timeOfLastSpikeCompartmentName(), None)
+
+    @timeOfLastSpike.setter
+    def timeOfLastSpike(self, t):
+        self.compartments[self.timeOfLastSpikeCompartmentName()] = t
+
+    # Define Functions
+    def __init__(self, name, n_units, key=None, useVerboseDict=False, **kwargs):
+        super().__init__(name, useVerboseDict, **kwargs)
+
+        ##Random Number Set up
+        self.key = key
+        if self.key is None:
+            self.key = random.PRNGKey(time.time_ns())
+
+        ##Layer Size Setup
+        self.batch_size = 1
+        self.n_units = n_units
+        self.reset()
+
+    def verify_connections(self):
+        pass
+
+    def advance_state(self, t, dt, **kwargs):
+        self.key, *subkeys = random.split(self.key, 2)
+
+        self.outputCompartment = sample_bernoulli(subkeys[0], data=self.inputCompartment)
+        #self.timeOfLastSpike = (1 - self.outputCompartment) * self.timeOfLastSpike + (self.outputCompartment * t)
+        self.timeOfLastSpike = update_times(t, self.outputCompartment, self.timeOfLastSpike)
+
+    def reset(self, **kwargs):
+        self.inputCompartment = None
+        self.outputCompartment = jnp.zeros((self.batch_size, self.n_units)) #None
+        self.timeOfLastSpike = jnp.zeros((self.batch_size, self.n_units))
+
+    def save(self, **kwargs):
+        pass