x-transformers 1.29.0__tar.gz → 1.29.2__tar.gz

{x_transformers-1.29.0/x_transformers.egg-info → x_transformers-1.29.2}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: x-transformers
-Version: 1.29.0
+Version: 1.29.2
 Summary: X-Transformers - Pytorch
 Home-page: https://github.com/lucidrains/x-transformers
 Author: Phil Wang

{x_transformers-1.29.0 → x_transformers-1.29.2}/README.md

@@ -693,7 +693,7 @@ model = TransformerWrapper(
 )
 ```
 
-If you wish to do something more sophisticated, say 3 layers, with each layer recurrent 4 times before onto the next, that is possible as well.
+If you wish to do something more sophisticated, say 3 layers, with each layer recurrent 4 times before onto the next, that is possible as well. Be aware the `layers_execute_order` is 0-indexed
 
 ```python
 import torch
@@ -716,11 +716,6 @@ model = TransformerWrapper(
         )
     )
 )
-
-x = torch.randint(0, 256, (1, 1024))
-
-model(x) # (1, 1024, 20000)
-
 ```
 
 ### Understanding and Improving Transformer From a Multi-Particle Dynamic System Point of View

{x_transformers-1.29.0 → x_transformers-1.29.2}/setup.py

@@ -3,7 +3,7 @@ from setuptools import setup, find_packages
 setup(
   name = 'x-transformers',
   packages = find_packages(exclude=['examples']),
-  version = '1.29.0',
+  version = '1.29.2',
   license='MIT',
   description = 'X-Transformers - Pytorch',
   author = 'Phil Wang',

{x_transformers-1.29.0 → x_transformers-1.29.2}/x_transformers/x_transformers.py

@@ -1059,7 +1059,6 @@ class AttentionLayers(Module):
         dim_head = attn_kwargs.get('dim_head', DEFAULT_DIM_HEAD)
 
         self.dim = dim
-        self.depth = depth
         self.causal = causal
         self.layers = ModuleList([])
 
@@ -1179,6 +1178,11 @@ class AttentionLayers(Module):
 
         self.num_attn_layers = len(list(filter(equals('a'), layer_types)))
 
+        # set the depth
+
+        depth = default(depth, len(self.layers_execute_order))
+        self.depth = depth
+
         # stochastic depth
 
         self.layer_dropouts = cast_tuple(layer_dropout, len(layer_types))

{x_transformers-1.29.0 → x_transformers-1.29.2/x_transformers.egg-info}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: x-transformers
-Version: 1.29.0
+Version: 1.29.2
 Summary: X-Transformers - Pytorch
 Home-page: https://github.com/lucidrains/x-transformers
 Author: Phil Wang