pgdice 0.2.0 → 0.2.1

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: fda4fee4feb3b2d3dd02baa31b524cf14e6047a9c915bc45c9c8abc5f056361a
-  data.tar.gz: 5d12a5c07ebdc686a85d32a567af90c7fa38c98c70cd0ee7986ae70bdaf9a1ce
+  metadata.gz: f3fb2d5818d5b0042ad5509989c68728bc4cf308a6776d2e4e86f098e54f0eca
+  data.tar.gz: 878e00f3882170077962bbd486164f529ffe03cfb3a90a3c82fbb93ad4f91062
 SHA512:
-  metadata.gz: df344dd28a9a0bf196ced1f01d69e6382164c86f77d53d73886a9243b32177287aea7e0ed6d45a3df34aaea51823654210616947cea4a25369f92db429153cd3
-  data.tar.gz: 86b3055b01c1cbfecd431ed009375650eee9e37d2aea387cc3fad55b47c892a9b72fe1c05d4f29828d62006e640fc65c37afab35e7cab3c91d978ec39aa85961
+  metadata.gz: 391d851ca34559bae050ce7a3e4ea5d980fa85c215438252c08842af2d409535170e14951538d665168851260cf182a2705901682b5adad9b9b30928d054e49d
+  data.tar.gz: bab98688c55400ff18ea5f94a0fc29ad94752c13fa5fcf410a058c71c4c82bcb588df0ccf97f1bc1447e9e59f4d9877ffff00ef2aea67c016a66a2fa8995979a

data/CHANGELOG.md

@@ -2,13 +2,12 @@
 All notable changes to this project will be documented in this file.
 This project adheres to [Semantic Versioning](http://semver.org/).
 
-## [v0.2.0] : 2018-09-17
-### Changelog added
 
-### Added
-- Support for overriding configuration parameters. Currently only the `:logger` option is supported.
-    - [DatabaseConnection](lib/pgdice/database_connection.rb) now accepts an opts hash
-    - [PartitionHelper](lib/pgdice/partition_helper.rb) now accepts an opts hash
-    - [PartitionManager](lib/pgdice/partition_manager.rb) now accepts an opts hash
-    - [PgSliceManager](lib/pgdice/pg_slice_manager.rb) now accepts an opts hash
-    - [Validation](lib/pgdice/validation.rb) now accepts an opts hash
+## [v0.2.1] : 2018-10-21
+### Changes
+  - Renamed `PartitionManager.list_batched_droppable_partitions` to
+  `PartitionManager.list_droppable_partitions_by_batch_size`
+  - Readme updated
+  
+## [v0.2.0] : 2018-10-21
+ - Changelog added

data/README.md

@@ -25,7 +25,7 @@ maintainers and any affiliated parties CANNOT BE HELD LIABLE FOR DATA LOSS OR LO
 See the [LICENSE](LICENSE) for more information.
 
 
-## Installation
+# Installation
 
 Add this line to your application's Gemfile:
 
@@ -41,9 +41,9 @@ Or install it yourself as:
 
     $ gem install pgdice
 
-## Usage
+# Usage
 
-### Configuration
+## Configuration
 
 You must configure `PgDice` before you can use it, otherwise you won't be able to perform any manipulation actions
 on tables.
@@ -67,7 +67,7 @@ end
 ```
 
 
-#### Configuration Parameters
+### Configuration Parameters
 
 - `database_url` - Required: The postgres database url to connect to. 
   - This is required since `pgslice` requires a postgres `url`.
@@ -80,14 +80,16 @@ end
     - See the [Approved Tables Configuration](#approved-tables-configuration) section for more.
 
 - `dry_run` - Optional: Boolean value to control whether changes are executed on the database.
-  - You can set it to either `true` or `false`. 
-    - `true` will make PgDice log out the commands but not execute them.
+  - Defaults to `false`
+  - `true` will make PgDice log out the commands but not execute them.
 
 - `batch_size` - Optional: Maximum number of tables you can drop in one `drop_old_partitions` call. 
   - Defaults to 7.
+  - Keep in mind the size of your tables, drop operations are done in one command. Large tables
+  will take longer to drop per table and could time out if there is activity on the parent table.
 
 
-#### Advanced Configuration Parameters
+### Advanced Configuration Parameters
 
 All of the following parameters are optional and honestly you probably will never need to mess with these.
 
@@ -97,7 +99,7 @@ All of the following parameters are optional and honestly you probably will neve
   so this feature may not be very useful if you are trying to only use one connection for this utility.
 
  
-### Approved Tables Configuration
+## Approved Tables Configuration
 
 In order to maintain the correct number of partitions over time you must configure a 
 [PgDice::Table](lib/pgdice/table.rb).
@@ -105,7 +107,7 @@ In order to maintain the correct number of partitions over time you must configu
 An example configuration file has been provided at [config.yml](examples/config.yml) if you would rather
 declare your `approved_tables` in yaml.
 
-#### Alternative Approved Tables Configuration 
+### Alternative Approved Tables Configuration 
 
 If you want to declare your [PgDice::ApprovedTables](lib/pgdice/approved_tables.rb) in your configuration
 block instead, you can build them like so:
@@ -128,7 +130,7 @@ end
 It is possible to use both the configuration block and a file if you so choose. 
 The block will take precedence over the values in the file.
  
-### Converting existing tables to partitioned tables
+## Converting existing tables to partitioned tables
 
 __This should only be used on smallish tables and ONLY after you have tested it on a non-production copy of your 
 production database.__
@@ -136,7 +138,8 @@ In fact, you should just not do this in production. Schedule downtime or somethi
 a copy of your database. Then practice restoring your database some more.
 
 
-This command will convert an existing table into 61 partitioned tables (30 past, 30 future, and one for today).
+This command will convert the existing `comments` table into 98 partitioned tables 
+(90 past, 7 future, and one for today).
 
 For more information on what's going on in the background see 
 [https://github.com/ankane/pgslice](https://github.com/ankane/pgslice)
@@ -146,30 +149,27 @@ For more information on what's going on in the background see
 PgDice.partition_helper.partition_table('comments')
 ```
 
-If you mess up (again you shouldn't use this in production). These two methods are useful for writing tests
-that work with partitions.
 
-#### Notes on partition_table
+### Notes on partition_table
 
 - You can override values configured in the `PgDice::Table` by passing them in as a hash. 
   - For example if you wanted to create `30` future tables instead of the configured `7` for the `comments` table
   you could pass in `future: 30`.
 
+
+If you mess up, again you shouldn't use this in production, you can call:
+ 
 ```ruby
 PgDice.partition_helper.undo_partitioning!('comments')
 ```
 
-#### Notes on `partition_table`
-
-- In `partition_helper` there are versions of the methods that will throw exceptions (ending in `!`) and others 
-that will return a truthy value or `false` if there is a failure.
+This method will revert the changes made by partitioning a table. Don't rely on this 
+in production if you mess up; you need to test everything thoroughly.
 
-- `period` can be set to one of these values: `:day`, `:month`, `:year`
 
+## Maintaining partitioned tables
 
-### Maintaining partitioned tables
-
-#### Adding more tables
+### Adding more tables
 
 If you have existing tables that need to periodically have more tables added you can run:
 
@@ -177,14 +177,14 @@ If you have existing tables that need to periodically have more tables added you
 PgDice.partition_manager.add_new_partitions('comments')
 ```
 
-##### Notes on `add_new_partitions`
+#### Notes on `add_new_partitions`
 
-- The above command would add `7` new tables and their associated indexes all based on the `period` that the
-partitioned table was defined with.
- - The example `comments` table we have been using was configured to always keep `7` future partitions above.
+- The above command would add up to `7` new tables and their associated indexes all based on the `period` 
+that the partitioned table was defined with.
+  - The example `comments` table we have been using was configured to always keep `7` future partitions above.
 
 
-#### Listing droppable partitions
+### Listing droppable partitions
 
 Sometimes you just want to know what's out there and if there are tables ready to be dropped.
 
@@ -193,12 +193,20 @@ To list all eligible tables for dropping you can run:
 PgDice.partition_manager.list_droppable_partitions('comments')
 ```
 
-##### Notes on `list_droppable_partitions`
+If you want to know _exactly_ which partitions will be dropped you can call:
+```ruby
+PgDice.partition_manager.list_droppable_partitions_by_batch_size('comments')
+```
+
+This method will show partitions that are within the configured `batch_size`.
 
-- This method uses the `past` value from the `PgDice::Table` to determine which tables are eligible for dropping.
 
+#### Notes on `list_droppable_partitions`
+
+- This method uses the `past` value from the `PgDice::Table` to determine which tables are eligible for dropping.
+- Like most commands, if you want to override the values it will use to check just pass them in.
 
-#### Dropping old tables
+### Dropping old tables
 
 _Dropping tables is irreversible! Do this at your own risk!!_
 
@@ -208,7 +216,7 @@ If you want to drop old tables (after backing them up of course) you can run:
 PgDice.partition_manager.drop_old_partitions(table_name: 'comments')
 ```
 
-##### Notes on `drop_old_partitions`
+#### Notes on `drop_old_partitions`
 
 - The above example command would drop partitions that exceed the configured `past` table count
 for the `PgDice::Table`. 
@@ -216,24 +224,23 @@ for the `PgDice::Table`.
   So if there were 100 tables older than `today` it would drop up to `batch_size` tables.
   
 
-#### Validating everything is still working
+# Validation
 
 If you've got background jobs creating and dropping tables you're going to want to 
 ensure they are actually working correctly. 
 
 To validate that your expected number of tables exist, you can run:
 ```ruby
-PgDice.validation.assert_tables('comments', future: 7, past: 90)
+PgDice.validation.assert_tables('comments')
 ```
 
 An [InsufficientTablesError](lib/pgdice.rb) will be raised if any conditions are not met.
 
-This will check that the table 30 days from now exists and that there is 
-still a table from 90 days ago. The above example assumes the table was partitioned
-by day.
+This will check that there are 7 future tables from now and that there are 90 past tables
+per our configuration above.
 
 
-## FAQ
+# FAQ
 
 1. How do I get a postgres url if I'm running in Rails?
 ```ruby
@@ -255,11 +262,10 @@ end
 ## Planned Features
 
 1. Full `PG::Connection` support (no more database URLs).
-1. Custom schema support for all operations. Defaults to `public` currently.
-1. Non time-range based partitioning.
+1. Non time-range based partitioning. [PgParty](https://github.com/rkrage/pg_party) might be a good option!
 
 
-## Development
+# Development
 
 After checking out the repo, run `bin/setup` to install dependencies. Then, run `rake test` to run the tests. 
 You can also run `bin/console` for an interactive prompt that will allow you to experiment.
@@ -267,7 +273,7 @@ You can also run `bin/console` for an interactive prompt that will allow you to
 To install this gem onto your local machine, run `bundle exec rake install`.
 
 
-### Running tests
+## Running tests
 
 You're going to need to have postgres 10 or greater installed.
 
@@ -286,12 +292,12 @@ to be a safe, welcoming space for collaboration, and contributors are expected t
  the [Contributor Covenant](http://contributor-covenant.org) code of conduct.
 
 
-## License
+# License
 
 The gem is available as open source under the terms of the [MIT License](https://opensource.org/licenses/MIT).
 
 
-## Code of Conduct
+# Code of Conduct
 
 Everyone interacting in the Pgdice project’s codebases, issue trackers, chat rooms and mailing lists is expected 
 to follow the [code of conduct](https://github.com/IlluminusLimited/pgdice/blob/master/CODE_OF_CONDUCT.md).

data/lib/pgdice/partition_manager.rb

@@ -49,7 +49,7 @@ module PgDice
       droppable_partitions(all_params)
     end
 
-    def list_batched_droppable_partitions(table_name, params = {})
+    def list_droppable_partitions_by_batch_size(table_name, params = {})
       all_params = approved_tables.smash(table_name, params)
       validation.validate_parameters(all_params)
       droppable_tables = batched_droppable_partitions(all_params)

data/lib/pgdice/version.rb

@@ -1,5 +1,5 @@
 # frozen_string_literal: true
 
 module PgDice
-  VERSION = '0.2.0'
+  VERSION = '0.2.1'
 end

metadata

@@ -1,7 +1,7 @@
 --- !ruby/object:Gem::Specification
 name: pgdice
 version: !ruby/object:Gem::Version
-  version: 0.2.0
+  version: 0.2.1
 platform: ruby
 authors:
 - Andrew Newell