activerecord-spanner-adapter 0.7.0 → 1.0.0
Sign up to get free protection for your applications and to get access to all the features.
- checksums.yaml +4 -4
- data/CHANGELOG.md +14 -1
- data/README.md +2 -3
- data/lib/activerecord_spanner_adapter/connection.rb +46 -20
- data/lib/activerecord_spanner_adapter/information_schema.rb +2 -1
- data/lib/activerecord_spanner_adapter/transaction.rb +52 -21
- data/lib/activerecord_spanner_adapter/version.rb +1 -1
- data/lib/spanner_client_ext.rb +4 -0
- metadata +2 -12
- data/examples/snippets/interleaved-tables/README.md +0 -152
- data/examples/snippets/interleaved-tables/Rakefile +0 -13
- data/examples/snippets/interleaved-tables/application.rb +0 -109
- data/examples/snippets/interleaved-tables/config/database.yml +0 -8
- data/examples/snippets/interleaved-tables/db/migrate/01_create_tables.rb +0 -44
- data/examples/snippets/interleaved-tables/db/schema.rb +0 -32
- data/examples/snippets/interleaved-tables/db/seeds.rb +0 -40
- data/examples/snippets/interleaved-tables/models/album.rb +0 -15
- data/examples/snippets/interleaved-tables/models/singer.rb +0 -20
- data/examples/snippets/interleaved-tables/models/track.rb +0 -25
checksums.yaml
CHANGED
@@ -1,7 +1,7 @@
|
|
1
1
|
---
|
2
2
|
SHA256:
|
3
|
-
metadata.gz:
|
4
|
-
data.tar.gz:
|
3
|
+
metadata.gz: e91546c93ad037bfaa453c4e80f0f9bd3ce5f6ced1e98cfd74ea92a8495996ec
|
4
|
+
data.tar.gz: 1180932c1f3644a0338b856f1b170ed5a4aa2735ac8410071981db28697c7bf4
|
5
5
|
SHA512:
|
6
|
-
metadata.gz:
|
7
|
-
data.tar.gz:
|
6
|
+
metadata.gz: cbb029027fc34279f095294df20756d1bcfa2a077b45919d4447d4be8a29f7fb5bbb911896b8a5a3441766af735a0ec3ad38b4dfae2527ef401c1d4e9a39132e
|
7
|
+
data.tar.gz: 33a6509c950572f3880dc9d48c34dc35784909b46fc1d1226f2e20c57c77e734c53149f6620be17a8d3e85b4e086624bf545dae5bcc91a671cd1089cad885b36
|
data/CHANGELOG.md
CHANGED
@@ -1,5 +1,19 @@
|
|
1
1
|
# Changelog
|
2
2
|
|
3
|
+
## [1.0.0](https://www.github.com/googleapis/ruby-spanner-activerecord/compare/activerecord-spanner-adapter/v0.7.1...activerecord-spanner-adapter/v1.0.0) (2021-12-07)
|
4
|
+
|
5
|
+
|
6
|
+
### Features
|
7
|
+
|
8
|
+
* release 1.0.0 ([#146](https://www.github.com/googleapis/ruby-spanner-activerecord/issues/146)) ([15ce616](https://www.github.com/googleapis/ruby-spanner-activerecord/commit/15ce6161fd052aaf6a1f078e65c0f836e8d640f3))
|
9
|
+
|
10
|
+
### [0.7.1](https://www.github.com/googleapis/ruby-spanner-activerecord/compare/activerecord-spanner-adapter/v0.7.0...activerecord-spanner-adapter/v0.7.1) (2021-11-21)
|
11
|
+
|
12
|
+
|
13
|
+
### Performance Improvements
|
14
|
+
|
15
|
+
* inline BeginTransaction with first statement in the transaction ([#139](https://www.github.com/googleapis/ruby-spanner-activerecord/issues/139)) ([ed88647](https://www.github.com/googleapis/ruby-spanner-activerecord/commit/ed88647a4df995b4f4221ac056f9204ee45ce90f))
|
16
|
+
|
3
17
|
## [0.7.0](https://www.github.com/googleapis/ruby-spanner-activerecord/compare/activerecord-spanner-adapter/v0.6.0...activerecord-spanner-adapter/v0.7.0) (2021-10-03)
|
4
18
|
|
5
19
|
|
@@ -24,7 +38,6 @@
|
|
24
38
|
* Add support for NUMERIC type ([#73](https://www.github.com/googleapis/ruby-spanner-activerecord/issues/73)) ([176cf99](https://www.github.com/googleapis/ruby-spanner-activerecord/commit/176cf99dc8c26b3fd34d9e85d82a91dbde2b15c8))
|
25
39
|
* Add support for ARRAY data type ([#86](https://www.github.com/googleapis/ruby-spanner-activerecord/issues/86)) ([0c66a62](https://www.github.com/googleapis/ruby-spanner-activerecord/commit/0c66a620cab968779de04faf48e03eec643ebea9))
|
26
40
|
* google-cloud-spanner version upgraded to 2.2 ([#55](https://www.github.com/googleapis/ruby-spanner-activerecord/issues/55)) ([d7581d6](https://www.github.com/googleapis/ruby-spanner-activerecord/commit/d7581d60bd9a9e7b9989565449119f73e2caa694))
|
27
|
-
* Support interleaved tables ([#83](https://www.github.com/googleapis/ruby-spanner-activerecord/issues/83)) ([82265f9](https://www.github.com/googleapis/ruby-spanner-activerecord/commit/82265f94ace79964639a2c65554714752be39724))
|
28
41
|
* retry session not found ([#81](https://www.github.com/googleapis/ruby-spanner-activerecord/issues/81)) ([88fd3b7](https://www.github.com/googleapis/ruby-spanner-activerecord/commit/88fd3b70a03a90de2b667bb0f2e86efe5dc9328b))
|
29
42
|
* support and test multiple ActiveRecord versions ([#107](https://www.github.com/googleapis/ruby-spanner-activerecord/issues/107)) ([db9d96c](https://www.github.com/googleapis/ruby-spanner-activerecord/commit/db9d96c44b9560f6904209df1a9aa42bf50a5844))
|
30
43
|
* support DDL batches on connection ([#72](https://www.github.com/googleapis/ruby-spanner-activerecord/issues/72)) ([0d18cd4](https://www.github.com/googleapis/ruby-spanner-activerecord/commit/0d18cd49641bdb567012d6ac88b1909461d42551))
|
data/README.md
CHANGED
@@ -4,7 +4,7 @@
|
|
4
4
|
|
5
5
|
![rubocop](https://github.com/googleapis/ruby-spanner-activerecord/workflows/rubocop/badge.svg)
|
6
6
|
|
7
|
-
This project provides a Cloud Spanner adapter for ActiveRecord. It
|
7
|
+
This project provides a Cloud Spanner adapter for ActiveRecord. It supports the following versions:
|
8
8
|
|
9
9
|
- ActiveRecord 6.0.x with Ruby 2.6 and 2.7.
|
10
10
|
- ActiveRecord 6.1.x with Ruby 2.6 and higher.
|
@@ -69,7 +69,6 @@ Some noteworthy examples in the snippets directory:
|
|
69
69
|
- [mutations](examples/snippets/mutations): Shows how you can use [mutations instead of DML](https://cloud.google.com/spanner/docs/dml-versus-mutations)
|
70
70
|
for inserting, updating and deleting data in a Cloud Spanner database. Mutations can have a significant performance
|
71
71
|
advantage compared to DML statements, but do not allow read-your-writes semantics during a transaction.
|
72
|
-
- [interleaved-tables](examples/snippets/interleaved-tables): Shows how to create and work with a hierarchy of `INTERLEAVED IN` tables.
|
73
72
|
- [array-data-type](examples/snippets/array-data-type): Shows how to work with `ARRAY` data types.
|
74
73
|
|
75
74
|
## Limitations
|
@@ -93,4 +92,4 @@ The gem is available as open source under the terms of the [MIT License](https:/
|
|
93
92
|
|
94
93
|
## Code of Conduct
|
95
94
|
|
96
|
-
Everyone interacting in the Activerecord::Spanner project’s codebases, issue trackers, chat rooms and mailing lists is expected to follow the [code of conduct](https://github.com/googleapis/ruby-spanner-activerecord/blob/master/CODE_OF_CONDUCT.md).
|
95
|
+
Everyone interacting in the Activerecord::Spanner project’s codebases, issue trackers, chat rooms and mailing lists is expected to follow the [code of conduct](https://github.com/googleapis/ruby-spanner-activerecord/blob/master/CODE_OF_CONDUCT.md).
|
@@ -208,27 +208,53 @@ module ActiveRecordSpannerAdapter
|
|
208
208
|
self.current_transaction = nil
|
209
209
|
end
|
210
210
|
|
211
|
-
|
212
|
-
|
213
|
-
|
214
|
-
|
215
|
-
|
216
|
-
|
217
|
-
|
218
|
-
|
219
|
-
|
220
|
-
|
221
|
-
|
222
|
-
|
223
|
-
|
224
|
-
|
225
|
-
|
226
|
-
|
227
|
-
|
228
|
-
|
229
|
-
|
230
|
-
|
211
|
+
selector = transaction_selector || single_use_selector
|
212
|
+
execute_sql_request sql, converted_params, types, selector
|
213
|
+
end
|
214
|
+
|
215
|
+
def execute_sql_request sql, converted_params, types, selector
|
216
|
+
res = session.execute_query \
|
217
|
+
sql,
|
218
|
+
params: converted_params,
|
219
|
+
types: types,
|
220
|
+
transaction: selector,
|
221
|
+
seqno: (current_transaction&.next_sequence_number)
|
222
|
+
current_transaction.grpc_transaction = res.metadata.transaction \
|
223
|
+
if current_transaction && res&.metadata&.transaction
|
224
|
+
res
|
225
|
+
rescue Google::Cloud::AbortedError
|
226
|
+
# Mark the current transaction as aborted to prevent any unnecessary further requests on the transaction.
|
227
|
+
current_transaction&.mark_aborted
|
228
|
+
raise
|
229
|
+
rescue Google::Cloud::NotFoundError => e
|
230
|
+
if session_not_found?(e) || transaction_not_found?(e)
|
231
|
+
reset!
|
232
|
+
# Force a retry of the entire transaction if this statement was executed as part of a transaction.
|
233
|
+
# Otherwise, just retry the statement itself.
|
234
|
+
raise_aborted_err if current_transaction&.active?
|
235
|
+
retry
|
236
|
+
end
|
237
|
+
raise
|
238
|
+
rescue Google::Cloud::Error => e
|
239
|
+
# Check if it was the first statement in a transaction that included a BeginTransaction
|
240
|
+
# option in the request. If so, execute an explicit BeginTransaction and then retry the
|
241
|
+
# request without the BeginTransaction option.
|
242
|
+
if current_transaction && selector&.begin&.read_write
|
243
|
+
selector = create_transaction_after_failed_first_statement e
|
244
|
+
retry
|
231
245
|
end
|
246
|
+
# It was not the first statement, so propagate the error.
|
247
|
+
raise
|
248
|
+
end
|
249
|
+
|
250
|
+
# Creates a transaction using a BeginTransaction RPC. This is used if the first statement of a
|
251
|
+
# transaction fails, as that also means that no transaction id was returned.
|
252
|
+
def create_transaction_after_failed_first_statement original_error
|
253
|
+
transaction = current_transaction.force_begin_read_write
|
254
|
+
Google::Spanner::V1::TransactionSelector.new id: transaction.transaction_id
|
255
|
+
rescue Google::Cloud::Error
|
256
|
+
# Raise the original error if the BeginTransaction RPC also fails.
|
257
|
+
raise original_error
|
232
258
|
end
|
233
259
|
|
234
260
|
# Transactions
|
@@ -62,7 +62,8 @@ module ActiveRecordSpannerAdapter
|
|
62
62
|
end
|
63
63
|
|
64
64
|
def table_columns table_name, column_name: nil
|
65
|
-
sql = +"SELECT COLUMN_NAME, SPANNER_TYPE, IS_NULLABLE,
|
65
|
+
sql = +"SELECT COLUMN_NAME, SPANNER_TYPE, IS_NULLABLE,"
|
66
|
+
sql << " CAST(COLUMN_DEFAULT AS STRING) AS COLUMN_DEFAULT, ORDINAL_POSITION"
|
66
67
|
sql << " FROM INFORMATION_SCHEMA.COLUMNS"
|
67
68
|
sql << " WHERE TABLE_NAME=%<table_name>s"
|
68
69
|
sql << " AND COLUMN_NAME=%<column_name>s" if column_name
|
@@ -30,28 +30,37 @@ module ActiveRecordSpannerAdapter
|
|
30
30
|
@mutations << mutation
|
31
31
|
end
|
32
32
|
|
33
|
+
# Begins the transaction.
|
34
|
+
#
|
35
|
+
# Read-only and PDML transactions are started by executing a BeginTransaction RPC.
|
36
|
+
# Read/write transactions are not really started by this method, and instead a
|
37
|
+
# transaction selector is prepared that will be included with the first statement
|
38
|
+
# on the transaction.
|
33
39
|
def begin
|
34
40
|
raise "Nested transactions are not allowed" if @state != :INITIALIZED
|
35
41
|
begin
|
36
|
-
@
|
37
|
-
|
38
|
-
|
39
|
-
|
40
|
-
|
41
|
-
|
42
|
-
|
43
|
-
|
44
|
-
@connection.session.create_snapshot strong: true
|
45
|
-
else
|
46
|
-
raise "Invalid snapshot argument: #{@isolation}"
|
47
|
-
end
|
48
|
-
when :read_only
|
49
|
-
@connection.session.create_snapshot strong: true
|
50
|
-
when :pdml
|
51
|
-
@connection.session.create_pdml
|
42
|
+
case @isolation
|
43
|
+
when Hash
|
44
|
+
if @isolation[:timestamp]
|
45
|
+
@grpc_transaction = @connection.session.create_snapshot timestamp: @isolation[:timestamp]
|
46
|
+
elsif @isolation[:staleness]
|
47
|
+
@grpc_transaction = @connection.session.create_snapshot staleness: @isolation[:staleness]
|
48
|
+
elsif @isolation[:strong]
|
49
|
+
@grpc_transaction = @connection.session.create_snapshot strong: true
|
52
50
|
else
|
53
|
-
@
|
51
|
+
raise "Invalid snapshot argument: #{@isolation}"
|
54
52
|
end
|
53
|
+
when :read_only
|
54
|
+
@grpc_transaction = @connection.session.create_snapshot strong: true
|
55
|
+
when :pdml
|
56
|
+
@grpc_transaction = @connection.session.create_pdml
|
57
|
+
else
|
58
|
+
@begin_transaction_selector = Google::Spanner::V1::TransactionSelector.new \
|
59
|
+
begin: Google::Spanner::V1::TransactionOptions.new(
|
60
|
+
read_write: Google::Spanner::V1::TransactionOptions::ReadWrite.new
|
61
|
+
)
|
62
|
+
|
63
|
+
end
|
55
64
|
@state = :STARTED
|
56
65
|
rescue Google::Cloud::NotFoundError => e
|
57
66
|
if @connection.session_not_found? e
|
@@ -66,6 +75,12 @@ module ActiveRecordSpannerAdapter
|
|
66
75
|
end
|
67
76
|
end
|
68
77
|
|
78
|
+
# Forces a BeginTransaction RPC for a read/write transaction. This is used by a
|
79
|
+
# connection if the first statement of a transaction failed.
|
80
|
+
def force_begin_read_write
|
81
|
+
@grpc_transaction = @connection.session.create_transaction
|
82
|
+
end
|
83
|
+
|
69
84
|
def next_sequence_number
|
70
85
|
@sequence_number += 1 if @committable
|
71
86
|
end
|
@@ -74,7 +89,10 @@ module ActiveRecordSpannerAdapter
|
|
74
89
|
raise "This transaction is not active" unless active?
|
75
90
|
|
76
91
|
begin
|
77
|
-
|
92
|
+
# Start a transaction with an explicit BeginTransaction RPC if the transaction only contains mutations.
|
93
|
+
force_begin_read_write if @committable && !@mutations.empty? && !@grpc_transaction
|
94
|
+
|
95
|
+
@connection.session.commit_transaction @grpc_transaction, @mutations if @committable && @grpc_transaction
|
78
96
|
@state = :COMMITTED
|
79
97
|
rescue Google::Cloud::NotFoundError => e
|
80
98
|
if @connection.session_not_found? e
|
@@ -93,7 +111,7 @@ module ActiveRecordSpannerAdapter
|
|
93
111
|
def rollback
|
94
112
|
# Allow rollback after abort and/or a failed commit.
|
95
113
|
raise "This transaction is not active" unless active? || @state == :FAILED || @state == :ABORTED
|
96
|
-
if active?
|
114
|
+
if active? && @grpc_transaction
|
97
115
|
# We do a shoot-and-forget rollback here, as the error that caused the transaction to be rolled back could
|
98
116
|
# also have invalidated the transaction (e.g. `Session not found`). If the rollback fails for any other
|
99
117
|
# reason, we also do not need to retry it or propagate the error to the application, as the transaction will
|
@@ -113,11 +131,24 @@ module ActiveRecordSpannerAdapter
|
|
113
131
|
@state = :ABORTED
|
114
132
|
end
|
115
133
|
|
134
|
+
# Sets the underlying gRPC transaction to use for this Transaction.
|
135
|
+
# This is used for queries/DML statements that inlined the BeginTransaction option and returned
|
136
|
+
# a transaction in the metadata.
|
137
|
+
def grpc_transaction= grpc
|
138
|
+
@grpc_transaction = Google::Cloud::Spanner::Transaction.from_grpc grpc, @connection.session
|
139
|
+
end
|
140
|
+
|
116
141
|
def transaction_selector
|
117
142
|
return unless active?
|
118
143
|
|
119
|
-
|
120
|
-
|
144
|
+
# Use the transaction that has been started by a BeginTransaction RPC or returned by a
|
145
|
+
# statement, if present.
|
146
|
+
return Google::Spanner::V1::TransactionSelector.new id: @grpc_transaction.transaction_id \
|
147
|
+
if @grpc_transaction
|
148
|
+
|
149
|
+
# Return a transaction selector that will instruct the statement to also start a transaction
|
150
|
+
# and return its id as a side effect.
|
151
|
+
@begin_transaction_selector
|
121
152
|
end
|
122
153
|
end
|
123
154
|
end
|
data/lib/spanner_client_ext.rb
CHANGED
metadata
CHANGED
@@ -1,14 +1,14 @@
|
|
1
1
|
--- !ruby/object:Gem::Specification
|
2
2
|
name: activerecord-spanner-adapter
|
3
3
|
version: !ruby/object:Gem::Version
|
4
|
-
version: 0.
|
4
|
+
version: 1.0.0
|
5
5
|
platform: ruby
|
6
6
|
authors:
|
7
7
|
- Google LLC
|
8
8
|
autorequire:
|
9
9
|
bindir: exe
|
10
10
|
cert_chain: []
|
11
|
-
date: 2021-
|
11
|
+
date: 2021-12-07 00:00:00.000000000 Z
|
12
12
|
dependencies:
|
13
13
|
- !ruby/object:Gem::Dependency
|
14
14
|
name: google-cloud-spanner
|
@@ -378,16 +378,6 @@ files:
|
|
378
378
|
- examples/snippets/hints/db/seeds.rb
|
379
379
|
- examples/snippets/hints/models/album.rb
|
380
380
|
- examples/snippets/hints/models/singer.rb
|
381
|
-
- examples/snippets/interleaved-tables/README.md
|
382
|
-
- examples/snippets/interleaved-tables/Rakefile
|
383
|
-
- examples/snippets/interleaved-tables/application.rb
|
384
|
-
- examples/snippets/interleaved-tables/config/database.yml
|
385
|
-
- examples/snippets/interleaved-tables/db/migrate/01_create_tables.rb
|
386
|
-
- examples/snippets/interleaved-tables/db/schema.rb
|
387
|
-
- examples/snippets/interleaved-tables/db/seeds.rb
|
388
|
-
- examples/snippets/interleaved-tables/models/album.rb
|
389
|
-
- examples/snippets/interleaved-tables/models/singer.rb
|
390
|
-
- examples/snippets/interleaved-tables/models/track.rb
|
391
381
|
- examples/snippets/migrations/README.md
|
392
382
|
- examples/snippets/migrations/Rakefile
|
393
383
|
- examples/snippets/migrations/application.rb
|
@@ -1,152 +0,0 @@
|
|
1
|
-
# Sample - Interleaved Tables
|
2
|
-
|
3
|
-
This example shows how to use interleaved tables with the Spanner ActiveRecord adapter.
|
4
|
-
|
5
|
-
See https://cloud.google.com/spanner/docs/schema-and-data-model#creating-interleaved-tables for more information
|
6
|
-
on interleaved tables if you are not familiar with this concept.
|
7
|
-
|
8
|
-
## Creating Interleaved Tables in ActiveRecord
|
9
|
-
You can create interleaved tables using migrations in ActiveRecord by using the following Spanner ActiveRecord specific
|
10
|
-
methods that are defined on `TableDefinition`:
|
11
|
-
* `interleave_in`: Specifies which parent table a child table should be interleaved in and optionally whether
|
12
|
-
deletes of a parent record should automatically cascade delete all child records.
|
13
|
-
* `parent_key`: Creates a column that is a reference to (a part of) the primary key of the parent table. Each child
|
14
|
-
table must include all the primary key columns of the parent table as a `parent_key`.
|
15
|
-
|
16
|
-
Cloud Spanner requires a child table to include the exact same primary key columns as the parent table in addition to
|
17
|
-
the primary key column(s) of the child table. This means that the default `id` primary key column of ActiveRecord is
|
18
|
-
not usable in combination with interleaved tables. Instead each primary key column should be prefixed with the table
|
19
|
-
name of the table that it references, or use some other unique name.
|
20
|
-
|
21
|
-
This example uses the following table schema:
|
22
|
-
|
23
|
-
```sql
|
24
|
-
CREATE TABLE singers (
|
25
|
-
singerid INT64 NOT NULL,
|
26
|
-
first_name STRING(MAX),
|
27
|
-
last_name STRING(MAX)
|
28
|
-
) PRIMARY KEY (singerid);
|
29
|
-
|
30
|
-
CREATE TABLE albums (
|
31
|
-
albumid INT64 NOT NULL,
|
32
|
-
singerid INT64 NOT NULL,
|
33
|
-
title STRING(MAX)
|
34
|
-
) PRIMARY KEY (singerid, albumid), INTERLEAVE IN PARENT singers;
|
35
|
-
|
36
|
-
CREATE TABLE tracks (
|
37
|
-
trackid INT64 NOT NULL,
|
38
|
-
singerid INT64 NOT NULL,
|
39
|
-
albumid INT64 NOT NULL,
|
40
|
-
title STRING(MAX),
|
41
|
-
duration NUMERIC
|
42
|
-
) PRIMARY KEY (singerid, albumid, trackid), INTERLEAVE IN PARENT albums ON DELETE CASCADE;
|
43
|
-
```
|
44
|
-
|
45
|
-
This schema can be created in ActiveRecord as follows:
|
46
|
-
|
47
|
-
```ruby
|
48
|
-
create_table :singers, id: false do |t|
|
49
|
-
# Explicitly define the primary key with a custom name to prevent all primary key columns from being named `id`.
|
50
|
-
t.primary_key :singerid
|
51
|
-
t.string :first_name
|
52
|
-
t.string :last_name
|
53
|
-
end
|
54
|
-
|
55
|
-
create_table :albums, id: false do |t|
|
56
|
-
# Interleave the `albums` table in the parent table `singers`.
|
57
|
-
t.interleave_in :singers
|
58
|
-
t.primary_key :albumid
|
59
|
-
# `singerid` is defined as a `parent_key` which makes it a part of the primary key in the table definition, but
|
60
|
-
# it is not presented to ActiveRecord as part of the primary key, to prevent ActiveRecord from considering this
|
61
|
-
# to be an entity with a composite primary key (which is not supported by ActiveRecord).
|
62
|
-
t.parent_key :singerid
|
63
|
-
t.string :title
|
64
|
-
end
|
65
|
-
|
66
|
-
create_table :tracks, id: false do |t|
|
67
|
-
# Interleave the `tracks` table in the parent table `albums` and cascade delete all tracks that belong to an
|
68
|
-
# album when an album is deleted.
|
69
|
-
t.interleave_in :albums, :cascade
|
70
|
-
# `trackid` is considered the only primary key column by ActiveRecord.
|
71
|
-
t.primary_key :trackid
|
72
|
-
# `singerid` and `albumid` form the parent key of `tracks`. These are part of the primary key definition in the
|
73
|
-
# database, but are presented as parent keys to ActiveRecord.
|
74
|
-
t.parent_key :singerid
|
75
|
-
t.parent_key :albumid
|
76
|
-
t.string :title
|
77
|
-
t.numeric :duration
|
78
|
-
end
|
79
|
-
```
|
80
|
-
|
81
|
-
## Models for Interleaved Tables
|
82
|
-
An interleaved table parent/child relationship must be modelled as a `belongs_to`/`has_many` association in
|
83
|
-
ActiveRecord. As the columns that are used to reference a parent record use a custom column name, it is required to also
|
84
|
-
include the custom column name in the `belongs_to` and `has_many` definitions.
|
85
|
-
|
86
|
-
Instances of these models can be used in the same way as any other association in ActiveRecord, but with a couple of
|
87
|
-
inherent limitations:
|
88
|
-
* It is not possible to change the parent record of a child record. For instance, changing the singer of an album in the
|
89
|
-
above example is impossible, as Cloud Spanner does not allow such an update.
|
90
|
-
* It is not possible to de-reference a parent record by setting it to null.
|
91
|
-
* It is only possible to delete a parent record with existing child records, if the child records are also deleted. This
|
92
|
-
can be done by enabling ON DELETE CASCADE in Cloud Spanner, or by deleting the child records using ActiveRecord.
|
93
|
-
|
94
|
-
### Example Models
|
95
|
-
|
96
|
-
```ruby
|
97
|
-
class Singer < ActiveRecord::Base
|
98
|
-
# `albums` is defined as INTERLEAVE IN PARENT `singers`. The primary key of `albums` is (`singerid`, `albumid`), but
|
99
|
-
# only `albumid` is used by ActiveRecord as the primary key. The `singerid` column is defined as a `parent_key` of
|
100
|
-
# `albums` (see also the `db/migrate/01_create_tables.rb` file).
|
101
|
-
has_many :albums, foreign_key: "singerid"
|
102
|
-
|
103
|
-
# `tracks` is defined as INTERLEAVE IN PARENT `albums`. The primary key of `tracks` is
|
104
|
-
# (`singerid`, `albumid`, `trackid`), but only `trackid` is used by ActiveRecord as the primary key. The `singerid`
|
105
|
-
# and `albumid` columns are defined as `parent_key` of `tracks` (see also the `db/migrate/01_create_tables.rb` file).
|
106
|
-
# The `singerid` column can therefore be used to associate tracks with a singer without the need to go through albums.
|
107
|
-
# Note also that the inclusion of `singerid` as a column in `tracks` is required in order to make `tracks` a child
|
108
|
-
# table of `albums` which has primary key (`singerid`, `albumid`).
|
109
|
-
has_many :tracks, foreign_key: "singerid"
|
110
|
-
end
|
111
|
-
|
112
|
-
class Album < ActiveRecord::Base
|
113
|
-
# `albums` is defined as INTERLEAVE IN PARENT `singers`. The primary key of `singers` is `singerid`.
|
114
|
-
belongs_to :singer, foreign_key: "singerid"
|
115
|
-
|
116
|
-
# `tracks` is defined as INTERLEAVE IN PARENT `albums`. The primary key of `albums` is (`singerid`, `albumid`), but
|
117
|
-
# only `albumid` is used by ActiveRecord as the primary key. The `singerid` column is defined as a `parent_key` of
|
118
|
-
# `albums` (see also the `db/migrate/01_create_tables.rb` file).
|
119
|
-
has_many :tracks, foreign_key: "albumid"
|
120
|
-
end
|
121
|
-
|
122
|
-
class Track < ActiveRecord::Base
|
123
|
-
# `tracks` is defined as INTERLEAVE IN PARENT `albums`. The primary key of `albums` is ()`singerid`, `albumid`).
|
124
|
-
belongs_to :album, foreign_key: "albumid"
|
125
|
-
|
126
|
-
# `tracks` also has a `singerid` column should be used to associate a Track with a Singer.
|
127
|
-
belongs_to :singer, foreign_key: "singerid"
|
128
|
-
|
129
|
-
# Override the default initialize method to automatically set the singer attribute when an album is given.
|
130
|
-
def initialize attributes = nil
|
131
|
-
super
|
132
|
-
self.singer ||= album&.singer
|
133
|
-
end
|
134
|
-
|
135
|
-
def album=value
|
136
|
-
super
|
137
|
-
# Ensure the singer of this track is equal to the singer of the album that is set.
|
138
|
-
self.singer = value&.singer
|
139
|
-
end
|
140
|
-
end
|
141
|
-
```
|
142
|
-
|
143
|
-
## Running the Sample
|
144
|
-
|
145
|
-
The sample will automatically start a Spanner Emulator in a docker container and execute the sample
|
146
|
-
against that emulator. The emulator will automatically be stopped when the application finishes.
|
147
|
-
|
148
|
-
Run the application with the command
|
149
|
-
|
150
|
-
```bash
|
151
|
-
bundle exec rake run
|
152
|
-
```
|
@@ -1,13 +0,0 @@
|
|
1
|
-
# Copyright 2021 Google LLC
|
2
|
-
#
|
3
|
-
# Use of this source code is governed by an MIT-style
|
4
|
-
# license that can be found in the LICENSE file or at
|
5
|
-
# https://opensource.org/licenses/MIT.
|
6
|
-
|
7
|
-
require_relative "../config/environment"
|
8
|
-
require "sinatra/activerecord/rake"
|
9
|
-
|
10
|
-
desc "Sample showing how to work with interleaved tables in ActiveRecord."
|
11
|
-
task :run do
|
12
|
-
Dir.chdir("..") { sh "bundle exec rake run[interleaved-tables]" }
|
13
|
-
end
|
@@ -1,109 +0,0 @@
|
|
1
|
-
# Copyright 2021 Google LLC
|
2
|
-
#
|
3
|
-
# Use of this source code is governed by an MIT-style
|
4
|
-
# license that can be found in the LICENSE file or at
|
5
|
-
# https://opensource.org/licenses/MIT.
|
6
|
-
|
7
|
-
require "io/console"
|
8
|
-
require_relative "../config/environment"
|
9
|
-
require_relative "models/singer"
|
10
|
-
require_relative "models/album"
|
11
|
-
require_relative "models/track"
|
12
|
-
|
13
|
-
class Application
|
14
|
-
def self.run
|
15
|
-
# List all singers, albums and tracks.
|
16
|
-
list_singers_albums_tracks
|
17
|
-
|
18
|
-
# Create a new album with some tracks.
|
19
|
-
create_new_album
|
20
|
-
|
21
|
-
# Try to update the singer of an album. This is not possible as albums are interleaved in singers.
|
22
|
-
update_singer_of_album
|
23
|
-
|
24
|
-
# Try to delete a singer that has at least one album. This is NOT possible as albums is NOT marked with
|
25
|
-
# ON DELETE CASCADE.
|
26
|
-
delete_singer_with_albums
|
27
|
-
|
28
|
-
# Try to delete an album that has at least one track. This IS possible as tracks IS marked with
|
29
|
-
# ON DELETE CASCADE.
|
30
|
-
delete_album_with_tracks
|
31
|
-
|
32
|
-
puts ""
|
33
|
-
puts "Press any key to end the application"
|
34
|
-
STDIN.getch
|
35
|
-
end
|
36
|
-
|
37
|
-
def self.list_singers_albums_tracks
|
38
|
-
puts ""
|
39
|
-
puts "Listing all singers with corresponding albums and tracks"
|
40
|
-
Singer.all.order("last_name, first_name").each do |singer|
|
41
|
-
puts "#{singer.first_name} #{singer.last_name} has #{singer.albums.count} albums:"
|
42
|
-
singer.albums.order("title").each do |album|
|
43
|
-
puts " #{album.title} has #{album.tracks.count} tracks:"
|
44
|
-
album.tracks.each do |track|
|
45
|
-
puts " #{track.title}"
|
46
|
-
end
|
47
|
-
end
|
48
|
-
end
|
49
|
-
end
|
50
|
-
|
51
|
-
def self.create_new_album
|
52
|
-
# Create a new album with some tracks.
|
53
|
-
puts ""
|
54
|
-
singer = Singer.all.sample
|
55
|
-
puts "Creating a new album for #{singer.first_name} #{singer.last_name}"
|
56
|
-
album = singer.albums.build title: "New Title"
|
57
|
-
album.tracks.build title: "Track 1", duration: 3.5, singer: singer
|
58
|
-
album.tracks.build title: "Track 2", duration: 3.6, singer: singer
|
59
|
-
# This will save the album and corresponding tracks in one transaction.
|
60
|
-
album.save!
|
61
|
-
|
62
|
-
album.reload
|
63
|
-
puts "Album #{album.title} has #{album.tracks.count} tracks:"
|
64
|
-
album.tracks.order("title").each do |track|
|
65
|
-
puts " #{track.title} with duration #{track.duration}"
|
66
|
-
end
|
67
|
-
end
|
68
|
-
|
69
|
-
def self.update_singer_of_album
|
70
|
-
# It is not possible to change the singer of an album or the album of a track. This is because the associations
|
71
|
-
# between these are not traditional foreign keys, but an immutable parent-child relationship.
|
72
|
-
album = Album.all.sample
|
73
|
-
new_singer = Singer.all.except(album.singer).sample
|
74
|
-
# This will fail as we cannot assign a new singer to an album as it is an INTERLEAVE IN PARENT relationship.
|
75
|
-
begin
|
76
|
-
album.update! singer: new_singer
|
77
|
-
raise StandardError, "Unexpected error: Updating the singer of an album should not be possible."
|
78
|
-
rescue ActiveRecord::StatementInvalid
|
79
|
-
puts ""
|
80
|
-
puts "Failed to update the singer of an album. This is expected."
|
81
|
-
end
|
82
|
-
end
|
83
|
-
|
84
|
-
def self.delete_singer_with_albums
|
85
|
-
# Deleting a singer that has albums is not possible, as the INTERLEAVE IN PARENT of albums is not marked with
|
86
|
-
# ON DELETE CASCADE.
|
87
|
-
singer = Album.all.sample.singer
|
88
|
-
begin
|
89
|
-
singer.delete
|
90
|
-
raise StandardError, "Unexpected error: Updating the singer of an album should not be possible."
|
91
|
-
rescue ActiveRecord::StatementInvalid
|
92
|
-
puts ""
|
93
|
-
puts "Failed to delete a singer that has #{singer.albums.count} albums. This is expected."
|
94
|
-
end
|
95
|
-
end
|
96
|
-
|
97
|
-
def self.delete_album_with_tracks
|
98
|
-
# Deleting an album with tracks is supported, as the INTERLEAVE IN PARENT relationship between tracks and albums is
|
99
|
-
# marked with ON DELETE CASCADE.
|
100
|
-
puts ""
|
101
|
-
puts "Total track count: #{Track.count}"
|
102
|
-
album = Track.all.sample.album
|
103
|
-
puts "Deleting album #{album.title} with #{album.tracks.count} tracks"
|
104
|
-
album.delete
|
105
|
-
puts "Total track count after deletion: #{Track.count}"
|
106
|
-
end
|
107
|
-
end
|
108
|
-
|
109
|
-
Application.run
|
@@ -1,44 +0,0 @@
|
|
1
|
-
# Copyright 2021 Google LLC
|
2
|
-
#
|
3
|
-
# Use of this source code is governed by an MIT-style
|
4
|
-
# license that can be found in the LICENSE file or at
|
5
|
-
# https://opensource.org/licenses/MIT.
|
6
|
-
|
7
|
-
class CreateTables < ActiveRecord::Migration[6.0]
|
8
|
-
def change
|
9
|
-
# Execute the entire migration as one DDL batch.
|
10
|
-
connection.ddl_batch do
|
11
|
-
create_table :singers, id: false do |t|
|
12
|
-
# Explicitly define the primary key with a custom name to prevent all primary key columns from being named `id`.
|
13
|
-
t.primary_key :singerid
|
14
|
-
t.string :first_name
|
15
|
-
t.string :last_name
|
16
|
-
end
|
17
|
-
|
18
|
-
create_table :albums, id: false do |t|
|
19
|
-
# Interleave the `albums` table in the parent table `singers`.
|
20
|
-
t.interleave_in :singers
|
21
|
-
t.primary_key :albumid
|
22
|
-
# `singerid` is defined as a `parent_key` which makes it a part of the primary key in the table definition, but
|
23
|
-
# it is not presented to ActiveRecord as part of the primary key, to prevent ActiveRecord from considering this
|
24
|
-
# to be an entity with a composite primary key (which is not supported by ActiveRecord).
|
25
|
-
t.parent_key :singerid
|
26
|
-
t.string :title
|
27
|
-
end
|
28
|
-
|
29
|
-
create_table :tracks, id: false do |t|
|
30
|
-
# Interleave the `tracks` table in the parent table `albums` and cascade delete all tracks that belong to an
|
31
|
-
# album when an album is deleted.
|
32
|
-
t.interleave_in :albums, :cascade
|
33
|
-
# `trackid` is considered the only primary key column by ActiveRecord.
|
34
|
-
t.primary_key :trackid
|
35
|
-
# `singerid` and `albumid` form the parent key of `tracks`. These are part of the primary key definition in the
|
36
|
-
# database, but are presented as parent keys to ActiveRecord.
|
37
|
-
t.parent_key :singerid
|
38
|
-
t.parent_key :albumid
|
39
|
-
t.string :title
|
40
|
-
t.numeric :duration
|
41
|
-
end
|
42
|
-
end
|
43
|
-
end
|
44
|
-
end
|
@@ -1,32 +0,0 @@
|
|
1
|
-
# This file is auto-generated from the current state of the database. Instead
|
2
|
-
# of editing this file, please use the migrations feature of Active Record to
|
3
|
-
# incrementally modify your database, and then regenerate this schema definition.
|
4
|
-
#
|
5
|
-
# This file is the source Rails uses to define your schema when running `rails
|
6
|
-
# db:schema:load`. When creating a new database, `rails db:schema:load` tends to
|
7
|
-
# be faster and is potentially less error prone than running all of your
|
8
|
-
# migrations from scratch. Old migrations may fail to apply correctly if those
|
9
|
-
# migrations use external dependencies or application code.
|
10
|
-
#
|
11
|
-
# It's strongly recommended that you check this file into your version control system.
|
12
|
-
|
13
|
-
ActiveRecord::Schema.define(version: 1) do
|
14
|
-
|
15
|
-
create_table "albums", primary_key: "albumid", force: :cascade do |t|
|
16
|
-
t.integer "singerid", limit: 8, null: false
|
17
|
-
t.string "title"
|
18
|
-
end
|
19
|
-
|
20
|
-
create_table "singers", primary_key: "singerid", force: :cascade do |t|
|
21
|
-
t.string "first_name"
|
22
|
-
t.string "last_name"
|
23
|
-
end
|
24
|
-
|
25
|
-
create_table "tracks", primary_key: "trackid", force: :cascade do |t|
|
26
|
-
t.integer "singerid", limit: 8, null: false
|
27
|
-
t.integer "albumid", limit: 8, null: false
|
28
|
-
t.string "title"
|
29
|
-
t.decimal "duration"
|
30
|
-
end
|
31
|
-
|
32
|
-
end
|
@@ -1,40 +0,0 @@
|
|
1
|
-
# Copyright 2021 Google LLC
|
2
|
-
#
|
3
|
-
# Use of this source code is governed by an MIT-style
|
4
|
-
# license that can be found in the LICENSE file or at
|
5
|
-
# https://opensource.org/licenses/MIT.
|
6
|
-
|
7
|
-
require_relative "../../config/environment.rb"
|
8
|
-
require_relative "../models/singer"
|
9
|
-
require_relative "../models/album"
|
10
|
-
require_relative "../models/track"
|
11
|
-
|
12
|
-
first_names = %w[Pete Alice John Ethel Trudy Naomi Wendy Ruben Thomas Elly]
|
13
|
-
last_names = %w[Wendelson Allison Peterson Johnson Henderson Ericsson Aronson Tennet Courtou]
|
14
|
-
|
15
|
-
adjectives = %w[daily happy blue generous cooked bad open]
|
16
|
-
nouns = %w[windows potatoes bank street tree glass bottle]
|
17
|
-
|
18
|
-
verbs = %w[operate waste package chew yield express polish stress slip want cough campaign cultivate report park refer]
|
19
|
-
adverbs = %w[directly right hopefully personally economically privately supposedly consequently fully later urgently]
|
20
|
-
|
21
|
-
durations = [3.14, 5.4, 3.3, 4.1, 5.0, 3.2, 3.0, 3.5, 4.0, 4.5, 5.5, 6.0]
|
22
|
-
|
23
|
-
# This ensures all the records are inserted using one read/write transaction that will use mutations instead of DML.
|
24
|
-
ActiveRecord::Base.transaction isolation: :buffered_mutations do
|
25
|
-
singers = []
|
26
|
-
5.times do
|
27
|
-
singers << Singer.create(first_name: first_names.sample, last_name: last_names.sample)
|
28
|
-
end
|
29
|
-
|
30
|
-
albums = []
|
31
|
-
20.times do
|
32
|
-
singer = singers.sample
|
33
|
-
albums << Album.create(title: "#{adjectives.sample} #{nouns.sample}", singer: singer)
|
34
|
-
end
|
35
|
-
|
36
|
-
200.times do
|
37
|
-
album = albums.sample
|
38
|
-
Track.create title: "#{verbs.sample} #{adverbs.sample}", duration: durations.sample, album: album
|
39
|
-
end
|
40
|
-
end
|
@@ -1,15 +0,0 @@
|
|
1
|
-
# Copyright 2021 Google LLC
|
2
|
-
#
|
3
|
-
# Use of this source code is governed by an MIT-style
|
4
|
-
# license that can be found in the LICENSE file or at
|
5
|
-
# https://opensource.org/licenses/MIT.
|
6
|
-
|
7
|
-
class Album < ActiveRecord::Base
|
8
|
-
# `albums` is defined as INTERLEAVE IN PARENT `singers`. The primary key of `singers` is `singerid`.
|
9
|
-
belongs_to :singer, foreign_key: "singerid"
|
10
|
-
|
11
|
-
# `tracks` is defined as INTERLEAVE IN PARENT `albums`. The primary key of `albums` is (`singerid`, `albumid`), but
|
12
|
-
# only `albumid` is used by ActiveRecord as the primary key. The `singerid` column is defined as a `parent_key` of
|
13
|
-
# `albums` (see also the `db/migrate/01_create_tables.rb` file).
|
14
|
-
has_many :tracks, foreign_key: "albumid"
|
15
|
-
end
|
@@ -1,20 +0,0 @@
|
|
1
|
-
# Copyright 2021 Google LLC
|
2
|
-
#
|
3
|
-
# Use of this source code is governed by an MIT-style
|
4
|
-
# license that can be found in the LICENSE file or at
|
5
|
-
# https://opensource.org/licenses/MIT.
|
6
|
-
|
7
|
-
class Singer < ActiveRecord::Base
|
8
|
-
# `albums` is defined as INTERLEAVE IN PARENT `singers`. The primary key of `albums` is (`singerid`, `albumid`), but
|
9
|
-
# only `albumid` is used by ActiveRecord as the primary key. The `singerid` column is defined as a `parent_key` of
|
10
|
-
# `albums` (see also the `db/migrate/01_create_tables.rb` file).
|
11
|
-
has_many :albums, foreign_key: "singerid"
|
12
|
-
|
13
|
-
# `tracks` is defined as INTERLEAVE IN PARENT `albums`. The primary key of `tracks` is
|
14
|
-
# (`singerid`, `albumid`, `trackid`), but only `trackid` is used by ActiveRecord as the primary key. The `singerid`
|
15
|
-
# and `albumid` columns are defined as `parent_key` of `tracks` (see also the `db/migrate/01_create_tables.rb` file).
|
16
|
-
# The `singerid` column can therefore be used to associate tracks with a singer without the need to go through albums.
|
17
|
-
# Note also that the inclusion of `singerid` as a column in `tracks` is required in order to make `tracks` a child
|
18
|
-
# table of `albums` which has primary key (`singerid`, `albumid`).
|
19
|
-
has_many :tracks, foreign_key: "singerid"
|
20
|
-
end
|
@@ -1,25 +0,0 @@
|
|
1
|
-
# Copyright 2021 Google LLC
|
2
|
-
#
|
3
|
-
# Use of this source code is governed by an MIT-style
|
4
|
-
# license that can be found in the LICENSE file or at
|
5
|
-
# https://opensource.org/licenses/MIT.
|
6
|
-
|
7
|
-
class Track < ActiveRecord::Base
|
8
|
-
# `tracks` is defined as INTERLEAVE IN PARENT `albums`. The primary key of `albums` is ()`singerid`, `albumid`).
|
9
|
-
belongs_to :album, foreign_key: "albumid"
|
10
|
-
|
11
|
-
# `tracks` also has a `singerid` column should be used to associate a Track with a Singer.
|
12
|
-
belongs_to :singer, foreign_key: "singerid"
|
13
|
-
|
14
|
-
# Override the default initialize method to automatically set the singer attribute when an album is given.
|
15
|
-
def initialize attributes = nil
|
16
|
-
super
|
17
|
-
self.singer ||= album&.singer
|
18
|
-
end
|
19
|
-
|
20
|
-
def album=value
|
21
|
-
super
|
22
|
-
# Ensure the singer of this track is equal to the singer of the album that is set.
|
23
|
-
self.singer = value&.singer
|
24
|
-
end
|
25
|
-
end
|