red_amber 0.4.1 → 0.4.2

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: 264e7637475fd01946900335751a1592a3859e9bfa772ecc0800ab05c4d852f0
-  data.tar.gz: a57400445419698a66d6b5c94e15fa8c040f2f3930f9fbf75603ffb6e18bd9cf
+  metadata.gz: 498f580bc6fc79e36b199cc3ec62c38638e4df903e956a7a78947d9091748d0c
+  data.tar.gz: 24c3f25ff47b6bba0af26d1a1c77a80a56c2115e0bd76d26ba3f769f71d3557b
 SHA512:
-  metadata.gz: 0fdbcdb732e36bb866a8251800ab3fa1a714fa075234bf8cd516f2542ab6704ebfa429a7177da2bd8cd6fa6eb1158efb0d68f46f43d1dc088a9a0f0debdc5c54
-  data.tar.gz: f9c1dffaa157ecf34b0b4fec6c1d7972b4773bbf7a11101a345172d621753cd9fc3818753b329dd2906a506af294d6a96c0180a0fb4dc84c2b54bceef6b520f5
+  metadata.gz: '085caa83703f4b9be0a3baae3318f0bcb606bbf264347ad3db431b29fb59c87e05b142ab1fd7e8a0af0a3d64b0b81055f1e85d82414f773d01456cf5a386df25'
+  data.tar.gz: 901e7eda6560eb2a9ab378d672b39d3ba08ae47012d8465ce541a465d744ce45d93a451ef2bff8fdf838fc1040b12facc58c87d95c6f6bedb89c5c138b95005c

data/.rubocop.yml

@@ -52,7 +52,7 @@ Lint/BinaryOperatorWithIdenticalOperands:
 
 Lint/Debugger:
   Exclude:
-    - 'bin/example'
+    - 'docker/example'
 
 # Need for test with empty block
 # Offense count: 1
@@ -219,7 +219,7 @@ Naming/PredicateName:
 Rubycw/Rubycw:
   Exclude:
     - 'test/**/*'
-    - 'bin/example'
+    - 'docker/example'
 
 # Offense count: 16
 # This cop supports safe autocorrection (--autocorrect).
@@ -236,7 +236,7 @@ Style/SlicingWithRange:
 
 Style/MixinUsage:
   Exclude:
-    - 'bin/example'
+    - 'docker/example'
 
 # Necessary to Vector < 0 element-wise comparison
 # Offense count: 5

data/CHANGELOG.md

@@ -1,3 +1,38 @@
+## [0.4.2] - 2023-04-02
+
+- Breaking change
+
+- Bug fixes
+ - Fix Vector#modulo, #fdiv, #remainder (#203)
+ 
+- New features and improvements
+  - Update SubFrames#take to return SubFrames (#212)
+
+- Refactoring
+  - Refine SubFrames to support partial retrieval (#207)
+  - Upgrade SubFrames#frames  and promote to public (#207)
+  - Use faster count in Group#inspect (#207)
+
+- Improve in tests/CI
+
+- Documentation and Example
+  - Introduce minimum docker environment (#205)
+  - Move example REPL to docker (#205)
+  - Add readme.md in docker (#205)
+  - Add example_of_red_amber.ipynb (#205)
+  - Use smaller dataset in irb example
+  - Fix docker/example
+  - Updated link to red-data-tools (#213)
+    - Thanks to Soumya Kushwaha
+
+- GitHub site
+  - Migrated to [Red Data Tools](https://github.com/red-data-tools)
+    - Thanks to Sutou Kouhei
+
+- Thanks
+  - Sutou Kouhei
+  - Soumya Kushwaha
+
 ## [0.4.1] - 2023-03-11
 
 - Breaking change
@@ -676,7 +711,7 @@
    -  Improve `DataFrame#[]`, `#slice`, `#remove` by a new engine
       -  It parses arguments to Vector internally.
       -  Used Kernel#Array to simplify code (#16) .
-    - recycle: Move `DataFrame#slice`, `#remove` to Selectable
+    - Move `DataFrame#slice`, `#remove` to Selectable
     - Refine `DataFrame#take`, `#filter` (undocumented)
 
   - Introduce coerce in Vector (#35)

data/README.md

@@ -1,11 +1,11 @@
 # RedAmber
 
 [![Gem Version](https://img.shields.io/gem/v/red_amber?color=brightgreen)](https://rubygems.org/gems/red_amber)
-[![CI](https://github.com/heronshoes/red_amber/actions/workflows/ci.yml/badge.svg)](https://github.com/heronshoes/red_amber/actions/workflows/ci.yml)
+[![CI](https://github.com/heronshoes/red_amber/actions/workflows/ci.yml/badge.svg)](https://github.com/red-data-tools/red_amber/actions/workflows/ci.yml)
 [![Maintainability](https://api.codeclimate.com/v1/badges/b8a745047045d2f49daa/maintainability)](https://codeclimate.com/github/heronshoes/red_amber/maintainability)
 [![Test coverage](https://api.codeclimate.com/v1/badges/b8a745047045d2f49daa/test_coverage)](https://codeclimate.com/github/heronshoes/red_amber/test_coverage)
 [![Doc](https://img.shields.io/badge/docs-latest-blue)](https://heronshoes.github.io/red_amber/)
-[![Discussions](https://img.shields.io/github/discussions/heronshoes/red_amber)](https://github.com/heronshoes/red_amber/discussions)
+[![Discussions](https://img.shields.io/github/discussions/heronshoes/red_amber)](https://github.com/red-data-tools/red_amber/discussions)
 
 A simple dataframe library for Ruby.
 
@@ -13,12 +13,12 @@ A simple dataframe library for Ruby.
 [![Gitter Chat](https://badges.gitter.im/red-data-tools/en.svg)](https://gitter.im/red-data-tools/en) [![Gem Version](https://img.shields.io/gem/v/red-arrow?color=brightgreen)](https://rubygems.org/gems/red-arrow)
 - Inspired by the dataframe library [Rover-df](https://github.com/ankane/rover)
 
-![screenshot from jupyterlab](https://raw.githubusercontent.com/heronshoes/red_amber/main/doc/image/screenshot.png)
+![screenshot from jupyterlab](https://raw.githubusercontent.com/red-data-tools/red_amber/main/doc/image/screenshot.png)
 
 ## Requirements
 ### Ruby
 Supported Ruby version is >= 3.0 (since RedAmber 0.3.0).
-- I decided to remove support for Ruby 2.7 without waiting for its EOL. See [Release note for v0.3.0](https://github.com/heronshoes/red_amber/discussions/162) for details.
+- I decided to remove support for Ruby 2.7 without waiting for its EOL. See [Release note for v0.3.0](https://github.com/red-data-tools/red_amber/discussions/162) for details.
 
 ### Libraries
 ```ruby
@@ -78,11 +78,13 @@ And then execute `bundle install` or install them yourself such as `gem install
 
 ## Docker image and Jupyter Notebook
 
-[RubyData Docker Stacks](https://github.com/RubyData/docker-stacks) is available as a ready-to-run Docker image containing Jupyter and useful data tools as well as RedAmber (Thanks to Kenta Murata).
+Docker image is available from docker folder. See [readme](docker/readme.md) for instruction. Integrated Jypyter notebook is in docker/notebook folder.
 
-Also you can try the contents of this README interactively by [Binder](https://mybinder.org/v2/gh/heronshoes/docker-stacks/RedAmber-binder?filepath=red-amber.ipynb). 
+You can try the contents of this README interactively by [Binder](https://mybinder.org/v2/gh/heronshoes/docker-stacks/RedAmber-binder?filepath=red-amber.ipynb). 
 [![Binder](https://mybinder.org/badge_logo.svg)](https://mybinder.org/v2/gh/heronshoes/docker-stacks/RedAmber-binder?filepath=red-amber.ipynb)
 
+[RubyData Docker Stacks](https://github.com/RubyData/docker-stacks) is available as a ready-to-run Docker image containing Jupyter and useful data tools as well as RedAmber (Thanks to Kenta Murata).
+
 ## Comparison of DataFrames
 
 Comparison of  basic features of RedAmber with Python 
@@ -95,7 +97,7 @@ Julia [Dataframes](https://dataframes.juliadata.org/stable/) is in [DataFrame_Co
 Class `RedAmber::DataFrame` represents a set of data in 2D-shape.
 Its entity is a Red Arrow's Table object. 
 
-![dataframe model of RedAmber](https://raw.githubusercontent.com/heronshoes/red_amber/main/doc/image/dataframe_model.png)
+![dataframe model of RedAmber](https://raw.githubusercontent.com/red-data-tools/red_amber/main/doc/image/dataframe_model.png)
 
 Let's load the library and try some examples.
 
@@ -222,7 +224,7 @@ You can try this notebook on [Binder](https://mybinder.org/v2/gh/heronshoes/dock
 ## Development
 
 ```shell
-git clone https://github.com/heronshoes/red_amber.git
+git clone https://github.com/red-data-tools/red_amber.git
 cd red_amber
 bundle install
 bundle exec rake test
@@ -232,12 +234,12 @@ bundle exec rake test
 
 I will appreciate if you could help to improve this project. Here are a few ways you can help:
 
-- Let's talk in the [discussions](https://github.com/heronshoes/red_amber/discussions). [![Discussions](https://img.shields.io/github/discussions/heronshoes/red_amber)](https://github.com/heronshoes/red_amber/discussions)
+- Let's talk in the [discussions](https://github.com/heronshoes/red_amber/discussions). [![Discussions](https://img.shields.io/github/discussions/heronshoes/red_amber)](https://github.com/red-data-tools/red_amber/discussions)
   - Browse Q and A, how to use, tips, etc.
   - Ask questions you’re wondering about.
   - Share ideas. The idea may be promoted to issues or pull requests.
-- [Report bugs or suggest new features](https://github.com/heronshoes/red_amber/issues)
-- Fix bugs and [submit pull requests](https://github.com/heronshoes/red_amber/pulls)
+- [Report bugs or suggest new features](https://github.com/red-data-tools/red_amber/issues)
+- Fix bugs and [submit pull requests](https://github.com/red-data-tools/red_amber/pulls)
 - Write, clarify, or fix documentation
 
 ## License

data/benchmark/basic.yml

@@ -43,7 +43,7 @@ benchmark:
   'B06: Pick by a block': |
     df.pick { keys.map { |key| key.end_with?('time') } }
 
-  'B07: Slice([]) by a index': |
+  'B07: Slice([]) by an index': |
     df[877]
 
   'B08: Slice by indeces': |

data/doc/CODE_OF_CONDUCT.md

@@ -39,7 +39,7 @@ This Code of Conduct applies within all community spaces, and also applies when
 
 ## Enforcement
 
-Instances of abusive, harassing, or otherwise unacceptable behavior may be reported to the community leaders responsible for enforcement at 63298319+heronshoes@users.noreply.github.com. All complaints will be reviewed and investigated promptly and fairly.
+Instances of abusive, harassing, or otherwise unacceptable behavior may be reported to the community leaders responsible for enforcement at heronshoes877@gmail.com. All complaints will be reviewed and investigated promptly and fairly.
 
 All community leaders are obligated to respect the privacy and security of the reporter of any incident.
 

data/docker/.env

@@ -0,0 +1,4 @@
+NB_USER=jovyan
+
+TZ=
+TOKEN=''

data/docker/Dockerfile

@@ -0,0 +1,66 @@
+# x86-64/Ubuntu-22.04/python-3.10.9/lab-3.6.1/notebook-6.5.3/2023-03-13
+ARG BASE_IMAGE_TAG=295612d3ade4
+
+FROM jupyter/minimal-notebook:$BASE_IMAGE_TAG
+
+USER root
+
+RUN set -eux; \
+    apt update; \
+    apt install -y --no-install-recommends \
+        curl \
+        \
+        # For Apache Arrow
+        ca-certificates \
+        lsb-release \
+        \
+        # Ruby 3.0.2
+        ruby-dev \
+        \
+        # For iruby
+        libczmq-dev \
+        libzmq3-dev
+
+# Apache Arrow
+ARG ARROW_DEB_TMP=/tmp/apache-arrow-apt-source-latest.deb
+
+RUN set -eux; \
+    apt update; \
+    curl -sfSL -o ${ARROW_DEB_TMP} \
+        https://apache.jfrog.io/artifactory/arrow/$(lsb_release --id --short | tr 'A-Z' 'a-z')/apache-arrow-apt-source-latest-$(lsb_release --codename --short).deb; \
+    apt install -y --no-install-recommends \
+        ${ARROW_DEB_TMP}; \
+    rm -f ${ARROW_DEB_TMP}; \
+    apt update; \
+    apt install -y \
+        libarrow-dev \
+        libarrow-glib-dev \
+        libparquet-dev \
+        libparquet-glib-dev \
+        libgirepository1.0-dev; \
+    rm -rf /var/lib/apt/lists/*
+
+USER $NB_UID
+
+WORKDIR $HOME
+
+ENV PATH $HOME/.local/share/gem/bin:$HOME/.local/share/gem/ruby/3.0.0/bin:$PATH
+
+# IRuby
+RUN set -eux; \
+    gem install --user-install \
+        rake \
+        bundler \
+        iruby; \
+    iruby register --force
+
+COPY --chown=$NB_UID:$NB_GID Gemfile $HOME
+COPY --chown=$NB_UID:$NB_GID Gemfile.lock $HOME
+
+ENV GEM_HOME=$HOME/.local/share/gem
+ENV BUNDLE_PATH=$HOME/.local/share/gem
+ENV BUNDLE_BIN=$HOME/.local/share/gem/bin
+
+RUN bundle install --jobs=4
+
+COPY --chown=$NB_UID:$NB_GID example $HOME

data/docker/Gemfile

@@ -0,0 +1,21 @@
+# frozen_string_literal: true
+
+source 'https://rubygems.org'
+
+gem 'irb'
+
+gem 'numo-narray'
+gem 'red-arrow', '~> 11.0.0'
+gem 'red-arrow-numo-narray'
+gem 'red-parquet', '~> 11.0.0'
+
+gem 'red_amber', '>=0.4.0'
+gem 'red-amber-view'
+gem 'rover-df'
+
+gem 'red-datasets'
+gem 'red-datasets-arrow'
+
+gem 'benchmark_driver'
+gem 'benchmark-ips'
+gem 'faker'

data/docker/Gemfile.lock

@@ -0,0 +1,80 @@
+GEM
+  remote: https://rubygems.org/
+  specs:
+    benchmark-ips (2.12.0)
+    benchmark_driver (0.16.3)
+    bigdecimal (3.1.4)
+    concurrent-ruby (1.2.2)
+    csv (3.2.6)
+    extpp (0.1.1)
+    faker (3.1.1)
+      i18n (>= 1.8.11, < 2)
+    fiddle (1.1.1)
+    gio2 (4.1.2)
+      fiddle
+      gobject-introspection (= 4.1.2)
+    glib2 (4.1.2)
+      native-package-installer (>= 1.0.3)
+      pkg-config (>= 1.3.5)
+    gobject-introspection (4.1.2)
+      glib2 (= 4.1.2)
+    i18n (1.12.0)
+      concurrent-ruby (~> 1.0)
+    io-console (0.6.0)
+    irb (1.6.3)
+      reline (>= 0.3.0)
+    libui (0.0.15)
+    native-package-installer (1.1.5)
+    numo-narray (0.9.2.1)
+    pkg-config (1.5.1)
+    red-amber-view (0.0.1)
+      libui
+      red-arrow
+      red_amber
+    red-arrow (11.0.0)
+      bigdecimal (>= 3.1.0)
+      extpp (>= 0.1.1)
+      gio2 (>= 3.5.0)
+      native-package-installer
+      pkg-config
+    red-arrow-numo-narray (0.0.6)
+      numo-narray
+      red-arrow
+    red-datasets (0.1.5)
+      csv (>= 3.2.4)
+      rexml
+      rubyzip
+    red-datasets-arrow (0.0.3)
+      red-arrow
+      red-datasets (>= 0.0.3)
+    red-parquet (11.0.0)
+      red-arrow (= 11.0.0)
+    red_amber (0.4.1)
+      red-arrow (~> 11.0.0)
+    reline (0.3.2)
+      io-console (~> 0.5)
+    rexml (3.2.5)
+    rover-df (0.3.4)
+      numo-narray (>= 0.9.1.9)
+    rubyzip (2.3.2)
+
+PLATFORMS
+  x86_64-linux
+
+DEPENDENCIES
+  benchmark-ips
+  benchmark_driver
+  faker
+  irb
+  numo-narray
+  red-amber-view
+  red-arrow (~> 11.0.0)
+  red-arrow-numo-narray
+  red-datasets
+  red-datasets-arrow
+  red-parquet (~> 11.0.0)
+  red_amber (>= 0.4.1)
+  rover-df
+
+BUNDLED WITH
+   2.4.8

data/docker/docker-compose.yml

@@ -0,0 +1,21 @@
+version: '3'
+
+services:
+  minimal-redamber:
+    build:
+      context: .
+      dockerfile: Dockerfile
+    image: red_amber-minimal-notebook
+    container_name: red_amber-minimal-notebook
+    user: root
+    environment:
+      - GRANT_SUDO=yes
+      - NB_USER=$NB_USER
+      - CHOWN_HOME=yes
+      - TZ=$TZ
+    working_dir: /home/$NB_USER/work
+    ports:
+      - '8888:8888'
+    volumes:
+      - ./notebook:/home/$NB_USER/work
+    command: start-notebook.sh --NotebookApp.token=$TOKEN

data/docker/example

@@ -0,0 +1,74 @@
+#!/usr/bin/env ruby
+# frozen_string_literal: true
+
+$stderr.print "starting.\r"
+
+require 'bundler/setup'
+
+$stderr.print "starting..\r"
+require 'red_amber'
+include RedAmber
+
+$stderr.print "starting...\r"
+require 'datasets-arrow'
+
+$stderr.print "reading penguins...\r"
+penguins = DataFrame.new(Datasets::Penguins.new)
+
+$stderr.print "reading diamonds...\r"
+diamonds = DataFrame.new(Datasets::Diamonds.new)
+
+$stderr.print "reading starwars...\r"
+starwars = DataFrame.new(Datasets::Rdataset.new('dplyr', 'starwars'))
+
+$stderr.print "reading openintro/simpsons_paradox_covid...\r"
+ds = Datasets::Rdataset.new('openintro', 'simpsons_paradox_covid')
+simpsons_paradox_covid = DataFrame.new(ds.to_arrow)
+
+$stderr.print "reading mtcars...                          \r"
+mtcars = DataFrame.new(Datasets::Rdatasets.new('datasets', 'mtcars'))
+
+$stderr.print "reading iris...  \r"
+iris = DataFrame.new(Datasets::Iris.new)
+
+$stderr.print "reading band_members...\r"
+band_members = DataFrame.new(Datasets::Rdatasets.new('dplyr', 'band_members'))
+
+$stderr.print "reading band_instruments...\r"
+band_instruments = DataFrame.new(Datasets::Rdatasets.new('dplyr', 'band_instruments'))
+
+$stderr.print "reading band_instruments2...\r"
+band_instruments2 = DataFrame.new(Datasets::Rdatasets.new('dplyr', 'band_instruments2'))
+
+$stderr.print "reading import_cars...      \r"
+import_cars = DataFrame.load(Arrow::Buffer.new(<<~TSV), format: :tsv)
+  Year	Audi	BMW	BMW_MINI	Mercedes-Benz	VW
+  2017	28336	52527	25427	68221	49040
+  2018	26473	50982	25984	67554	51961
+  2019	24222	46814	23813	66553	46794
+  2020	22304	35712	20196	57041	36576
+  2021	22535	35905	18211	51722	35215
+TSV
+
+$stderr.print "reading comecome...   \r"
+comecome = DataFrame.load(Arrow::Buffer.new(<<~CSV), format: :csv)
+  name,age
+  Yasuko,68
+  Rui,49
+  Hinata,28
+CSV
+
+$stderr.print "reading general dataframe and subframes...\r"
+dataframe = DataFrame.new(
+  x: [*1..6],
+  y: %w[A A B B B C],
+  z: [false, true, false, nil, true, false]
+)
+subframes = SubFrames.new(dataframe, [[0, 1], [2, 3, 4], [5]])
+
+# Welcome to RedAmber example!
+# This environment will offer these pre-loaded datasets:
+#   penguins, diamonds, iris, starwars, simpsons_paradox_covid,
+#   mtcars, band_members, band_instruments, band_instruments2
+#   (original) import_cars, comecome, dataframe, subframes
+binding.irb