sastrawi-ruby 0.2.0

checksums.yaml

@@ -0,0 +1,7 @@
+---
+SHA256:
+  metadata.gz: 293b0a6274835ba56e5df1e6c0a96b725e026ef703af178b7f791c3763b723c3
+  data.tar.gz: 2b74b53603072b2e4171abfc8117308dae795a78b2e0071fd73a7961e732808b
+SHA512:
+  metadata.gz: dc74bcdbcb213b19c26e0dd6480077e69ae8dec455911b5004af662547fe0e7bd5af72943615025025d244b9f7532e1f6b062bf213b99ae8f0e96b7f8c8db73b
+  data.tar.gz: eb5807126530f67a26935fd85130206ee08da1a4817d0e1d1f7151b011dc6533f6ef16b4a41673a5c2af5ec85a776d0be84e77ee024da15a730d7b090786dab9

data/.github/workflows/ci.yml

@@ -0,0 +1,23 @@
+name: CI
+
+on:
+  push:
+    branches: [master]
+  pull_request:
+    branches: [master]
+
+jobs:
+  test:
+    runs-on: ubuntu-latest
+    strategy:
+      matrix:
+        ruby-version: ['3.0', '3.1', '3.2', '3.3', '3.4']
+    steps:
+      - uses: actions/checkout@v4
+      - name: Set up Ruby ${{ matrix.ruby-version }}
+        uses: ruby/setup-ruby@v1
+        with:
+          ruby-version: ${{ matrix.ruby-version }}
+          bundler-cache: true
+      - name: Run tests
+        run: bundle exec rspec

data/.gitignore

@@ -0,0 +1,51 @@
+*.gem
+*.rbc
+/.config
+/coverage/
+/InstalledFiles
+/pkg/
+/spec/reports/
+/spec/examples.txt
+/test/tmp/
+/test/version_tmp/
+/tmp/
+
+# Used by dotenv library to load environment variables.
+# .env
+
+## Specific to RubyMotion:
+.dat*
+.repl_history
+build/
+*.bridgesupport
+build-iPhoneOS/
+build-iPhoneSimulator/
+
+## Specific to RubyMotion (use of CocoaPods):
+#
+# We recommend against adding the Pods directory to your .gitignore. However
+# you should judge for yourself, the pros and cons are mentioned at:
+# https://guides.cocoapods.org/using/using-cocoapods.html#should-i-check-the-pods-directory-into-source-control
+#
+# vendor/Pods/
+
+## Documentation cache and generated files:
+/.yardoc/
+/_yardoc/
+/doc/
+/rdoc/
+
+## Environment normalization:
+/.bundle/
+/vendor/bundle
+/lib/bundler/man/
+
+# for a library or gem, you might want to ignore these files since the code is
+# intended to run in multiple environments; otherwise, check them in:
+Gemfile.lock
+# .ruby-version
+# .ruby-gemset
+
+# unless supporting rvm < 1.11.0 or doing something fancy, ignore this:
+.rvmrc
+CLAUDE.md

data/.travis.yml

@@ -0,0 +1,10 @@
+sudo: false
+language: ruby
+rvm:
+  - 2.3.8
+  - 2.4.5
+  - 2.5.3
+before_install: gem install bundler -v 2.2.14 --no-document
+notifications:
+  email:
+    on_success: never

data/CONTRIBUTING.md

@@ -0,0 +1,22 @@
+# Contributing to sastrawi-ruby
+
+If you find a bug, please report it to [issue tracker][issue]. You can also
+contribute by writing codes.
+
+## How to contribute
+
+There are some steps you must follow:
+
+1. Fork this repository and clone it to your local environment
+2. Create a named brached that contains your change
+3. Install the development dependencies by running `bundle install`
+4. Code
+5. Add or adjust unit tests and make sure everything passes by running `bundle
+   exec rake`
+6. Push your branch to GitHub
+7. Send a pull request for your branch
+
+Use `dev` branch as a target of your branch for pull request. Both issue and pull
+request details must be written in English.
+
+[issue]: https://github.com/meisyal/sastrawi-ruby/issues

data/Gemfile

@@ -0,0 +1,4 @@
+source 'https://rubygems.org'
+
+# Specify your gem's dependencies in sastrawi.gemspec
+gemspec

data/LICENSE.txt

@@ -0,0 +1,21 @@
+The MIT License (MIT)
+
+Copyright (c) 2016-2021 Andrias Meisyal
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in
+all copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN
+THE SOFTWARE.

data/README.md

@@ -0,0 +1,104 @@
+# sastrawi-ruby
+
+Indonesian language stemmer for Ruby. Stems words in Bahasa Indonesia using the Nazief & Adriani algorithm with Enhanced Confix Stripping (ECS).
+
+This is an actively maintained fork of [meisyal/sastrawi-ruby](https://github.com/meisyal/sastrawi-ruby).
+
+## What's New in v0.2.0
+
+- **Bug fixes**: Fixed 3 stemming bugs (`menerangi`, `berimanlah`, `kesepersepuluhnya`)
+- **Dictionary**: Added missing words (`sepuluh`)
+- **Modernized**: Ruby 3.0+ required, updated dependencies, GitHub Actions CI
+- **Fixed regex warning** in disambiguator prefix rule 16
+
+## Installation
+
+```ruby
+# Gemfile
+gem "sastrawi"
+```
+
+```bash
+gem install sastrawi
+```
+
+Requires Ruby 3.0+.
+
+## Usage
+
+### Stemming
+
+```ruby
+require "sastrawi"
+
+factory = Sastrawi::Stemmer::StemmerFactory.new
+stemmer = factory.create_stemmer
+
+stemmer.stem("Perekonomian Indonesia sedang dalam pertumbuhan yang membanggakan")
+# => "ekonomi indonesia sedang dalam tumbuh yang bangga"
+
+stemmer.stem("membangunkan")  # => "bangun"
+stemmer.stem("bersembunyi")   # => "sembunyi"
+stemmer.stem("menerangi")     # => "terang"
+stemmer.stem("kesepersepuluhnya") # => "sepuluh"
+```
+
+### Stop Word Removal
+
+```ruby
+require "sastrawi"
+
+factory = Sastrawi::StopWordRemover::StopWordRemoverFactory.new
+stop_words = factory.get_stop_word
+# => ["a", "ada", "adalah", "agar", "akan", ...]
+```
+
+### Custom Dictionary
+
+```ruby
+require "sastrawi"
+
+factory = Sastrawi::Stemmer::StemmerFactory.new
+dictionary = factory.create_default_dictionary
+
+# Add words from file
+dictionary.add_words_from_text_file("my-dictionary.txt")
+
+# Add/remove individual words
+dictionary.add("internet")
+dictionary.remove("desa")
+
+stemmer = Sastrawi::Stemmer::Stemmer.new(dictionary)
+stemmer.stem("internetan")  # => "internet"
+```
+
+## How It Works
+
+Indonesian stemming removes affixes (prefixes, suffixes, infixes) to find base words:
+
+| Affix Type | Examples | Algorithm Step |
+|---|---|---|
+| Inflectional Particle | -lah, -kah, -pun | Removed first |
+| Possessive Pronoun | -ku, -mu, -nya | Removed second |
+| Derivational Suffix | -i, -kan, -an | Removed third |
+| Derivational Prefix | me-, ber-, ter-, pe-, di-, ke-, se- | Removed last (up to 3 layers) |
+
+The algorithm uses Confix Stripping (CS) and Enhanced Confix Stripping (ECS) for handling complex prefix-suffix combinations, plus a dictionary lookup at each step to validate results.
+
+## Known Limitations
+
+- `memuaskan` stems to `muas` instead of `puas` — both are valid dictionary words and the algorithm picks the first match (Rule13a). This is an inherent ambiguity in the Nazief-Adriani algorithm.
+
+## Contributing
+
+Bug reports and pull requests are welcome on [GitHub](https://github.com/johannesdwicahyo/sastrawi-ruby).
+
+## License
+
+MIT License. Contains base words from [Kateglo](https://kateglo.com) licensed under [CC BY-NC-SA 3.0](https://creativecommons.org/licenses/by-nc-sa/3.0/).
+
+## Credits
+
+- Original PHP implementation: [sastrawi/sastrawi](https://github.com/sastrawi/sastrawi)
+- Ruby port: [Andrias Meisyal](https://github.com/meisyal)
+- Fork maintainer: [Johannes Dwi Cahyo](https://github.com/johannesdwicahyo)

data/Rakefile

@@ -0,0 +1,6 @@
+require 'bundler/gem_tasks'
+require 'rspec/core/rake_task'
+
+RSpec::Core::RakeTask.new(:spec)
+
+task :default => :spec

data/_config.yml

@@ -0,0 +1 @@
+theme: jekyll-theme-cayman

data/bin/sastrawi

@@ -0,0 +1,24 @@
+#!/usr/bin/env ruby
+
+require 'sastrawi'
+
+# usage: $ sastrawi word/sentence
+if ARGV.empty?
+  puts '--------------- sastrawi: ERROR ---------------'
+  puts 'Usage: Please specify a word or sentence to be stemmed.'
+  puts '       sastrawi word/sentence'
+  puts 'Example:'
+  puts '       sastrawi mengundang'
+  puts '       sastrawi Perekonomian Indonesia sedang dalam pertumbuhan yang membanggakan.'
+else
+  stemmer_factory = Sastrawi::Stemmer::StemmerFactory.new
+  stemmer = stemmer_factory.create_stemmer
+
+  words = []
+
+  ARGV.each { |arg| words << arg }
+
+  sentence = words.join(' ')
+
+  puts stemmer.stem(sentence)
+end