fyodor 0.2.8 → 0.3.1

checksums.yaml

@@ -1,7 +1,7 @@
 ---
 SHA256:
-  metadata.gz: a9df8b69482e73f4b9111105c9c9e02b5d36ada90536b393d322000e99e9bc7e
-  data.tar.gz: 0070bfc112a33cea32020dfda7e7e033292f4083bc60e3487b854d66f857e206
+  metadata.gz: eeecee4acc8d86b2d4e21dc8071d5c1fa29ef5c7a7873f1c8c9cf0a693f2a9fb
+  data.tar.gz: ebd27239fbb6da6fb2fc601ed4138212ded181f135c42c99a4aff45046dcc802
 SHA512:
-  metadata.gz: d35a3946e8c78f57c1a742a9e6ab35c5fa0948cccc88e479147b83f91956844b31afe7475c2a7a53a5856a90eab26c04a8c5a197f085f88f19bde774aa934407
-  data.tar.gz: 4cbba9cd18529bc8e3a5d17a6236fa3ad30965655aca6387df759a11926bd578f373920bfb046751be757028989e39d330b19ab61d3909735dbf969a1693b633
+  metadata.gz: 41bd104a94086a9d42d99b85b99b17105013b38f2fa15f8623af86e64f7b648503748770edbec5d22681700b48f56b577c73c555a2b845f59f0d4b5d0b4590db
+  data.tar.gz: 06575a116669bbd2f1758ef772a5fbb091bfb22381f7cc44315c2f9973a7384174434c8a82443f1dc0ddef934a5f5fc2f49f53cb2caf5f9033897c0449843695

data/README.md

@@ -8,7 +8,7 @@ This application parses `My Clippings.txt` from your Kindle and generates a mark
 
 [For samples of the output, click here.](docs/output_demo)
 
-To read more about the motivation and what problem it tries to solve, [check this blog post](https://rafaelc.org/tech/p/export-all-your-kindle-highlights-and-notes/).
+To read more about the motivation and what problem it tries to solve, [check this blog post](https://rafaelc.org/posts/export-all-your-kindle-highlights-and-notes/).
 
 ## Features
 
@@ -18,10 +18,18 @@ To read more about the motivation and what problem it tries to solve, [check thi
 - Easily configurable for your language, allowing you to get all features and beautiful output.
 - This software goes some length to be locale agnostic: basic parsing should work without configuration for any language. It should also work even if your clippings file has multiple locales.
 - Bookmarks are printed together and notes are formatted differently, for better visualization.
-- Output in a format that is clean and easy to edit/fiddle around: markdown.
+- By default, output in a format that is clean and easy to edit/fiddle around: markdown.
+- Entirely customizable output, through templates, in the format you prefer.
 
 This program is based on the clippings file generated by Kindle 2019, but should work with other models.
 
+## Limitations
+
+We are limited by the data Kindle makes available through `My Clippings.txt`. This means:
+
+- We don't have chapter information.
+- We can’t guess all entries that were deleted.
+
 ## Installation
 
 Install Ruby and run:
@@ -46,10 +54,10 @@ Fyodor has an optional configuration file, which is used for the following.
 
 If your Kindle is not in English, you should tell Fyodor how some things are called by your `My Clippings.txt` (e.g. highlights, pages, etc). _Fyodor should still work without configuration, but you won't take advantage of many features, resulting in a dirtier output._
 
-1. Download the sample config to `~/.config/fyodor.toml` or `$XDG_CONFIG_HOME/fyodor.toml`:
+1. Download the sample config to `~/.config/fyodor/fyodor.toml` or `$XDG_CONFIG_HOME/fyodor/fyodor.toml`:
 
-```
-$ wget https://raw.githubusercontent.com/rccavalcanti/fyodor/master/docs/fyodor.toml.sample -O ~/.config/fyodor.toml
+```sh
+$ curl https://raw.githubusercontent.com/rc2dev/fyodor/master/docs/fyodor.toml.sample --create-dirs -o ~/.config/fyodor/fyodor.toml
 ```
 
 2. Open both the configuration and your `My Clippings.txt` in your preferred editor. Change the values in the `[parser]` section to mirror what you get in `My Clippings.txt`.
@@ -71,6 +79,23 @@ time = "Adicionado:"
 
 In the configuration file you can also set whether to print the time of each entry. On `[output]`, set `time` to `true` or `false`.
 
+### Templating
+
+You may change the structure of the files output by Fyodor by providing your own template.
+
+Simply place a ERB template at `~/.config/fyodor/template.erb` or `$XDG_CONFIG_HOME/fyodor/template.erb` and Fyodor will use it automatically.
+
+The default template can be found [here](share/template.erb). You can use any method or attribute available [on this class](lib/fyodor/output_generator.rb).
+
+### Extension
+
+If you want to change the extension of the output files - typically after changing the template -, set `extension` on `fyodor.toml`. For example, to change it to HTML:
+
+```toml
+[output]
+extension = "html"
+```
+
 ## Usage
 
 ```
@@ -98,4 +123,4 @@ If you like Fyodor, you can show your support here:
 
 Licensed under [GPLv3](LICENSE)
 
-Copyright (C) 2019-2020 [Rafael Cavalcanti](https://rafaelc.org/)
+Copyright (C) 2019-2022 [Rafael Cavalcanti](https://rafaelc.org/dev)

data/lib/fyodor/book.rb

@@ -26,8 +26,8 @@ module Fyodor
     end
 
     def basename
-      base = @author.to_s.empty? ? @title : "#{@author} - #{@title}"
-      base.strip.gsub(/[?*:|\/"<>]/,"_")
+      base = @author.to_s.empty? ? "Author N/A - #{@title}" : "#{@author} - #{@title}"
+      base.strip
     end
 
     def count_types

data/lib/fyodor/config_getter.rb

@@ -4,7 +4,11 @@ require "toml"
 
 module Fyodor
   class ConfigGetter
-    DEFAULT = {
+    CONFIG_NAME = "fyodor.toml"
+    TEMPLATE_NAME = "template.erb"
+    DEFAULT_TEMPLATE_PATH = File.dirname(__FILE__) + "/../../share/template.erb"
+
+    DEFAULTS = {
       "parser" => {
         "highlight" => "Your Highlight",
         "note" => "Your Note",
@@ -15,7 +19,8 @@ module Fyodor
         "time" => "Added on"
       },
       "output" => {
-        "time" => false
+        "time" => false,
+        "extension" => "md"
       }
     }
 
@@ -28,30 +33,52 @@ module Fyodor
 
     def get_config
       Hash.include CoreExtensions::Hash::Merging
-      print_path
 
-      user_config = path.nil? ? {} : TOML.load_file(path)
-      DEFAULT.deep_merge(user_config)
+      @config_path = get_path(CONFIG_NAME)
+      print_config_path
+      user_config = @config_path.nil? ? {} : TOML.load_file(@config_path)
+
+      config = DEFAULTS.deep_merge(user_config)
+      config["output"]["template"] = template
+
+      config
     end
 
-    def path
-      @path ||= paths.find { |path| path.exist? }
+    def get_path(name)
+      possible_dirs.each do |d|
+        path = d + name
+        return path if path.exist?
+      end
+
+      return nil
     end
 
-    def paths
-      return @paths unless @paths.nil?
+    def possible_dirs
+      return @possible_dirs unless @possible_dirs.nil?
 
-      @paths = []
-      @paths << Pathname.new(ENV["XDG_CONFIG_HOME"]) + "fyodor.toml" unless ENV["XDG_CONFIG_HOME"].nil?
-      @paths << Pathname.new("~/.config/fyodor.toml").expand_path
+      @possible_dirs = []
+      @possible_dirs << Pathname.new(ENV["XDG_CONFIG_HOME"]) + "fyodor" unless ENV["XDG_CONFIG_HOME"].nil?
+      @possible_dirs << Pathname.new("~/.config/fyodor").expand_path
     end
 
-    def print_path
-      if path.nil?
-        puts "No config found: using defaults.\n\n"
+    def print_config_path
+      if @config_path.nil?
+        puts "No config found: using defaults.\n"
       else
-        puts "Using config at #{path}\n\n"
+        puts "Using config at #{@config_path}.\n"
       end
     end
+
+    def template
+      template_path = get_path(TEMPLATE_NAME) || DEFAULT_TEMPLATE_PATH
+
+      if template_path == DEFAULT_TEMPLATE_PATH
+        puts "No template found: using default.\n\n"
+      else
+        puts "Using template at #{template_path}.\n\n"
+      end
+
+      File.read(template_path)
+    end
   end
 end

data/lib/fyodor/output_generator.rb

@@ -0,0 +1,72 @@
+require "fyodor/strings"
+require "erb"
+
+module Fyodor
+  class OutputGenerator
+    include Strings
+
+    def initialize(book, config)
+      @book = book
+      @config = config
+    end
+
+    def content
+      ERB.new(@config["template"], nil, '-').result(binding)
+    end
+
+
+    private
+    
+    def regular_entries
+      @book.reject { |entry| entry.type == Entry::TYPE[:bookmark] }
+    end
+
+    def bookmarks
+      @book.select { |entry| entry.type == Entry::TYPE[:bookmark] }
+    end
+
+    def render_entries(entries)
+      output = ""
+      entries.each do |entry|
+        output += "- #{item_text(entry)}\n\n"
+        output += "  #{item_desc(entry)}\n\n" unless item_desc(entry).empty?
+      end
+      output.strip
+    end
+
+    def item_text(entry)
+      case entry.type
+      when Entry::TYPE[:bookmark]
+        "#{page(entry)}"
+      when Entry::TYPE[:note]
+        "_Note:_ #{entry.text.strip}"
+      else
+        "#{entry.text.strip}"
+      end
+    end
+
+    def item_desc(entry)
+      return entry.desc unless entry.desc_parsed?
+
+      case entry.type
+      when Entry::TYPE[:bookmark]
+        time(entry)
+      else
+        (type(entry) + " @ " + page(entry) + " " + time(entry)).strip
+      end
+    end
+
+    def page(entry)
+      ((entry.page.nil? ? "" : "page #{entry.page}, ") +
+        (entry.loc.nil? ? "" : "loc. #{entry.loc}")).delete_suffix(", ")
+    end
+
+    def time(entry)
+      @config["time"] ? "[#{entry.time}]" : ""
+    end
+
+    def type(entry)
+      SINGULAR[entry.type]
+    end
+  end
+end

data/lib/fyodor/output_writer.rb

@@ -1,4 +1,4 @@
-require "fyodor/md_generator"
+require "fyodor/output_generator"
 
 module Fyodor
   class OutputWriter
@@ -12,7 +12,7 @@ module Fyodor
     def write_all
       puts "\nWriting to #{@output_dir}..." unless @library.empty?
       @library.each do |book|
-        content = MdGenerator.new(book, @config).content
+        content = OutputGenerator.new(book, @config).content
         File.open(path(book), "w") { |f| f.puts(content) }
       end
     end
@@ -21,11 +21,13 @@ module Fyodor
     private
 
     def path(book)
-      path = @output_dir + "#{book.basename}.md"
+      basename = book.basename.gsub(/[?*:|\/"<>]/,"_")
+      extension = @config["extension"]
+      path = @output_dir + "#{basename}.#{extension}"
 
       i = 2
       while(path.exist?)
-        path = @output_dir + "#{book.basename} - #{i}.md"
+        path = @output_dir + "${basename - #{i}.#{extension}"
         i += 1
       end
 

data/lib/fyodor/version.rb

@@ -1,3 +1,3 @@
 module Fyodor
-  VERSION = "0.2.8".freeze
+  VERSION = "0.3.1".freeze
 end

metadata

@@ -1,14 +1,14 @@
 --- !ruby/object:Gem::Specification
 name: fyodor
 version: !ruby/object:Gem::Version
-  version: 0.2.8
+  version: 0.3.1
 platform: ruby
 authors:
 - Rafael Cavalcanti
 autorequire: 
 bindir: bin
 cert_chain: []
-date: 2021-06-22 00:00:00.000000000 Z
+date: 2022-02-03 00:00:00.000000000 Z
 dependencies:
 - !ruby/object:Gem::Dependency
   name: toml
@@ -39,7 +39,7 @@ dependencies:
       - !ruby/object:Gem::Version
         version: '3.0'
 description: Parse Kindle clippings into markdown files
-email: code@rafaelc.org
+email: dev@rafaelc.org
 executables:
 - fyodor
 extensions: []
@@ -56,16 +56,16 @@ files:
 - lib/fyodor/entry.rb
 - lib/fyodor/entry_parser.rb
 - lib/fyodor/library.rb
-- lib/fyodor/md_generator.rb
+- lib/fyodor/output_generator.rb
 - lib/fyodor/output_writer.rb
 - lib/fyodor/stats_printer.rb
 - lib/fyodor/strings.rb
 - lib/fyodor/version.rb
-homepage: https://github.com/rccavalcanti/fyodor
+homepage: https://rafaelc.org/fyodor
 licenses:
 - GPL-3.0-only
 metadata:
-  source_code_uri: https://github.com/rccavalcanti/fyodor
+  source_code_uri: https://rafaelc.org/fyodor
 post_install_message: 
 rdoc_options: []
 require_paths:

data/lib/fyodor/md_generator.rb

@@ -1,96 +0,0 @@
-require "fyodor/strings"
-
-module Fyodor
-  class MdGenerator
-    include Strings
-
-    def initialize(book, config)
-      @book = book
-      @config = config
-    end
-
-    def content
-      header + body + bookmarks
-    end
-
-
-    private
-
-    def header
-      return <<~EOF
-      # #{@book.title}
-      #{"by #{@book.author}" unless @book.author.to_s.empty?}
-
-      #{header_counts}
-
-      EOF
-    end
-
-    def header_counts
-      output = ""
-      @book.count_types.each do |type, n|
-        output += "#{n} #{pluralize(type, n)}, " if n > 0
-      end
-      output.delete_suffix(", ")
-    end
-
-    def pluralize(type, n)
-      n == 1 ? SINGULAR[type] : PLURAL[type]
-    end
-
-    def body
-      entries = @book.reject { |entry| entry.type == Entry::TYPE[:bookmark] }
-      entries.size == 0 ? "" : entries_render(entries)
-    end
-
-    def bookmarks
-      bookmarks = @book.select { |entry| entry.type == Entry::TYPE[:bookmark] }
-      bookmarks.size == 0 ? "" : entries_render(bookmarks, "Bookmarks")
-    end
-
-    def entries_render(entries, title=nil)
-      output = "---\n\n"
-      output += "## #{title}\n\n" unless title.nil?
-      entries.each do |entry|
-        output += "#{item_text(entry)}\n\n"
-        output += "<p style=\"text-align: right;\"><sup>#{item_desc(entry)}</sup></p>\n\n"
-      end
-      output
-    end
-
-    def item_text(entry)
-      case entry.type
-      when Entry::TYPE[:bookmark]
-        "* #{page(entry)}"
-      when Entry::TYPE[:note]
-        "* _Note:_\n#{entry.text.strip}"
-      else
-        "* #{entry.text.strip}"
-      end
-    end
-
-    def item_desc(entry)
-      return entry.desc unless entry.desc_parsed?
-
-      case entry.type
-      when Entry::TYPE[:bookmark]
-        time(entry)
-      else
-        (type(entry) + " @ " + page(entry) + " " + time(entry)).strip
-      end
-    end
-
-    def page(entry)
-      ((entry.page.nil? ? "" : "page #{entry.page}, ") +
-        (entry.loc.nil? ? "" : "loc. #{entry.loc}")).delete_suffix(", ")
-    end
-
-    def time(entry)
-      @config["time"] ? "[#{entry.time}]" : ""
-    end
-
-    def type(entry)
-      SINGULAR[entry.type]
-    end
-  end
-end