asciidoctor-gb 0.1.5

data/.rubocop.yml

@@ -0,0 +1,15 @@
+# This project follows the Ribose OSS style guide.
+# https://github.com/riboseinc/oss-guides
+# All project-specific additions and overrides should be specified in this file.
+
+inherit_from:
+  # Thoughtbot's style guide from: https://github.com/thoughtbot/guides
+  - ".rubocop.tb.yml"
+  # Overrides from Ribose
+  - ".rubocop.ribose.yml"
+AllCops:
+  DisplayCopNames: false
+  StyleGuideCopsOnly: false
+  TargetRubyVersion: 2.4
+Rails:
+  Enabled: true

data/CODE_OF_CONDUCT.md

@@ -0,0 +1,74 @@
+# Contributor Covenant Code of Conduct
+
+## Our Pledge
+
+In the interest of fostering an open and welcoming environment, we as
+contributors and maintainers pledge to making participation in our project and
+our community a harassment-free experience for everyone, regardless of age, body
+size, disability, ethnicity, gender identity and expression, level of experience,
+nationality, personal appearance, race, religion, or sexual identity and
+orientation.
+
+## Our Standards
+
+Examples of behavior that contributes to creating a positive environment
+include:
+
+* Using welcoming and inclusive language
+* Being respectful of differing viewpoints and experiences
+* Gracefully accepting constructive criticism
+* Focusing on what is best for the community
+* Showing empathy towards other community members
+
+Examples of unacceptable behavior by participants include:
+
+* The use of sexualized language or imagery and unwelcome sexual attention or
+advances
+* Trolling, insulting/derogatory comments, and personal or political attacks
+* Public or private harassment
+* Publishing others' private information, such as a physical or electronic
+  address, without explicit permission
+* Other conduct which could reasonably be considered inappropriate in a
+  professional setting
+
+## Our Responsibilities
+
+Project maintainers are responsible for clarifying the standards of acceptable
+behavior and are expected to take appropriate and fair corrective action in
+response to any instances of unacceptable behavior.
+
+Project maintainers have the right and responsibility to remove, edit, or
+reject comments, commits, code, wiki edits, issues, and other contributions
+that are not aligned to this Code of Conduct, or to ban temporarily or
+permanently any contributor for other behaviors that they deem inappropriate,
+threatening, offensive, or harmful.
+
+## Scope
+
+This Code of Conduct applies both within project spaces and in public spaces
+when an individual is representing the project or its community. Examples of
+representing a project or community include using an official project e-mail
+address, posting via an official social media account, or acting as an appointed
+representative at an online or offline event. Representation of a project may be
+further defined and clarified by project maintainers.
+
+## Enforcement
+
+Instances of abusive, harassing, or otherwise unacceptable behavior may be
+reported by contacting the project team at ronald.tse@ribose.com. All
+complaints will be reviewed and investigated and will result in a response that
+is deemed necessary and appropriate to the circumstances. The project team is
+obligated to maintain confidentiality with regard to the reporter of an incident.
+Further details of specific enforcement policies may be posted separately.
+
+Project maintainers who do not follow or enforce the Code of Conduct in good
+faith may face temporary or permanent repercussions as determined by other
+members of the project's leadership.
+
+## Attribution
+
+This Code of Conduct is adapted from the [Contributor Covenant][homepage], version 1.4,
+available at [http://contributor-covenant.org/version/1/4][version]
+
+[homepage]: http://contributor-covenant.org
+[version]: http://contributor-covenant.org/version/1/4/

data/Gemfile

@@ -0,0 +1,11 @@
+source "https://rubygems.org"
+
+# Specify your gem's dependencies in ribose.gemspec
+gem "isodoc",
+      git: "https://github.com/riboseinc/isodoc.git"
+gem "asciidoctor-iso",
+      git: "https://github.com/riboseinc/asciidoctor-iso.git"
+git_source(:github) {|repo_name| "https://github.com/#{repo_name}" }
+
+# Specify your gem's dependencies in asciidoctor-csd.gemspec
+gemspec

data/README.adoc

@@ -0,0 +1,77 @@
+= asciidoctor-gb
+
+image:https://img.shields.io/gem/v/asciidoctor-gb.svg["Gem Version", link="https://rubygems.org/gems/asciidoctor-gb"]
+image:https://img.shields.io/travis/riboseinc/asciidoctor-gb/master.svg["Build Status", link="https://travis-ci.org/riboseinc/asciidoctor-gb"]
+image:https://codeclimate.com/github/riboseinc/asciidoctor-gb/badges/gpa.svg["Code Climate", link="https://codeclimate.com/github/riboseinc/asciidoctor-gb"]
+
+Gem for generating https://en.wikipedia.org/wiki/Guobiao_standards[Guibiao standards]
+(Chinese national standards), using Asciidoc. This gem inherits from 
+https://github.com/riboseinc/asciidoctor-iso, a gem used to generate ISO standards
+using Asciidoc. The two standards formats are closely aligned. Refer to the ISO gem
+for guidance, including https://github.com/riboseinc/asciidoctor-iso/wiki/Guidance-for-authoring
+
+The Gem can also be used to generate Chinese local or sector standards, which have the 
+same format; the gem formats the title page to have the correct metadata displayed.
+
+== Differences from asciidoctor-iso
+
+=== Document Attributes
+
+In the following, "GB standard" should be read to refer to any Chinese national, sector or local standard. Asterisked document attributes are mandatory.
+
+`:title-intro-zh:`, `:title-main-zh:`*, `:title-part-zh:`:: These are the title introduction, main title, and part title in Chinese. (They replace their French counterparts in asciidoctor-iso.)
+`:title-intro-en:`, `:title-main-en:`*, `:title-part-en:`:: These are the title introduction, main title, and part title in English. (They form the document subtitle, instead of the document title as in asciidoctor-iso.)
+`:technical-committee-type:`:: The type of the technical committee (`technical` or `provisional`).
+`:iso-standard`: A corresponding ISO standard that the GB standard relates to. Format is full document code, then optionally comma followed by document title; e.g. `ISO/IEC 27001:2013, Information security management systems`
+`:equivalence:`:: The relation of the GB standard to the corresponding ISO standard (`equivalent`, `identical`, `nonequivalent`). Defaults to `equivalent`.
+`:obsoletes`:: A corresponding GB standard that this GB standard obsoletes. Format is full document code, then optionally comma followed by document title; e.g. `GB/T 22080-2008`
+`:obsoletes-parts:`: A list of bibliographic localities in the corresponding GB standard that this GB standard obsoletes. These are formatted the same way as the localities in citations; e.g. `clause 7-9, clause 11`
+`:scope:`:: The scope of the GB standard (`national`, `sector`, `professional`, `local`, `enterprise`). Defaults to `national`.
+`:mandate:`:: The mandate of the GB standard (`mandatory`, `recommended`, `guidelines`). Defaults to `mandatory`.
+`:prefix:*`:: The prefix classifying the GB standard. (Refer to https://github.com/riboseinc/gbdoc/blob/master/models/gb-standard-national-prefix.adoc, https://github.com/riboseinc/gbdoc/blob/master/models/gb-standard-sector-prefix.adoc, https://github.com/riboseinc/gbdoc/blob/master/models/gb-standard-local-prefix.adoc.)
+`:published-date:`* :: The date on which the GB standard was published.
+`:activated-date:`* :: The date on which the GB standard was activated.
+`:library-ics:`* :: The international categorisation number for the GB standard
+`:library-l:`* :: The L-identifier (library) for the GB standard
+
+=== Language macros
+
+In Terms and Definitions, preferred terms, alternate terms and deprecated
+terms are expected to be given in both Chinese and English. By default,
+the gem does this by detecting space-delimited runs of Han or Latin script
+text:
+
+[source,asciidoc]
+--
+alt:[rough rice 糙米]
+--
+
+[source,xml]
+--
+<admitted language="zh">糙米</admitted> <admitted language="en">rough rice</admitted>
+--
+
+However if there is script mixing in a term -- if the Chinese term contains
+a Latin script acronym or a mathematical expression, for example -- the
+Chinese term will not be detected correctly. To address this, the formatting macros
++`[zh]#...#`+ and +`[en]#...#`+ are used. If they are present, then the content
+of those macros is treated as the Chinese and English equivalents of the
+parent node instead:
+
+[source,asciidoc]
+--
+=== [en]#XYZ paddy# [zh]#水稻XY#]
+alt:[[en]#rough rice# [zh]#糙米#]
+--
+
+[source,xml]
+--
+<preferred language="en">XYZ paddy</preferred> <preferred language="zh">水稻XYZ</preferred>
+<admitted language="zh">糙米</admitted> <admitted language="en">rough rice</admitted>
+--
+
+Unfortunately no further markup is permitted within the +`[zh]#...#`+ and +`[en]#...#`+ 
+macros by Asciidoctor, and Asciidoctor does not correctly nest inline macros within other
+inline macros (so +`alt:[en:[_xyz_] zh:[xyz]`+  would not give correct behaviour either.)
+
+The gem also supports +`[zh-Hant]#...#`+ and +`[zh-Hans]#...#`+ to differentiate traditional and simplified script in ISOXML; `zh-Hant` is provisionally supported through changing font in the output.

data/Rakefile

@@ -0,0 +1,6 @@
+require "bundler/gem_tasks"
+require "rspec/core/rake_task"
+
+RSpec::Core::RakeTask.new(:spec)
+
+task :default => :spec

data/asciidoctor-gb.gemspec

@@ -0,0 +1,52 @@
+lib = File.expand_path("../lib", __FILE__)
+$LOAD_PATH.unshift(lib) unless $LOAD_PATH.include?(lib)
+require "asciidoctor/gb/version"
+
+Gem::Specification.new do |spec|
+  spec.name          = "asciidoctor-gb"
+  spec.version       = Asciidoctor::Gb::VERSION
+  spec.authors       = ["Ribose Inc."]
+  spec.email         = ["open.source@ribose.com"]
+
+  spec.summary       = "asciidoctor-gb lets you write GB standards in AsciiDoc."
+  spec.description   = <<~DESCRIPTION
+    asciidoctor-gb lets you write GB standards (Chinese national standards)
+    in AsciiDoc syntax.
+
+    This gem is in active development.
+  DESCRIPTION
+
+  spec.homepage      = "https://github.com/riboseinc/asciidoctor-gb"
+  spec.license       = "MIT"
+
+  spec.files         = `git ls-files -z`.split("\x0").reject do |f|
+    f.match(%r{^(test|spec|features)/})
+  end
+  spec.bindir        = "exe"
+  spec.executables   = spec.files.grep(%r{^exe/}) { |f| File.basename(f) }
+  spec.require_paths = ["lib"]
+
+  spec.add_dependency "asciidoctor", "~> 1.5.6"
+  spec.add_dependency "asciimath"
+  spec.add_dependency "htmlentities", "~> 4.3.4"
+  spec.add_dependency "image_size"
+  spec.add_dependency "mime-types"
+  spec.add_dependency "nokogiri", "~> 1.8.1"
+  spec.add_dependency "ruby-jing"
+  spec.add_dependency "ruby-xslt"
+  spec.add_dependency "thread_safe"
+  spec.add_dependency "uuidtools"
+  spec.add_dependency "asciidoctor-iso"
+  spec.add_dependency "isodoc"
+
+  spec.add_development_dependency "bundler", "~> 1.15"
+  spec.add_development_dependency "byebug", "~> 9.1"
+  spec.add_development_dependency "equivalent-xml", "~> 0.6"
+  spec.add_development_dependency "guard", "~> 2.14"
+  spec.add_development_dependency "guard-rspec", "~> 4.7"
+  spec.add_development_dependency "rake", "~> 12.0"
+  spec.add_development_dependency "rspec", "~> 3.6"
+  spec.add_development_dependency "rubocop", "~> 0.50"
+  spec.add_development_dependency "simplecov", "~> 0.15"
+  spec.add_development_dependency "timecop", "~> 0.9"
+end

data/bin/console

@@ -0,0 +1,14 @@
+#!/usr/bin/env ruby
+
+require "bundler/setup"
+require "asciidoctor/gb"
+
+# You can add fixtures and/or initialization code here to make experimenting
+# with your gem easier. You can also use a different console, if you like.
+
+# (If you use this, don't forget to add pry to your Gemfile!)
+# require "pry"
+# Pry.start
+
+require "irb"
+IRB.start(__FILE__)

data/bin/setup

@@ -0,0 +1,8 @@
+#!/usr/bin/env bash
+set -euo pipefail
+IFS=$'\n\t'
+set -vx
+
+bundle install
+
+# Do any other automated setup that you need to do here

data/lib/asciidoctor/gb/agencies.rb

@@ -0,0 +1,186 @@
+require "isodoc"
+
+module Asciidoctor
+  module Gb
+    class GbConvert < IsoDoc::Convert
+      SECTOR = {
+        AQ: { industry: "安全生产", admin: "国家安全生产管理局" },
+        BB: { industry: "包装", admin: "国家发改委" },
+        CB: { industry: "船舶", admin: "国防科学工业委员会" },
+        CH: { industry: "测绘", admin: "国家测绘局" },
+        CJ: { industry: "城镇建设", admin: "建设部" },
+        CY: { industry: "新闻出版", admin: "国家新闻出版总署" },
+        DA: { industry: "档案", admin: "国家档案局" },
+        DB: { industry: "地震", admin: "中国地震局" },
+        DL: { industry: "电力", admin: "国家发改委" },
+        DZ: { industry: "地质矿产", admin: "国土资源部" },
+        EJ: { industry: "核工业", admin: "国防科学工业委员会" },
+        FZ: { industry: "纺织", admin: "国家发改委" },
+        GA: { industry: "公共安全", admin: "公安部" },
+        GH: { industry: "供销", admin: "中华全国供销合作总社" },
+        GM: { industry: "密码", admin: "国家密码管理局" },
+        GY: { industry: "广播电影电视", admin: "国家广播电影电视总局" },
+        HB: { industry: "航空", admin: "国防科学工业委员会" },
+        HG: { industry: "化工", admin: "国家发改委" },
+        HJ: { industry: "环境保护", admin: "国家环境保护总局" },
+        HS: { industry: "海关", admin: "海关总署" },
+        HY: { industry: "海洋", admin: "国家海洋局" },
+        JB: { industry: "机械", admin: "国家发改委" },
+        JC: { industry: "建材", admin: "国家发改委" },
+        JG: { industry: "建筑工业", admin: "建设部" },
+        JR: { industry: "金融", admin: "中国人民银行" },
+        JT: { industry: "交通", admin: "交通部" },
+        JY: { industry: "教育", admin: "教育部" },
+        LB: { industry: "旅游", admin: "国家旅游局" },
+        LD: { industry: "劳动和劳动安全", admin: "劳动和社会保障部" },
+        LS: { industry: "粮食", admin: "国家粮食局" },
+        LY: { industry: "林业", admin: "国家林业局" },
+        MH: { industry: "民用航空", admin: "中国民航管理总局" },
+        MT: { industry: "煤炭", admin: "国家发改委" },
+        MZ: { industry: "民政", admin: "民政部" },
+        NY: { industry: "农业", admin: "农业部" },
+        QB: { industry: "轻工", admin: "国家发改委" },
+        QC: { industry: "汽车", admin: "国家发改委" },
+        QJ: { industry: "航天", admin: "国防科学工业委员会" },
+        QX: { industry: "气象", admin: "中国气象局" },
+        SB: { industry: "国内贸易", admin: "商务部" },
+        SC: { industry: "水产", admin: "农业部" },
+        SH: { industry: "石油化工", admin: "国家发改委" },
+        SJ: { industry: "电子", admin: "信息产业部" },
+        SL: { industry: "水利", admin: "水利部" },
+        SN: { industry: "商检", admin: "国家质量监督检验检疫总局" },
+        SY: { industry: "石油天然气", admin: "国家发改委" },
+        TB: { industry: "铁道", admin: "铁道部" },
+        TD: { industry: "土地管理", admin: "国土资源部" },
+        TJ: { industry: "铁道交通", admin: "铁道部标准所" },
+        TY: { industry: "体育", admin: "国家体育总局" },
+        WB: { industry: "物资管理", admin: "国家发改委" },
+        WH: { industry: "文化", admin: "文化部" },
+        WJ: { industry: "兵工民品", admin: "国防科学工业委员会" },
+        WM: { industry: "外经贸", admin: "外经贸部科技司" },
+        WS: { industry: "卫生", admin: "卫生部" },
+        WW: { industry: "文物保护", admin: "国家文物局" },
+        XB: { industry: "稀土", admin: "国家发改委稀土办公室" },
+        YB: { industry: "黑色冶金", admin: "国家发改委" },
+        YC: { industry: "烟草", admin: "国家烟草专卖局" },
+        YD: { industry: "通信", admin: "信息产业部" },
+        YS: { industry: "有色冶金", admin: "国家发改委" },
+        YY: { industry: "医药", admin: "国家食品药品监督管理局" },
+        YZ: { industry: "邮政", admin: "国家邮政局" },
+        ZY: { industry: "中医药", admin: "国家中医药管理局" },
+      }.freeze
+
+      NATIONAL = {
+        GB: { name: "中华人民共和国国家标准",
+              admin: ["中华人民共和国国家质量监督检验检疫总局", "中国国家标准化管理委员会"] },
+      "GB/T": { name: "中华人民共和国国家标准",
+                admin: ["中华人民共和国国家质量监督检验检疫总局", "中国国家标准化管理委员会"] },
+      "GB/Z": { name: "中华人民共和国国家标准化指导性技术文件",
+                admin: ["中华人民共和国国家质量监督检验检疫总局", "中国国家标准化管理委员会"] },
+      GBZ: { name: "中华人民共和国国家职业卫生标准", admin: "中华人民共和国卫生部" },
+      GJB: { name: "中华人民共和国国家军用标准", admin: "中国人民解放军装备总部" },
+      GBn: { name: "中华人民共和国国家内部标准", admin: "" },
+      GHZB: { name: "中华人民共和国国家环境质量标准", admin: "" },                                                                                                                  GWKB: { name: "中华人民共和国国家环境保护标准", admin: "环境保护部" },
+      GWPB: { name: "中华人民共和国国家污染物排放标准", admin: "" },
+      JJF: { name: "中华人民共和国国家计量技术规范", admin: "中华人民共和国国家质量监督检验检疫总局" },
+      JJG: { name: "中华人民共和国国家计量检定规程", admin: "中华人民共和国国家质量监督检验检疫总局" },
+      }.freeze
+
+      LOCAL = {
+        "11": "北京市",
+        "12": "天津市",
+        "13": "河北省",
+        "14": "山西省",
+        "15": "内蒙古自治区",
+        "21": "辽宁省",
+        "22": "吉林省",
+        "23": "黑龙江省",
+        "31": "上海市",
+        "32": "江苏省",
+        "33": "浙江省",
+        "34": "安徽省",
+        "35": "福建省",
+        "36": "江西省",
+        "37": "山东省",
+        "41": "河南省",
+        "42": "湖北省",
+        "43": "湖南省",
+        "44": "广东省",
+        "45": "广西壮族自治区",
+        "46": "海南省",
+        "50": "重庆市",
+        "51": "四川省",
+        "52": "贵州省",
+        "53": "云南省",
+        "54": "西藏自治区",
+        "61": "陕西省",
+        "62": "甘肃省",
+        "63": "青海省",
+        "64": "宁夏回族自治区",
+        "65": "新疆维吾尔自治区",
+        "71": "台湾省",
+        "81": "香港特别行政区",
+        "82": "澳门特别行政区",
+      }.freeze
+
+      def gb_mandate_suffix(prefix, mandate)
+        if prefix == "GB"
+          prefix += "/T" if mandate == "recommended"
+          prefix += "/Z" if mandate == "guide"
+        end
+        prefix
+      end
+
+      def mandate_suffix(prefix, mandate)
+        prefix += "/T" if mandate == "recommended"
+        prefix += "/Z" if mandate == "guide"
+        prefix
+      end
+
+      def standard_class(scope, prefix, mandate)
+        case scope
+        when "national"
+          NATIONAL&.dig(gb_mandate_suffix(prefix, mandate).to_sym,
+                        :name) || "XXXX"
+        when "sector"
+          "中华人民共和国#{SECTOR&.dig(prefix.to_sym,
+          :industry) || 'XXXX'}行业标准"
+        when "local"
+          "#{LOCAL&.dig(prefix.to_sym) || 'XXXX'}地方标准"
+          when "enterprise" then "ENTERPRISE STANDARD" # TODO
+          when "professional" then "PROFESSIONAL STANDARD" # TODO
+          end
+      end
+
+      def standard_agency(scope, prefix, mandate)
+        case scope
+        when "national"
+          NATIONAL&.dig(gb_mandate_suffix(prefix, mandate).to_sym,
+                        :admin) || "XXXX"
+        when "sector"
+          SECTOR&.dig(prefix.to_sym, :admin) || "XXXX"
+        when "local"
+          "#{LOCAL&.dig(prefix.to_sym) || 'XXXX'}质量技术检测局"
+        when "enterprise" then "ENTERPRISE STANDARD" # TODO
+        when "professional" then "PROFESSIONAL STANDARD" # TODO
+        end
+      end
+
+      def gbtype_validate(root)
+        scope = root.at("//gbscope")&.text
+        prefix = root.at("//gbprefix")&.text
+        case scope
+        when "national"
+          NATIONAL.has_key?(prefix.to_sym) ||
+            warn("GB: #{prefix} is not a recognised national prefix")
+        when "sector"
+          SECTOR.has_key?(prefix.to_sym) ||
+            warn("GB: #{prefix} is not a recognised sector prefix")
+        when "local"
+          LOCAL.has_key?(prefix.to_sym) ||
+            warn("GB: #{prefix} is not a recognised local prefix")
+        end
+      end
+    end
+  end
+end

data/lib/asciidoctor/gb/converter.rb

@@ -0,0 +1,179 @@
+require "asciidoctor"
+require "asciidoctor/gb/version"
+require "asciidoctor/gb/gbconvert"
+require "asciidoctor/iso/converter"
+require_relative "./section_input.rb"
+require_relative "./front.rb"
+require "pp"
+
+module Asciidoctor
+  module Gb
+    GB_NAMESPACE = "http://riboseinc.com/gbstandard"
+
+    # A {Converter} implementation that generates GB output, and a document
+    # schema encapsulation of the document for validation
+    class Converter < ISO::Converter
+
+      register_for "gb"
+
+      def makexml(node)
+        result = ["<?xml version='1.0' encoding='UTF-8'?>\n<gb-standard>"]
+        @draft = node.attributes.has_key?("draft")
+        result << noko { |ixml| front node, ixml }
+        result << noko { |ixml| middle node, ixml }
+        result << "</gb-standard>"
+        result = textcleanup(result.flatten * "\n")
+        ret1 = cleanup(Nokogiri::XML(result))
+        validate(ret1)
+        ret1.root.add_namespace(nil, GB_NAMESPACE)
+        ret1
+      end
+
+      def validate(doc)
+        content_validate(doc)
+        schema_validate(formattedstr_strip(doc.dup),
+                        File.join(File.dirname(__FILE__), "gbstandard.rng"))
+      end
+
+      def content_validate(doc)
+        super
+        bilingual_terms_validate(doc.root)
+        doc_converter(nil).gbtype_validate(doc.root)
+      end
+
+      def check_bilingual(t, element)
+        zh = t.at(".//#{element}[@language = 'zh']")
+        en = t.at(".//#{element}[@language = 'en']")
+        (en.nil? || en.text.empty?) && !(zh.nil? || zh.text.empty?) &&
+          warn("GB: #{element} term #{zh.text} has no English counterpart")
+        !(en.nil? || en.text.empty?) && (zh.nil? || zh.text.empty?) &&
+          warn("GB: #{element} term #{en.text} has no Chinese counterpart")
+      end
+
+      def bilingual_terms_validate(root)
+        root.xpath("//term").each do |t|
+          check_bilingual(t, "preferred")
+          check_bilingual(t, "admitted")
+          check_bilingual(t, "deprecates")
+        end
+      end
+
+      def html_doc_path(file)
+        File.join(File.dirname(__FILE__), File.join("html", file))
+      end
+
+      def doc_converter(node)
+        GbConvert.new(
+          htmlstylesheet: html_doc_path("htmlstyle.css"),
+          wordstylesheet: html_doc_path("wordstyle.css"),
+          standardstylesheet: html_doc_path("gb.css"),
+          header: html_doc_path("header.html"),
+          htmlcoverpage: html_doc_path("html_gb_titlepage.html"),
+          wordcoverpage: html_doc_path("word_gb_titlepage.html"),
+          htmlintropage: html_doc_path("html_gb_intro.html"),
+          wordintropage: html_doc_path("word_gb_intro.html"),
+          i18nyaml: node&.attr("i18nyaml"),
+        )
+      end
+
+      def termdef_cleanup(xmldoc)
+        super
+        termdef_localisedstr(xmldoc)
+      end
+
+      ROMAN_TEXT = /\s*[a-z\u00c0-\u00d6\u00d8-\u00f0\u0100-\u0240]/i
+      HAN_TEXT = /\s*[\u4e00-\u9fff]+/
+
+      def termdef_localisedstr(xmldoc)
+        xmldoc.xpath("//admitted | //deprecates | //preferred").each do |zh|
+          if zh.at("./string")
+            extract_localisedstrings(zh)
+          else
+            duplicate_localisedstrings(zh)
+          end
+        end
+      end
+
+      # element consists solely of localised strings, with no attributes
+      def extract_localisedstrings(elem)
+        elem.xpath("./string").each do |s|
+          s.name = elem.name
+        end
+        elem.replace(elem.children)
+      end
+
+      def duplicate_localisedstrings(zh)
+        en = zh.dup.remove
+        zh.after(en).after(" ")
+        zh["language"] = "zh"
+        en["language"] = "en"
+        en.traverse do |c|
+          c.text? && c.content = c.text.gsub(HAN_TEXT, "").gsub(/^\s*/, "")
+        end
+        zh.traverse do |c| 
+          c.text? && c.content = c.text.gsub(ROMAN_TEXT, "").gsub(/^\s*/, "")
+        end
+      end
+
+      def inline_quoted(node)
+        noko do |xml|
+          case node.type
+          when :emphasis then xml.em node.text
+          when :strong then xml.strong node.text
+          when :monospaced then xml.tt node.text
+          when :double then xml << "\"#{node.text}\""
+          when :single then xml << "'#{node.text}'"
+          when :superscript then xml.sup node.text
+          when :subscript then xml.sub node.text
+          when :asciimath then xml.stem node.text, **{ type: "AsciiMath" }
+          else
+            case node.role
+            when "alt" then xml.admitted { |a| a << node.text }
+            when "deprecated" then xml.deprecates { |a| a << node.text }
+            when "domain" then xml.domain { |a| a << node.text }
+            when "strike" then xml.strike node.text
+            when "smallcap" then xml.smallcap node.text
+            when "en" then xml.string node.text, **{ language: "en" }
+            when "zh" then xml.string node.text, **{ language: "zh" }
+            when "zh-Hans"
+              xml.string node.text, **{ language: "zh", script: "Hans" }
+            when "zh-Hant"
+              xml.string node.text, **{ language: "zh", script: "Hant" }
+            else
+              xml << node.text
+            end
+          end
+        end.join
+      end
+
+      def termdef_boilerplate_cleanup(xmldoc)
+        nil
+      end
+
+      GBCODE = "((AQ|BB|CB|CH|CJ|CY|DA|DB|DL|DZ|EJ|FZ|GA|GH|GM|GY|HB|HG|"\
+        "HJ|HS|HY|JB|JC|JG|JR|JT|JY|LB|LD|LS|LY|MH|MT|MZ|NY|QB|QC|QJ|"\
+        "QZ|SB|SC|SH|SJ|SN|SY|TB|TD|TJ|TY|WB|WH|WJ|WM|WS|WW|XB|YB|YC|"\
+        "YD|YS|YY|YZ|ZY|GB|GBZ|GJB|GBn|GHZB|GWKB|GWPB|JJF|JJG)(/Z|/T)?)"
+
+      ISO_REF = %r{^<ref\sid="(?<anchor>[^"]+)">
+      \[(?<code>(ISO|IEC|#{GBCODE})[^0-9]*\s[0-9-]+)(:(?<year>[0-9]+))?\]</ref>,?\s
+      (?<text>.*)$}xm
+
+      ISO_REF_NO_YEAR = %r{^<ref\sid="(?<anchor>[^"]+)">
+      \[(?<code>(ISO|IEC|#{GBCODE})[^0-9]*\s[0-9-]+):--\]</ref>,?\s?
+      <fn[^>]*>\s*<p>(?<fn>[^\]]+)</p>\s*</fn>,?\s?(?<text>.*)$}xm
+
+      # TODO: all parts in ZH
+      ISO_REF_ALL_PARTS = %r{^<ref\sid="(?<anchor>[^"]+)">
+      \[(?<code>(ISO|IEC|#{GBCODE})[^0-9]*\s[0-9]+)\s\(all\sparts\)\]</ref>(<p>)?,?\s?
+      (?<text>.*)(</p>)?$}xm
+
+      def reference1_matches(item)
+        matched = ISO_REF.match item
+        matched2 = ISO_REF_NO_YEAR.match item
+        matched3 = ISO_REF_ALL_PARTS.match item
+        [matched, matched2, matched3]
+      end
+    end
+  end
+end