elm-pages 2.1.6 → 2.1.10

package/src/DataSource/Glob.elm

@@ -0,0 +1,1050 @@
+module DataSource.Glob exposing
+    ( Glob
+    , capture, match
+    , captureFilePath
+    , wildcard, recursiveWildcard
+    , int, digits
+    , expectUniqueMatch, expectUniqueMatchFromList
+    , literal
+    , map, succeed, toDataSource
+    , oneOf
+    , zeroOrMore, atLeastOne
+    )
+
+{-|
+
+@docs Glob
+
+This module helps you get a List of matching file paths from your local file system as a [`DataSource`](DataSource#DataSource). See the [`DataSource`](DataSource) module documentation
+for ways you can combine and map `DataSource`s.
+
+A common example would be to find all the markdown files of your blog posts. If you have all your blog posts in `content/blog/*.md`
+, then you could use that glob pattern in most shells to refer to each of those files.
+
+With the `DataSource.Glob` API, you could get all of those files like so:
+
+    import DataSource exposing (DataSource)
+
+    blogPostsGlob : DataSource (List String)
+    blogPostsGlob =
+        Glob.succeed (\slug -> slug)
+            |> Glob.match (Glob.literal "content/blog/")
+            |> Glob.capture Glob.wildcard
+            |> Glob.match (Glob.literal ".md")
+            |> Glob.toDataSource
+
+Let's say you have these files locally:
+
+```shell
+- elm.json
+- src/
+- content/
+  - blog/
+    - first-post.md
+    - second-post.md
+```
+
+We would end up with a `DataSource` like this:
+
+    DataSource.succeed [ "first-post", "second-post" ]
+
+Of course, if you add or remove matching files, the DataSource will get those new files (unlike `DataSource.succeed`). That's why we have Glob!
+
+You can even see the `elm-pages dev` server will automatically flow through any added/removed matching files with its hot module reloading.
+
+But why did we get `"first-post"` instead of a full file path, like `"content/blog/first-post.md"`? That's the difference between
+`capture` and `match`.
+
+
+## Capture and Match
+
+There are two functions for building up a Glob pattern: `capture` and `match`.
+
+`capture` and `match` both build up a `Glob` pattern that will match 0 or more files on your local file system.
+There will be one argument for every `capture` in your pipeline, whereas `match` does not apply any arguments.
+
+    import DataSource exposing (DataSource)
+    import DataSource.Glob as Glob
+
+    blogPostsGlob : DataSource (List String)
+    blogPostsGlob =
+        Glob.succeed (\slug -> slug)
+            -- no argument from this, but we will only
+            -- match files that begin with `content/blog/`
+            |> Glob.match (Glob.literal "content/blog/")
+            -- we get the value of the `wildcard`
+            -- as the slug argument
+            |> Glob.capture Glob.wildcard
+            -- no argument from this, but we will only
+            -- match files that end with `.md`
+            |> Glob.match (Glob.literal ".md")
+            |> Glob.toDataSource
+
+So to understand _which_ files will match, you can ignore whether you are using `capture` or `match` and just read
+the patterns you're using in order to understand what will match. To understand what Elm data type you will get
+_for each matching file_, you need to see which parts are being captured and how each of those captured values are being
+used in the function you use in `Glob.succeed`.
+
+@docs capture, match
+
+`capture` is a lot like building up a JSON decoder with a pipeline.
+
+Let's try our blogPostsGlob from before, but change every `match` to `capture`.
+
+    import DataSource exposing (DataSource)
+
+    blogPostsGlob :
+        DataSource
+            (List
+                { filePath : String
+                , slug : String
+                }
+            )
+    blogPostsGlob =
+        Glob.succeed
+            (\capture1 capture2 capture3 ->
+                { filePath = capture1 ++ capture2 ++ capture3
+                , slug = capture2
+                }
+            )
+            |> Glob.capture (Glob.literal "content/blog/")
+            |> Glob.capture Glob.wildcard
+            |> Glob.capture (Glob.literal ".md")
+            |> Glob.toDataSource
+
+Notice that we now need 3 arguments at the start of our pipeline instead of 1. That's because
+we apply 1 more argument every time we do a `Glob.capture`, much like `Json.Decode.Pipeline.required`, or other pipeline APIs.
+
+Now we actually have the full file path of our files. But having that slug (like `first-post`) is also very helpful sometimes, so
+we kept that in our record as well. So we'll now have the equivalent of this `DataSource` with the current `.md` files in our `blog` folder:
+
+    DataSource.succeed
+        [ { filePath = "content/blog/first-post.md"
+          , slug = "first-post"
+          }
+        , { filePath = "content/blog/second-post.md"
+          , slug = "second-post"
+          }
+        ]
+
+Having the full file path lets us read in files. But concatenating it manually is tedious
+and error prone. That's what the [`captureFilePath`](#captureFilePath) helper is for.
+
+
+## Reading matching files
+
+@docs captureFilePath
+
+In many cases you will want to take the matching files from a `Glob` and then read the body or frontmatter from matching files.
+
+
+## Reading Metadata for each Glob Match
+
+For example, if we had files like this:
+
+```markdown
+---
+title: My First Post
+---
+This is my first post!
+```
+
+Then we could read that title for our blog post list page using our `blogPosts` `DataSource` that we defined above.
+
+    import DataSource.File
+    import OptimizedDecoder as Decode exposing (Decoder)
+
+    titles : DataSource (List BlogPost)
+    titles =
+        blogPosts
+            |> DataSource.map
+                (List.map
+                    (\blogPost ->
+                        DataSource.File.request
+                            blogPost.filePath
+                            (DataSource.File.frontmatter blogFrontmatterDecoder)
+                    )
+                )
+            |> DataSource.resolve
+
+    type alias BlogPost =
+        { title : String }
+
+    blogFrontmatterDecoder : Decoder BlogPost
+    blogFrontmatterDecoder =
+        Decode.map BlogPost
+            (Decode.field "title" Decode.string)
+
+That will give us
+
+    DataSource.succeed
+        [ { title = "My First Post" }
+        , { title = "My Second Post" }
+        ]
+
+
+## Capturing Patterns
+
+@docs wildcard, recursiveWildcard
+
+
+## Capturing Specific Characters
+
+@docs int, digits
+
+
+## Matching a Specific Number of Files
+
+@docs expectUniqueMatch, expectUniqueMatchFromList
+
+
+## Glob Patterns
+
+@docs literal
+
+@docs map, succeed, toDataSource
+
+@docs oneOf
+
+@docs zeroOrMore, atLeastOne
+
+-}
+
+import DataSource exposing (DataSource)
+import DataSource.Http
+import DataSource.Internal.Glob exposing (Glob(..))
+import List.Extra
+import OptimizedDecoder
+import Regex
+import Secrets
+
+
+{-| A pattern to match local files and capture parts of the path into a nice Elm data type.
+-}
+type alias Glob a =
+    DataSource.Internal.Glob.Glob a
+
+
+{-| A `Glob` can be mapped. This can be useful for transforming a sub-match in-place.
+
+For example, if you wanted to take the slugs for a blog post and make sure they are normalized to be all lowercase, you
+could use
+
+    import DataSource exposing (DataSource)
+    import DataSource.Glob as Glob
+
+    blogPostsGlob : DataSource (List String)
+    blogPostsGlob =
+        Glob.succeed (\slug -> slug)
+            |> Glob.match (Glob.literal "content/blog/")
+            |> Glob.capture (Glob.wildcard |> Glob.map String.toLower)
+            |> Glob.match (Glob.literal ".md")
+            |> Glob.toDataSource
+
+If you want to validate file formats, you can combine that with some `DataSource` helpers to turn a `Glob (Result String value)` into
+a `DataSource (List value)`.
+
+For example, you could take a date and parse it.
+
+    import DataSource exposing (DataSource)
+    import DataSource.Glob as Glob
+
+    example : DataSource (List ( String, String ))
+    example =
+        Glob.succeed
+            (\dateResult slug ->
+                dateResult
+                    |> Result.map (\okDate -> ( okDate, slug ))
+            )
+            |> Glob.match (Glob.literal "blog/")
+            |> Glob.capture (Glob.recursiveWildcard |> Glob.map expectDateFormat)
+            |> Glob.match (Glob.literal "/")
+            |> Glob.capture Glob.wildcard
+            |> Glob.match (Glob.literal ".md")
+            |> Glob.toDataSource
+            |> DataSource.map (List.map DataSource.fromResult)
+            |> DataSource.resolve
+
+    expectDateFormat : List String -> Result String String
+    expectDateFormat dateParts =
+        case dateParts of
+            [ year, month, date ] ->
+                Ok (String.join "-" [ year, month, date ])
+
+            _ ->
+                Err "Unexpected date format, expected yyyy/mm/dd folder structure."
+
+-}
+map : (a -> b) -> Glob a -> Glob b
+map mapFn (Glob pattern regex applyCapture) =
+    Glob pattern
+        regex
+        (\fullPath captures ->
+            captures
+                |> applyCapture fullPath
+                |> Tuple.mapFirst mapFn
+        )
+
+
+{-| `succeed` is how you start a pipeline for a `Glob`. You will need one argument for each `capture` in your `Glob`.
+-}
+succeed : constructor -> Glob constructor
+succeed constructor =
+    Glob "" "" (\_ captures -> ( constructor, captures ))
+
+
+fullFilePath : Glob String
+fullFilePath =
+    Glob ""
+        ""
+        (\fullPath captures ->
+            ( fullPath, captures )
+        )
+
+
+{-|
+
+    import DataSource exposing (DataSource)
+    import DataSource.Glob as Glob
+
+    blogPosts :
+        DataSource
+            (List
+                { filePath : String
+                , slug : String
+                }
+            )
+    blogPosts =
+        Glob.succeed
+            (\filePath slug ->
+                { filePath = filePath
+                , slug = slug
+                }
+            )
+            |> Glob.captureFilePath
+            |> Glob.match (Glob.literal "content/blog/")
+            |> Glob.capture Glob.wildcard
+            |> Glob.match (Glob.literal ".md")
+            |> Glob.toDataSource
+
+This function does not change which files will or will not match. It just gives you the full matching
+file path in your `Glob` pipeline.
+
+Whenever possible, it's a good idea to use function to make sure you have an accurate file path when you need to read a file.
+
+-}
+captureFilePath : Glob (String -> value) -> Glob value
+captureFilePath =
+    capture fullFilePath
+
+
+{-| Matches anything except for a `/` in a file path. You may be familiar with this syntax from shells like bash
+where you can run commands like `rm client/*.js` to remove all `.js` files in the `client` directory.
+
+Just like a `*` glob pattern in bash, this `Glob.wildcard` function will only match within a path part. If you need to
+match 0 or more path parts like, see `recursiveWildcard`.
+
+    import DataSource exposing (DataSource)
+    import DataSource.Glob as Glob
+
+    type alias BlogPost =
+        { year : String
+        , month : String
+        , day : String
+        , slug : String
+        }
+
+    example : DataSource (List BlogPost)
+    example =
+        Glob.succeed BlogPost
+            |> Glob.match (Glob.literal "blog/")
+            |> Glob.match Glob.wildcard
+            |> Glob.match (Glob.literal "-")
+            |> Glob.capture Glob.wildcard
+            |> Glob.match (Glob.literal "-")
+            |> Glob.capture Glob.wildcard
+            |> Glob.match (Glob.literal "/")
+            |> Glob.capture Glob.wildcard
+            |> Glob.match (Glob.literal ".md")
+            |> Glob.toDataSource
+
+```shell
+
+- blog/
+  - 2021-05-27/
+    - first-post.md
+```
+
+That will match to:
+
+    results : DataSource (List BlogPost)
+    results =
+        DataSource.succeed
+            [ { year = "2021"
+              , month = "05"
+              , day = "27"
+              , slug = "first-post"
+              }
+            ]
+
+Note that we can "destructure" the date part of this file path in the format `yyyy-mm-dd`. The `wildcard` matches
+will match _within_ a path part (think between the slashes of a file path). `recursiveWildcard` can match across path parts.
+
+-}
+wildcard : Glob String
+wildcard =
+    Glob "*"
+        wildcardRegex
+        (\_ captures ->
+            case captures of
+                first :: rest ->
+                    ( first, rest )
+
+                [] ->
+                    ( "ERROR", [] )
+        )
+
+
+wildcardRegex : String
+wildcardRegex =
+    "([^/]*?)"
+
+
+{-| This is similar to [`wildcard`](#wildcard), but it will only match 1 or more digits (i.e. `[0-9]+`).
+
+See [`int`](#int) for a convenience function to get an Int value instead of a String of digits.
+
+-}
+digits : Glob String
+digits =
+    Glob "[0-9]+"
+        "([0-9]+?)"
+        (\_ captures ->
+            case captures of
+                first :: rest ->
+                    ( first, rest )
+
+                [] ->
+                    ( "ERROR", [] )
+        )
+
+
+{-| Same as [`digits`](#digits), but it safely turns the digits String into an `Int`.
+
+Leading 0's are ignored.
+
+    import DataSource exposing (DataSource)
+    import DataSource.Glob as Glob
+
+    slides : DataSource (List Int)
+    slides =
+        Glob.succeed identity
+            |> Glob.match (Glob.literal "slide-")
+            |> Glob.capture Glob.int
+            |> Glob.match (Glob.literal ".md")
+            |> Glob.toDataSource
+
+With files
+
+```shell
+- slide-no-match.md
+- slide-.md
+- slide-1.md
+- slide-01.md
+- slide-2.md
+- slide-03.md
+- slide-4.md
+- slide-05.md
+- slide-06.md
+- slide-007.md
+- slide-08.md
+- slide-09.md
+- slide-10.md
+- slide-11.md
+```
+
+Yields
+
+    matches : DataSource (List Int)
+    matches =
+        DataSource.succeed
+            [ 1
+            , 1
+            , 2
+            , 3
+            , 4
+            , 5
+            , 6
+            , 7
+            , 8
+            , 9
+            , 10
+            , 11
+            ]
+
+Note that neither `slide-no-match.md` nor `slide-.md` match.
+And both `slide-1.md` and `slide-01.md` match and turn into `1`.
+
+-}
+int : Glob Int
+int =
+    digits
+        |> map
+            (\matchedDigits ->
+                matchedDigits
+                    |> String.toInt
+                    |> Maybe.withDefault -1
+            )
+
+
+{-| Matches any number of characters, including `/`, as long as it's the only thing in a path part.
+
+In contrast, `wildcard` will never match `/`, so it only matches within a single path part.
+
+This is the elm-pages equivalent of `**/*.txt` in standard shell syntax:
+
+    import DataSource exposing (DataSource)
+    import DataSource.Glob as Glob
+
+    example : DataSource (List ( List String, String ))
+    example =
+        Glob.succeed Tuple.pair
+            |> Glob.match (Glob.literal "articles/")
+            |> Glob.capture Glob.recursiveWildcard
+            |> Glob.match (Glob.literal "/")
+            |> Glob.capture Glob.wildcard
+            |> Glob.match (Glob.literal ".txt")
+            |> Glob.toDataSource
+
+With these files:
+
+```shell
+- articles/
+  - google-io-2021-recap.txt
+  - archive/
+    - 1977/
+      - 06/
+        - 10/
+          - apple-2-announced.txt
+```
+
+We would get the following matches:
+
+    matches : DataSource (List ( List String, String ))
+    matches =
+        DataSource.succeed
+            [ ( [ "archive", "1977", "06", "10" ], "apple-2-announced" )
+            , ( [], "google-io-2021-recap" )
+            ]
+
+Note that the recursive wildcard conveniently gives us a `List String`, where
+each String is a path part with no slashes (like `archive`).
+
+And also note that it matches 0 path parts into an empty list.
+
+If we didn't include the `wildcard` after the `recursiveWildcard`, then we would only get
+a single level of matches because it is followed by a file extension.
+
+    example : DataSource (List String)
+    example =
+        Glob.succeed identity
+            |> Glob.match (Glob.literal "articles/")
+            |> Glob.capture Glob.recursiveWildcard
+            |> Glob.match (Glob.literal ".txt")
+
+    matches : DataSource (List String)
+    matches =
+        DataSource.succeed
+            [ "google-io-2021-recap"
+            ]
+
+This is usually not what is intended. Using `recursiveWildcard` is usually followed by a `wildcard` for this reason.
+
+-}
+recursiveWildcard : Glob (List String)
+recursiveWildcard =
+    Glob "**"
+        recursiveWildcardRegex
+        (\_ captures ->
+            case captures of
+                first :: rest ->
+                    ( first, rest )
+
+                [] ->
+                    ( "ERROR", [] )
+        )
+        |> map (String.split "/")
+        |> map (List.filter (not << String.isEmpty))
+
+
+recursiveWildcardRegex : String
+recursiveWildcardRegex =
+    "(.*?)"
+
+
+{-| -}
+zeroOrMore : List String -> Glob (Maybe String)
+zeroOrMore matchers =
+    Glob
+        ("*("
+            ++ (matchers |> String.join "|")
+            ++ ")"
+        )
+        ("((?:"
+            ++ (matchers |> List.map regexEscaped |> String.join "|")
+            ++ ")*)"
+        )
+        (\_ captures ->
+            case captures of
+                first :: rest ->
+                    ( if first == "" then
+                        Nothing
+
+                      else
+                        Just first
+                    , rest
+                    )
+
+                [] ->
+                    ( Just "ERROR", [] )
+        )
+
+
+{-| Match a literal part of a path. Can include `/`s.
+
+Some common uses include
+
+  - The leading part of a pattern, to say "starts with `content/blog/`"
+  - The ending part of a pattern, to say "ends with `.md`"
+  - In-between wildcards, to say "these dynamic parts are separated by `/`"
+
+```elm
+import DataSource exposing (DataSource)
+import DataSource.Glob as Glob
+
+blogPosts =
+    Glob.succeed
+        (\section slug ->
+            { section = section, slug = slug }
+        )
+        |> Glob.match (Glob.literal "content/blog/")
+        |> Glob.capture Glob.wildcard
+        |> Glob.match (Glob.literal "/")
+        |> Glob.capture Glob.wildcard
+        |> Glob.match (Glob.literal ".md")
+```
+
+-}
+literal : String -> Glob String
+literal string =
+    Glob string (regexEscaped string) (\_ captures -> ( string, captures ))
+
+
+regexEscaped : String -> String
+regexEscaped stringLiteral =
+    --https://stackoverflow.com/a/6969486
+    stringLiteral
+        |> Regex.replace regexEscapePattern (\match_ -> "\\" ++ match_.match)
+
+
+regexEscapePattern : Regex.Regex
+regexEscapePattern =
+    "[.*+?^${}()|[\\]\\\\]"
+        |> Regex.fromString
+        |> Maybe.withDefault Regex.never
+
+
+{-| Adds on to the glob pattern, but does not capture it in the resulting Elm match value. That means this changes which
+files will match, but does not change the Elm data type you get for each matching file.
+
+Exactly the same as `capture` except it doesn't capture the matched sub-pattern.
+
+-}
+match : Glob a -> Glob value -> Glob value
+match (Glob matcherPattern regex1 apply1) (Glob pattern regex2 apply2) =
+    Glob
+        (pattern ++ matcherPattern)
+        (combineRegexes regex1 regex2)
+        (\fullPath captures ->
+            let
+                ( _, captured1 ) =
+                    -- apply to make sure we drop from the captures list for all capturing patterns
+                    -- but don't change the return value
+                    captures
+                        |> apply1 fullPath
+
+                ( applied2, captured2 ) =
+                    captured1
+                        |> apply2 fullPath
+            in
+            ( applied2
+            , captured2
+            )
+        )
+
+
+{-| Adds on to the glob pattern, and captures it in the resulting Elm match value. That means this both changes which
+files will match, and gives you the sub-match as Elm data for each matching file.
+
+Exactly the same as `match` except it also captures the matched sub-pattern.
+
+    type alias ArchivesArticle =
+        { year : String
+        , month : String
+        , day : String
+        , slug : String
+        }
+
+    archives : DataSource ArchivesArticle
+    archives =
+        Glob.succeed ArchivesArticle
+            |> Glob.match (Glob.literal "archive/")
+            |> Glob.capture Glob.int
+            |> Glob.match (Glob.literal "/")
+            |> Glob.capture Glob.int
+            |> Glob.match (Glob.literal "/")
+            |> Glob.capture Glob.int
+            |> Glob.match (Glob.literal "/")
+            |> Glob.capture Glob.wildcard
+            |> Glob.match (Glob.literal ".md")
+            |> Glob.toDataSource
+
+The file `archive/1977/06/10/apple-2-released.md` will give us this match:
+
+    matches : List ArchivesArticle
+    matches =
+        DataSource.succeed
+            [ { year = 1977
+              , month = 6
+              , day = 10
+              , slug = "apple-2-released"
+              }
+            ]
+
+When possible, it's best to grab data and turn it into structured Elm data when you have it. That way,
+you don't end up with duplicate validation logic and data normalization, and your code will be more robust.
+
+If you only care about getting the full matched file paths, you can use `match`. `capture` is very useful because
+you can pick apart structured data as you build up your glob pattern. This follows the principle of
+[Parse, Don't Validate](https://elm-radio.com/episode/parse-dont-validate/).
+
+-}
+capture : Glob a -> Glob (a -> value) -> Glob value
+capture (Glob matcherPattern regex1 apply1) (Glob pattern regex2 apply2) =
+    Glob
+        (pattern ++ matcherPattern)
+        (combineRegexes regex1 regex2)
+        (\fullPath captures ->
+            let
+                ( applied1, captured1 ) =
+                    captures
+                        |> apply1 fullPath
+
+                ( applied2, captured2 ) =
+                    captured1
+                        |> apply2 fullPath
+            in
+            ( applied1 |> applied2
+            , captured2
+            )
+        )
+
+
+combineRegexes : String -> String -> String
+combineRegexes regex1 regex2 =
+    if isRecursiveWildcardSlashWildcard regex1 regex2 then
+        (regex2 |> String.dropRight 1) ++ regex1
+
+    else
+        regex2 ++ regex1
+
+
+isRecursiveWildcardSlashWildcard : String -> String -> Bool
+isRecursiveWildcardSlashWildcard regex1 regex2 =
+    (regex2 |> String.endsWith (recursiveWildcardRegex ++ "/"))
+        && (regex1 |> String.startsWith wildcardRegex)
+
+
+{-|
+
+    import DataSource.Glob as Glob
+
+    type Extension
+        = Json
+        | Yml
+
+    type alias DataFile =
+        { name : String
+        , extension : String
+        }
+
+    dataFiles : DataSource (List DataFile)
+    dataFiles =
+        Glob.succeed DataFile
+            |> Glob.match (Glob.literal "my-data/")
+            |> Glob.capture Glob.wildcard
+            |> Glob.match (Glob.literal ".")
+            |> Glob.capture
+                (Glob.oneOf
+                    ( ( "yml", Yml )
+                    , [ ( "json", Json )
+                      ]
+                    )
+                )
+
+If we have the following files
+
+```shell
+- my-data/
+    - authors.yml
+    - events.json
+```
+
+That gives us
+
+    results : DataSource (List DataFile)
+    results =
+        DataSource.succeed
+            [ { name = "authors"
+              , extension = Yml
+              }
+            , { name = "events"
+              , extension = Json
+              }
+            ]
+
+You could also match an optional file path segment using `oneOf`.
+
+    rootFilesMd : DataSource (List String)
+    rootFilesMd =
+        Glob.succeed (\slug -> slug)
+            |> Glob.match (Glob.literal "blog/")
+            |> Glob.capture Glob.wildcard
+            |> Glob.match
+                (Glob.oneOf
+                    ( ( "", () )
+                    , [ ( "/index", () ) ]
+                    )
+                )
+            |> Glob.match (Glob.literal ".md")
+            |> Glob.toDataSource
+
+With these files:
+
+```markdown
+- blog/
+    - first-post.md
+    - second-post/
+        - index.md
+```
+
+This would give us:
+
+    results : DataSource (List String)
+    results =
+        DataSource.succeed
+            [ "first-post"
+            , "second-post"
+            ]
+
+-}
+oneOf : ( ( String, a ), List ( String, a ) ) -> Glob a
+oneOf ( defaultMatch, otherMatchers ) =
+    let
+        allMatchers : List ( String, a )
+        allMatchers =
+            defaultMatch :: otherMatchers
+    in
+    Glob
+        ("{"
+            ++ (allMatchers |> List.map Tuple.first |> String.join ",")
+            ++ "}"
+        )
+        ("("
+            ++ String.join "|"
+                ((allMatchers |> List.map Tuple.first |> List.map regexEscaped)
+                    |> List.map regexEscaped
+                )
+            ++ ")"
+        )
+        (\_ captures ->
+            case captures of
+                match_ :: rest ->
+                    ( allMatchers
+                        |> List.Extra.findMap
+                            (\( literalString, result ) ->
+                                if literalString == match_ then
+                                    Just result
+
+                                else
+                                    Nothing
+                            )
+                        |> Maybe.withDefault (defaultMatch |> Tuple.second)
+                    , rest
+                    )
+
+                [] ->
+                    ( Tuple.second defaultMatch, [] )
+        )
+
+
+{-| -}
+atLeastOne : ( ( String, a ), List ( String, a ) ) -> Glob ( a, List a )
+atLeastOne ( defaultMatch, otherMatchers ) =
+    let
+        allMatchers : List ( String, a )
+        allMatchers =
+            defaultMatch :: otherMatchers
+    in
+    Glob
+        ("+("
+            ++ (allMatchers |> List.map Tuple.first |> String.join "|")
+            ++ ")"
+        )
+        ("((?:"
+            ++ (allMatchers |> List.map Tuple.first |> List.map regexEscaped |> String.join "|")
+            ++ ")+)"
+        )
+        (\_ captures ->
+            case captures of
+                match_ :: rest ->
+                    ( --( allMatchers
+                      --        |> List.Extra.findMap
+                      --            (\( literalString, result ) ->
+                      --                if literalString == match_ then
+                      --                    Just result
+                      --
+                      --                else
+                      --                    Nothing
+                      --            )
+                      --        |> Maybe.withDefault (defaultMatch |> Tuple.second)
+                      --  , []
+                      --  )
+                      DataSource.Internal.Glob.extractMatches (defaultMatch |> Tuple.second) allMatchers match_
+                        |> toNonEmptyWithDefault (defaultMatch |> Tuple.second)
+                    , rest
+                    )
+
+                [] ->
+                    ( ( Tuple.second defaultMatch, [] ), [] )
+        )
+
+
+toNonEmptyWithDefault : a -> List a -> ( a, List a )
+toNonEmptyWithDefault default list =
+    case list of
+        first :: rest ->
+            ( first, rest )
+
+        _ ->
+            ( default, [] )
+
+
+{-| In order to get match data from your glob, turn it into a `DataSource` with this function.
+-}
+toDataSource : Glob a -> DataSource (List a)
+toDataSource glob =
+    DataSource.Http.get (Secrets.succeed <| "glob://" ++ DataSource.Internal.Glob.toPattern glob)
+        (OptimizedDecoder.string
+            |> OptimizedDecoder.list
+            |> OptimizedDecoder.map
+                (\rawGlob -> rawGlob |> List.map (\matchedPath -> DataSource.Internal.Glob.run matchedPath glob |> .match))
+        )
+
+
+{-| Sometimes you want to make sure there is a unique file matching a particular pattern.
+This is a simple helper that will give you a `DataSource` error if there isn't exactly 1 matching file.
+If there is exactly 1, then you successfully get back that single match.
+
+For example, maybe you can have
+
+    import DataSource exposing (DataSource)
+    import DataSource.Glob as Glob
+
+    findBlogBySlug : String -> DataSource String
+    findBlogBySlug slug =
+        Glob.succeed identity
+            |> Glob.captureFilePath
+            |> Glob.match (Glob.literal "blog/")
+            |> Glob.capture (Glob.literal slug)
+            |> Glob.match
+                (Glob.oneOf
+                    ( ( "", () )
+                    , [ ( "/index", () ) ]
+                    )
+                )
+            |> Glob.match (Glob.literal ".md")
+            |> Glob.expectUniqueMatch
+
+If we used `findBlogBySlug "first-post"` with these files:
+
+```markdown
+- blog/
+    - first-post/
+        - index.md
+```
+
+This would give us:
+
+    results : DataSource String
+    results =
+        DataSource.succeed "blog/first-post/index.md"
+
+If we used `findBlogBySlug "first-post"` with these files:
+
+```markdown
+- blog/
+    - first-post.md
+    - first-post/
+        - index.md
+```
+
+Then we will get a `DataSource` error saying `More than one file matched.` Keep in mind that `DataSource` failures
+in build-time routes will cause a build failure, giving you the opportunity to fix the problem before users see the issue,
+so it's ideal to make this kind of assertion rather than having fallback behavior that could silently cover up
+issues (like if we had instead ignored the case where there are two or more matching blog post files).
+
+-}
+expectUniqueMatch : Glob a -> DataSource a
+expectUniqueMatch glob =
+    glob
+        |> toDataSource
+        |> DataSource.andThen
+            (\matchingFiles ->
+                case matchingFiles of
+                    [ file ] ->
+                        DataSource.succeed file
+
+                    [] ->
+                        DataSource.fail <| "No files matched the pattern: " ++ toPatternString glob
+
+                    _ ->
+                        DataSource.fail "More than one file matched."
+            )
+
+
+{-| -}
+expectUniqueMatchFromList : List (Glob a) -> DataSource a
+expectUniqueMatchFromList globs =
+    globs
+        |> List.map toDataSource
+        |> DataSource.combine
+        |> DataSource.andThen
+            (\matchingFiles ->
+                case List.concat matchingFiles of
+                    [ file ] ->
+                        DataSource.succeed file
+
+                    [] ->
+                        DataSource.fail <| "No files matched the patterns: " ++ (globs |> List.map toPatternString |> String.join ", ")
+
+                    _ ->
+                        DataSource.fail "More than one file matched."
+            )
+
+
+toPatternString : Glob a -> String
+toPatternString glob =
+    case glob of
+        Glob pattern_ _ _ ->
+            pattern_