airbyte-source-google-directory 0.2.1__tar.gz

airbyte-source-google-directory-0.2.1/PKG-INFO

@@ -0,0 +1,103 @@
+Metadata-Version: 2.1
+Name: airbyte-source-google-directory
+Version: 0.2.1
+Summary: Source implementation for Google Directory.
+Author: Airbyte
+Author-email: contact@airbyte.io
+Description-Content-Type: text/markdown
+Requires-Dist: airbyte-cdk~=0.1
+Requires-Dist: google-api-python-client==1.12.8
+Requires-Dist: google-auth-httplib2==0.0.4
+Requires-Dist: google-auth-oauthlib==0.4.2
+Requires-Dist: backoff==1.10.0
+Provides-Extra: tests
+Requires-Dist: requests-mock~=1.9.3; extra == "tests"
+Requires-Dist: pytest~=6.1; extra == "tests"
+Requires-Dist: pytest-mock~=3.6.1; extra == "tests"
+
+# Freshsales Source
+
+This is the repository for the Freshsales source connector, written in Python.
+For information about how to use this connector within Airbyte, see [the documentation](https://docs.airbyte.io/integrations/sources/freshsales).
+
+
+**To iterate on this connector, make sure to complete this prerequisites section.**
+
+
+From this connector directory, create a virtual environment:
+```
+python -m venv .venv
+```
+
+This will generate a virtualenv for this module in `.venv/`. Make sure this venv is active in your
+development environment of choice. To activate it from the terminal, run:
+```
+source .venv/bin/activate
+pip install -r requirements.txt
+pip install '.[tests]'
+```
+If you are in an IDE, follow your IDE's instructions to activate the virtualenv.
+
+Note that while we are installing dependencies from `requirements.txt`, you should only edit `setup.py` for your dependencies. `requirements.txt` is
+used for editable installs (`pip install -e`) to pull in Python dependencies from the monorepo and will call `setup.py`.
+If this is mumbo jumbo to you, don't worry about it, just put your deps in `setup.py` but install using `pip install -r requirements.txt` and everything
+should work as you expect.
+
+**If you are a community contributor**, follow the instructions in the [documentation](https://docs.airbyte.io/integrations/sources/freshsales)
+to generate the necessary credentials. Then create a file `secrets/config.json` conforming to the `source_freshsales/spec.json` file.
+Note that any directory named `secrets` is gitignored across the entire Airbyte repo, so there is no danger of accidentally checking in sensitive information.
+See `integration_tests/sample_config.json` for a sample config file.
+
+**If you are an Airbyte core member**, copy the credentials in Lastpass under the secret name `source freshsales test creds`
+and place them into `secrets/config.json`.
+
+```
+python main.py spec
+python main.py check --config secrets/config.json
+python main.py discover --config secrets/config.json
+python main.py read --config secrets/config.json --catalog integration_tests/configured_catalog.json
+```
+
+
+
+**Via [`airbyte-ci`](https://github.com/airbytehq/airbyte/blob/master/airbyte-ci/connectors/pipelines/README.md) (recommended):**
+```bash
+airbyte-ci connectors --name source-freshsales build
+```
+
+An image will be built with the tag `airbyte/source-freshsales:dev`.
+
+**Via `docker build`:**
+```bash
+docker build -t airbyte/source-freshsales:dev .
+```
+
+Then run any of the connector commands as follows:
+```
+docker run --rm airbyte/source-freshsales:dev spec
+docker run --rm -v $(pwd)/secrets:/secrets airbyte/source-freshsales:dev check --config /secrets/config.json
+docker run --rm -v $(pwd)/secrets:/secrets airbyte/source-freshsales:dev discover --config /secrets/config.json
+docker run --rm -v $(pwd)/secrets:/secrets -v $(pwd)/integration_tests:/integration_tests airbyte/source-freshsales:dev read --config /secrets/config.json --catalog /integration_tests/configured_catalog.json
+```
+
+You can run our full test suite locally using [`airbyte-ci`](https://github.com/airbytehq/airbyte/blob/master/airbyte-ci/connectors/pipelines/README.md):
+```bash
+airbyte-ci connectors --name=source-google-directory test
+```
+
+Customize `acceptance-test-config.yml` file to configure tests. See [Connector Acceptance Tests](https://docs.airbyte.com/connector-development/testing-connectors/connector-acceptance-tests-reference) for more information.
+If your connector requires to create or destroy resources for use during acceptance tests create fixtures for it and place them inside integration_tests/acceptance.py.
+
+All of your dependencies should go in `setup.py`, NOT `requirements.txt`. The requirements file is only used to connect internal Airbyte dependencies in the monorepo for local development.
+We split dependencies between two groups, dependencies that are:
+* required for your connector to work need to go to `MAIN_REQUIREMENTS` list.
+* required for the testing need to go to `TEST_REQUIREMENTS` list
+
+You've checked out the repo, implemented a million dollar feature, and you're ready to share your changes with the world. Now what?
+1. Make sure your changes are passing our test suite: `airbyte-ci connectors --name=source-google-directory test`
+2. Bump the connector version in `metadata.yaml`: increment the `dockerImageTag` value. Please follow [semantic versioning for connectors](https://docs.airbyte.com/contributing-to-airbyte/resources/pull-requests-handbook/#semantic-versioning-for-connectors).
+3. Make sure the `metadata.yaml` content is up to date.
+4. Make the connector documentation and its changelog is up to date (`docs/integrations/sources/google-directory.md`).
+5. Create a Pull Request: use [our PR naming conventions](https://docs.airbyte.com/contributing-to-airbyte/resources/pull-requests-handbook/#pull-request-title-convention).
+6. Pat yourself on the back for being an awesome contributor.
+7. Someone from Airbyte will take a look at your PR and iterate with you to merge it into master.

airbyte-source-google-directory-0.2.1/README.md

@@ -0,0 +1,100 @@
+# Freshsales Source
+
+This is the repository for the Freshsales source connector, written in Python.
+For information about how to use this connector within Airbyte, see [the documentation](https://docs.airbyte.io/integrations/sources/freshsales).
+
+## Local development
+
+### Prerequisites
+**To iterate on this connector, make sure to complete this prerequisites section.**
+
+#### Minimum Python version required `= 3.7.0`
+
+#### Build & Activate Virtual Environment and install dependencies
+From this connector directory, create a virtual environment:
+```
+python -m venv .venv
+```
+
+This will generate a virtualenv for this module in `.venv/`. Make sure this venv is active in your
+development environment of choice. To activate it from the terminal, run:
+```
+source .venv/bin/activate
+pip install -r requirements.txt
+pip install '.[tests]'
+```
+If you are in an IDE, follow your IDE's instructions to activate the virtualenv.
+
+Note that while we are installing dependencies from `requirements.txt`, you should only edit `setup.py` for your dependencies. `requirements.txt` is
+used for editable installs (`pip install -e`) to pull in Python dependencies from the monorepo and will call `setup.py`.
+If this is mumbo jumbo to you, don't worry about it, just put your deps in `setup.py` but install using `pip install -r requirements.txt` and everything
+should work as you expect.
+
+#### Create credentials
+**If you are a community contributor**, follow the instructions in the [documentation](https://docs.airbyte.io/integrations/sources/freshsales)
+to generate the necessary credentials. Then create a file `secrets/config.json` conforming to the `source_freshsales/spec.json` file.
+Note that any directory named `secrets` is gitignored across the entire Airbyte repo, so there is no danger of accidentally checking in sensitive information.
+See `integration_tests/sample_config.json` for a sample config file.
+
+**If you are an Airbyte core member**, copy the credentials in Lastpass under the secret name `source freshsales test creds`
+and place them into `secrets/config.json`.
+
+### Locally running the connector
+```
+python main.py spec
+python main.py check --config secrets/config.json
+python main.py discover --config secrets/config.json
+python main.py read --config secrets/config.json --catalog integration_tests/configured_catalog.json
+```
+
+### Locally running the connector docker image
+
+
+#### Build
+**Via [`airbyte-ci`](https://github.com/airbytehq/airbyte/blob/master/airbyte-ci/connectors/pipelines/README.md) (recommended):**
+```bash
+airbyte-ci connectors --name source-freshsales build
+```
+
+An image will be built with the tag `airbyte/source-freshsales:dev`.
+
+**Via `docker build`:**
+```bash
+docker build -t airbyte/source-freshsales:dev .
+```
+
+#### Run
+Then run any of the connector commands as follows:
+```
+docker run --rm airbyte/source-freshsales:dev spec
+docker run --rm -v $(pwd)/secrets:/secrets airbyte/source-freshsales:dev check --config /secrets/config.json
+docker run --rm -v $(pwd)/secrets:/secrets airbyte/source-freshsales:dev discover --config /secrets/config.json
+docker run --rm -v $(pwd)/secrets:/secrets -v $(pwd)/integration_tests:/integration_tests airbyte/source-freshsales:dev read --config /secrets/config.json --catalog /integration_tests/configured_catalog.json
+```
+
+## Testing
+You can run our full test suite locally using [`airbyte-ci`](https://github.com/airbytehq/airbyte/blob/master/airbyte-ci/connectors/pipelines/README.md):
+```bash
+airbyte-ci connectors --name=source-google-directory test
+```
+
+### Customizing acceptance Tests
+Customize `acceptance-test-config.yml` file to configure tests. See [Connector Acceptance Tests](https://docs.airbyte.com/connector-development/testing-connectors/connector-acceptance-tests-reference) for more information.
+If your connector requires to create or destroy resources for use during acceptance tests create fixtures for it and place them inside integration_tests/acceptance.py.
+
+## Dependency Management
+All of your dependencies should go in `setup.py`, NOT `requirements.txt`. The requirements file is only used to connect internal Airbyte dependencies in the monorepo for local development.
+We split dependencies between two groups, dependencies that are:
+* required for your connector to work need to go to `MAIN_REQUIREMENTS` list.
+* required for the testing need to go to `TEST_REQUIREMENTS` list
+
+### Publishing a new version of the connector
+You've checked out the repo, implemented a million dollar feature, and you're ready to share your changes with the world. Now what?
+1. Make sure your changes are passing our test suite: `airbyte-ci connectors --name=source-google-directory test`
+2. Bump the connector version in `metadata.yaml`: increment the `dockerImageTag` value. Please follow [semantic versioning for connectors](https://docs.airbyte.com/contributing-to-airbyte/resources/pull-requests-handbook/#semantic-versioning-for-connectors).
+3. Make sure the `metadata.yaml` content is up to date.
+4. Make the connector documentation and its changelog is up to date (`docs/integrations/sources/google-directory.md`).
+5. Create a Pull Request: use [our PR naming conventions](https://docs.airbyte.com/contributing-to-airbyte/resources/pull-requests-handbook/#pull-request-title-convention).
+6. Pat yourself on the back for being an awesome contributor.
+7. Someone from Airbyte will take a look at your PR and iterate with you to merge it into master.
+

airbyte-source-google-directory-0.2.1/airbyte_source_google_directory.egg-info/PKG-INFO

@@ -0,0 +1,103 @@
+Metadata-Version: 2.1
+Name: airbyte-source-google-directory
+Version: 0.2.1
+Summary: Source implementation for Google Directory.
+Author: Airbyte
+Author-email: contact@airbyte.io
+Description-Content-Type: text/markdown
+Requires-Dist: airbyte-cdk~=0.1
+Requires-Dist: google-api-python-client==1.12.8
+Requires-Dist: google-auth-httplib2==0.0.4
+Requires-Dist: google-auth-oauthlib==0.4.2
+Requires-Dist: backoff==1.10.0
+Provides-Extra: tests
+Requires-Dist: requests-mock~=1.9.3; extra == "tests"
+Requires-Dist: pytest~=6.1; extra == "tests"
+Requires-Dist: pytest-mock~=3.6.1; extra == "tests"
+
+# Freshsales Source
+
+This is the repository for the Freshsales source connector, written in Python.
+For information about how to use this connector within Airbyte, see [the documentation](https://docs.airbyte.io/integrations/sources/freshsales).
+
+
+**To iterate on this connector, make sure to complete this prerequisites section.**
+
+
+From this connector directory, create a virtual environment:
+```
+python -m venv .venv
+```
+
+This will generate a virtualenv for this module in `.venv/`. Make sure this venv is active in your
+development environment of choice. To activate it from the terminal, run:
+```
+source .venv/bin/activate
+pip install -r requirements.txt
+pip install '.[tests]'
+```
+If you are in an IDE, follow your IDE's instructions to activate the virtualenv.
+
+Note that while we are installing dependencies from `requirements.txt`, you should only edit `setup.py` for your dependencies. `requirements.txt` is
+used for editable installs (`pip install -e`) to pull in Python dependencies from the monorepo and will call `setup.py`.
+If this is mumbo jumbo to you, don't worry about it, just put your deps in `setup.py` but install using `pip install -r requirements.txt` and everything
+should work as you expect.
+
+**If you are a community contributor**, follow the instructions in the [documentation](https://docs.airbyte.io/integrations/sources/freshsales)
+to generate the necessary credentials. Then create a file `secrets/config.json` conforming to the `source_freshsales/spec.json` file.
+Note that any directory named `secrets` is gitignored across the entire Airbyte repo, so there is no danger of accidentally checking in sensitive information.
+See `integration_tests/sample_config.json` for a sample config file.
+
+**If you are an Airbyte core member**, copy the credentials in Lastpass under the secret name `source freshsales test creds`
+and place them into `secrets/config.json`.
+
+```
+python main.py spec
+python main.py check --config secrets/config.json
+python main.py discover --config secrets/config.json
+python main.py read --config secrets/config.json --catalog integration_tests/configured_catalog.json
+```
+
+
+
+**Via [`airbyte-ci`](https://github.com/airbytehq/airbyte/blob/master/airbyte-ci/connectors/pipelines/README.md) (recommended):**
+```bash
+airbyte-ci connectors --name source-freshsales build
+```
+
+An image will be built with the tag `airbyte/source-freshsales:dev`.
+
+**Via `docker build`:**
+```bash
+docker build -t airbyte/source-freshsales:dev .
+```
+
+Then run any of the connector commands as follows:
+```
+docker run --rm airbyte/source-freshsales:dev spec
+docker run --rm -v $(pwd)/secrets:/secrets airbyte/source-freshsales:dev check --config /secrets/config.json
+docker run --rm -v $(pwd)/secrets:/secrets airbyte/source-freshsales:dev discover --config /secrets/config.json
+docker run --rm -v $(pwd)/secrets:/secrets -v $(pwd)/integration_tests:/integration_tests airbyte/source-freshsales:dev read --config /secrets/config.json --catalog /integration_tests/configured_catalog.json
+```
+
+You can run our full test suite locally using [`airbyte-ci`](https://github.com/airbytehq/airbyte/blob/master/airbyte-ci/connectors/pipelines/README.md):
+```bash
+airbyte-ci connectors --name=source-google-directory test
+```
+
+Customize `acceptance-test-config.yml` file to configure tests. See [Connector Acceptance Tests](https://docs.airbyte.com/connector-development/testing-connectors/connector-acceptance-tests-reference) for more information.
+If your connector requires to create or destroy resources for use during acceptance tests create fixtures for it and place them inside integration_tests/acceptance.py.
+
+All of your dependencies should go in `setup.py`, NOT `requirements.txt`. The requirements file is only used to connect internal Airbyte dependencies in the monorepo for local development.
+We split dependencies between two groups, dependencies that are:
+* required for your connector to work need to go to `MAIN_REQUIREMENTS` list.
+* required for the testing need to go to `TEST_REQUIREMENTS` list
+
+You've checked out the repo, implemented a million dollar feature, and you're ready to share your changes with the world. Now what?
+1. Make sure your changes are passing our test suite: `airbyte-ci connectors --name=source-google-directory test`
+2. Bump the connector version in `metadata.yaml`: increment the `dockerImageTag` value. Please follow [semantic versioning for connectors](https://docs.airbyte.com/contributing-to-airbyte/resources/pull-requests-handbook/#semantic-versioning-for-connectors).
+3. Make sure the `metadata.yaml` content is up to date.
+4. Make the connector documentation and its changelog is up to date (`docs/integrations/sources/google-directory.md`).
+5. Create a Pull Request: use [our PR naming conventions](https://docs.airbyte.com/contributing-to-airbyte/resources/pull-requests-handbook/#pull-request-title-convention).
+6. Pat yourself on the back for being an awesome contributor.
+7. Someone from Airbyte will take a look at your PR and iterate with you to merge it into master.

airbyte-source-google-directory-0.2.1/airbyte_source_google_directory.egg-info/SOURCES.txt

@@ -0,0 +1,26 @@
+README.md
+setup.cfg
+setup.py
+airbyte_source_google_directory.egg-info/PKG-INFO
+airbyte_source_google_directory.egg-info/SOURCES.txt
+airbyte_source_google_directory.egg-info/dependency_links.txt
+airbyte_source_google_directory.egg-info/entry_points.txt
+airbyte_source_google_directory.egg-info/requires.txt
+airbyte_source_google_directory.egg-info/top_level.txt
+integration_tests/__init__.py
+integration_tests/acceptance.py
+integration_tests/configured_catalog.json
+integration_tests/invalid_config.json
+integration_tests/invalid_config_oauth.json
+integration_tests/sample_config.json
+integration_tests/sample_config_oauth.json
+source_google_directory/__init__.py
+source_google_directory/api.py
+source_google_directory/client.py
+source_google_directory/run.py
+source_google_directory/source.py
+source_google_directory/spec.json
+source_google_directory/utils.py
+source_google_directory/schemas/group_members.json
+source_google_directory/schemas/groups.json
+source_google_directory/schemas/users.json

airbyte-source-google-directory-0.2.1/airbyte_source_google_directory.egg-info/dependency_links.txt

@@ -0,0 +1 @@
+

airbyte-source-google-directory-0.2.1/airbyte_source_google_directory.egg-info/entry_points.txt

@@ -0,0 +1,2 @@
+[console_scripts]
+source-google-directory = source_google_directory.run:run

airbyte-source-google-directory-0.2.1/airbyte_source_google_directory.egg-info/requires.txt

@@ -0,0 +1,10 @@
+airbyte-cdk~=0.1
+google-api-python-client==1.12.8
+google-auth-httplib2==0.0.4
+google-auth-oauthlib==0.4.2
+backoff==1.10.0
+
+[tests]
+requests-mock~=1.9.3
+pytest~=6.1
+pytest-mock~=3.6.1

airbyte-source-google-directory-0.2.1/airbyte_source_google_directory.egg-info/top_level.txt

@@ -0,0 +1,2 @@
+integration_tests
+source_google_directory

airbyte-source-google-directory-0.2.1/integration_tests/__init__.py

@@ -0,0 +1,3 @@
+#
+# Copyright (c) 2023 Airbyte, Inc., all rights reserved.
+#

airbyte-source-google-directory-0.2.1/integration_tests/acceptance.py

@@ -0,0 +1,14 @@
+#
+# Copyright (c) 2023 Airbyte, Inc., all rights reserved.
+#
+
+
+import pytest
+
+pytest_plugins = ("connector_acceptance_test.plugin",)
+
+
+@pytest.fixture(scope="session", autouse=True)
+def connector_setup():
+    """This fixture is a placeholder for external resources that acceptance test might require."""
+    yield

airbyte-source-google-directory-0.2.1/integration_tests/configured_catalog.json

@@ -0,0 +1,40 @@
+{
+  "streams": [
+    {
+      "stream": {
+        "name": "users",
+        "json_schema": {},
+        "supported_sync_modes": ["full_refresh"],
+        "source_defined_cursor": false,
+        "source_defined_primary_key": [["id"]]
+      },
+      "sync_mode": "full_refresh",
+      "destination_sync_mode": "overwrite",
+      "primary_key": [["id"]]
+    },
+    {
+      "stream": {
+        "name": "groups",
+        "json_schema": {},
+        "supported_sync_modes": ["full_refresh"],
+        "source_defined_cursor": false,
+        "source_defined_primary_key": [["id"]]
+      },
+      "sync_mode": "full_refresh",
+      "destination_sync_mode": "overwrite",
+      "primary_key": [["id"]]
+    },
+    {
+      "stream": {
+        "name": "group_members",
+        "json_schema": {},
+        "supported_sync_modes": ["full_refresh"],
+        "source_defined_cursor": false,
+        "source_defined_primary_key": [["id"]]
+      },
+      "sync_mode": "full_refresh",
+      "destination_sync_mode": "overwrite",
+      "primary_key": [["id"]]
+    }
+  ]
+}

airbyte-source-google-directory-0.2.1/integration_tests/invalid_config.json

@@ -0,0 +1,4 @@
+{
+  "credentials_json": "{}",
+  "email": "test@test.test"
+}

airbyte-source-google-directory-0.2.1/integration_tests/invalid_config_oauth.json

@@ -0,0 +1,7 @@
+{
+  "credentials": {
+    "client_id": "<invalid_client_id>",
+    "client_secret": "<invalid_client_secret>",
+    "refresh_token": "<invalid_refresh_token>"
+  }
+}

airbyte-source-google-directory-0.2.1/integration_tests/sample_config.json

@@ -0,0 +1,6 @@
+{
+  "credentials": {
+    "credentials_json": "<The contents of the JSON service account key>",
+    "email": "test@test.test"
+  }
+}

airbyte-source-google-directory-0.2.1/integration_tests/sample_config_oauth.json

@@ -0,0 +1,7 @@
+{
+  "credentials": {
+    "client_id": "<Client ID>",
+    "client_secret": "<Client secret>",
+    "refresh_token": "<Refresh token>"
+  }
+}

airbyte-source-google-directory-0.2.1/setup.cfg

@@ -0,0 +1,97 @@
+[metadata]
+name = airbyte-source-google-directory
+version = 0.2.1
+author = Airbyte
+author_email = contact@airbyte.io
+long_description = # Freshsales Source
+	
+	This is the repository for the Freshsales source connector, written in Python.
+	For information about how to use this connector within Airbyte, see [the documentation](https://docs.airbyte.io/integrations/sources/freshsales).
+	
+	
+	**To iterate on this connector, make sure to complete this prerequisites section.**
+	
+	
+	From this connector directory, create a virtual environment:
+	```
+	python -m venv .venv
+	```
+	
+	This will generate a virtualenv for this module in `.venv/`. Make sure this venv is active in your
+	development environment of choice. To activate it from the terminal, run:
+	```
+	source .venv/bin/activate
+	pip install -r requirements.txt
+	pip install '.[tests]'
+	```
+	If you are in an IDE, follow your IDE's instructions to activate the virtualenv.
+	
+	Note that while we are installing dependencies from `requirements.txt`, you should only edit `setup.py` for your dependencies. `requirements.txt` is
+	used for editable installs (`pip install -e`) to pull in Python dependencies from the monorepo and will call `setup.py`.
+	If this is mumbo jumbo to you, don't worry about it, just put your deps in `setup.py` but install using `pip install -r requirements.txt` and everything
+	should work as you expect.
+	
+	**If you are a community contributor**, follow the instructions in the [documentation](https://docs.airbyte.io/integrations/sources/freshsales)
+	to generate the necessary credentials. Then create a file `secrets/config.json` conforming to the `source_freshsales/spec.json` file.
+	Note that any directory named `secrets` is gitignored across the entire Airbyte repo, so there is no danger of accidentally checking in sensitive information.
+	See `integration_tests/sample_config.json` for a sample config file.
+	
+	**If you are an Airbyte core member**, copy the credentials in Lastpass under the secret name `source freshsales test creds`
+	and place them into `secrets/config.json`.
+	
+	```
+	python main.py spec
+	python main.py check --config secrets/config.json
+	python main.py discover --config secrets/config.json
+	python main.py read --config secrets/config.json --catalog integration_tests/configured_catalog.json
+	```
+	
+	
+	
+	**Via [`airbyte-ci`](https://github.com/airbytehq/airbyte/blob/master/airbyte-ci/connectors/pipelines/README.md) (recommended):**
+	```bash
+	airbyte-ci connectors --name source-freshsales build
+	```
+	
+	An image will be built with the tag `airbyte/source-freshsales:dev`.
+	
+	**Via `docker build`:**
+	```bash
+	docker build -t airbyte/source-freshsales:dev .
+	```
+	
+	Then run any of the connector commands as follows:
+	```
+	docker run --rm airbyte/source-freshsales:dev spec
+	docker run --rm -v $(pwd)/secrets:/secrets airbyte/source-freshsales:dev check --config /secrets/config.json
+	docker run --rm -v $(pwd)/secrets:/secrets airbyte/source-freshsales:dev discover --config /secrets/config.json
+	docker run --rm -v $(pwd)/secrets:/secrets -v $(pwd)/integration_tests:/integration_tests airbyte/source-freshsales:dev read --config /secrets/config.json --catalog /integration_tests/configured_catalog.json
+	```
+	
+	You can run our full test suite locally using [`airbyte-ci`](https://github.com/airbytehq/airbyte/blob/master/airbyte-ci/connectors/pipelines/README.md):
+	```bash
+	airbyte-ci connectors --name=source-google-directory test
+	```
+	
+	Customize `acceptance-test-config.yml` file to configure tests. See [Connector Acceptance Tests](https://docs.airbyte.com/connector-development/testing-connectors/connector-acceptance-tests-reference) for more information.
+	If your connector requires to create or destroy resources for use during acceptance tests create fixtures for it and place them inside integration_tests/acceptance.py.
+	
+	All of your dependencies should go in `setup.py`, NOT `requirements.txt`. The requirements file is only used to connect internal Airbyte dependencies in the monorepo for local development.
+	We split dependencies between two groups, dependencies that are:
+	* required for your connector to work need to go to `MAIN_REQUIREMENTS` list.
+	* required for the testing need to go to `TEST_REQUIREMENTS` list
+	
+	You've checked out the repo, implemented a million dollar feature, and you're ready to share your changes with the world. Now what?
+	1. Make sure your changes are passing our test suite: `airbyte-ci connectors --name=source-google-directory test`
+	2. Bump the connector version in `metadata.yaml`: increment the `dockerImageTag` value. Please follow [semantic versioning for connectors](https://docs.airbyte.com/contributing-to-airbyte/resources/pull-requests-handbook/#semantic-versioning-for-connectors).
+	3. Make sure the `metadata.yaml` content is up to date.
+	4. Make the connector documentation and its changelog is up to date (`docs/integrations/sources/google-directory.md`).
+	5. Create a Pull Request: use [our PR naming conventions](https://docs.airbyte.com/contributing-to-airbyte/resources/pull-requests-handbook/#pull-request-title-convention).
+	6. Pat yourself on the back for being an awesome contributor.
+	7. Someone from Airbyte will take a look at your PR and iterate with you to merge it into master.
+long_description_content_type = text/markdown
+
+[egg_info]
+tag_build = 
+tag_date = 0
+

airbyte-source-google-directory-0.2.1/setup.py

@@ -0,0 +1,47 @@
+#
+# Copyright (c) 2023 Airbyte, Inc., all rights reserved.
+#
+
+
+from setuptools import find_packages, setup
+
+MAIN_REQUIREMENTS = [
+    "airbyte-cdk~=0.1",
+    "google-api-python-client==1.12.8",
+    "google-auth-httplib2==0.0.4",
+    "google-auth-oauthlib==0.4.2",
+    "backoff==1.10.0",
+]
+
+TEST_REQUIREMENTS = [
+    "requests-mock~=1.9.3",
+    "pytest~=6.1",
+    "pytest-mock~=3.6.1",
+]
+
+setup(
+    entry_points={
+        "console_scripts": [
+            "source-google-directory=source_google_directory.run:run",
+        ],
+    },
+    description="Source implementation for Google Directory.",
+    packages=find_packages(),
+    install_requires=MAIN_REQUIREMENTS,
+    package_data={
+        "": [
+            # Include yaml files in the package (if any)
+            "*.yml",
+            "*.yaml",
+            # Include all json files in the package, up to 4 levels deep
+            "*.json",
+            "*/*.json",
+            "*/*/*.json",
+            "*/*/*/*.json",
+            "*/*/*/*/*.json",
+        ]
+    },
+    extras_require={
+        "tests": TEST_REQUIREMENTS,
+    },
+)

airbyte-source-google-directory-0.2.1/source_google_directory/__init__.py

@@ -0,0 +1,6 @@
+#
+# Copyright (c) 2023 Airbyte, Inc., all rights reserved.
+#
+from .source import SourceGoogleDirectory
+
+__all__ = ["SourceGoogleDirectory"]

airbyte-source-google-directory-0.2.1/source_google_directory/api.py

@@ -0,0 +1,135 @@
+#
+# Copyright (c) 2023 Airbyte, Inc., all rights reserved.
+#
+
+
+import json
+from abc import ABC, abstractmethod
+from functools import partial
+from typing import Any, Callable, Dict, Iterator, Mapping, Sequence
+
+import backoff
+from google.auth.transport.requests import Request
+from google.oauth2 import service_account
+from google.oauth2.credentials import Credentials
+from googleapiclient.discovery import build
+from googleapiclient.errors import HttpError as GoogleApiHttpError
+
+from .utils import rate_limit_handling
+
+SCOPES = ["https://www.googleapis.com/auth/admin.directory.user.readonly", "https://www.googleapis.com/auth/admin.directory.group.readonly"]
+
+
+class API:
+    def __init__(self, credentials: Mapping[str, Any]):
+        self._creds = None
+        self._raw_credentials = credentials
+        self._service = None
+
+    @staticmethod
+    def _load_account_info(credentials_json: str) -> Dict:
+        account_info = json.loads(credentials_json)
+        return account_info
+
+    def _obtain_service_account_creds(self) -> service_account.Credentials:
+        """Obtaining creds based on Service account scenario"""
+        credentials_json = self._raw_credentials.get("credentials_json")
+        admin_email = self._raw_credentials.get("email")
+        account_info = self._load_account_info(credentials_json)
+        creds = service_account.Credentials.from_service_account_info(account_info, scopes=SCOPES)
+        self._creds = creds.with_subject(admin_email)
+
+    def _obtain_web_app_creds(self) -> Credentials:
+        """Obtaining creds based on Web server application scenario"""
+        info = {
+            "client_id": self._raw_credentials.get("client_id"),
+            "client_secret": self._raw_credentials.get("client_secret"),
+            "refresh_token": self._raw_credentials.get("refresh_token"),
+        }
+        creds = Credentials.from_authorized_user_info(info)
+        if creds.expired:
+            creds.refresh(Request())
+        self._creds = creds
+
+    def _obtain_creds(self):
+        if "credentials_json" in self._raw_credentials:
+            self._obtain_service_account_creds()
+        elif "client_id" and "client_secret" in self._raw_credentials:
+            self._obtain_web_app_creds()
+
+    def _construct_resource(self):
+        if not self._creds:
+            self._obtain_creds()
+        if not self._service:
+            self._service = build("admin", "directory_v1", credentials=self._creds)
+
+    def _get_resource(self, name: str):
+        self._construct_resource()
+        return getattr(self._service, name)
+
+    @backoff.on_exception(backoff.expo, GoogleApiHttpError, max_tries=7, giveup=rate_limit_handling)
+    def get(self, name: str, params: Dict = None) -> Dict:
+        resource = self._get_resource(name)
+        response = resource().list(**params).execute()
+        return response
+
+
+class StreamAPI(ABC):
+    results_per_page = 100
+
+    def __init__(self, api: API, *args, **kwargs):
+        super().__init__(*args, **kwargs)
+        self._api = api
+
+    def _api_get(self, resource: str, params: Dict = None):
+        return self._api.get(resource, params=params)
+
+    @abstractmethod
+    def list(self, fields: Sequence[str] = None) -> Iterator[dict]:
+        """Iterate over entities"""
+
+    @abstractmethod
+    def process_response(self, response: Dict) -> Iterator[dict]:
+        """Process Google Directory API response"""
+
+    def read(self, getter: Callable, params: Dict = None) -> Iterator:
+        """Read using getter"""
+        params = params or {}
+        params["maxResults"] = self.results_per_page
+        while True:
+            batch = getter(params={**params})
+            yield from self.process_response(batch)
+
+            if "nextPageToken" in batch:
+                params["pageToken"] = batch["nextPageToken"]
+            else:
+                break
+
+
+class UsersAPI(StreamAPI):
+    def process_response(self, response: Dict) -> Iterator[dict]:
+        return response["users"]
+
+    def list(self, fields: Sequence[str] = None) -> Iterator[dict]:
+        params = {"customer": "my_customer"}
+        yield from self.read(partial(self._api_get, resource="users"), params=params)
+
+
+class GroupsAPI(StreamAPI):
+    def process_response(self, response: Dict) -> Iterator[dict]:
+        return response["groups"]
+
+    def list(self, fields: Sequence[str] = None) -> Iterator[dict]:
+        params = {"customer": "my_customer"}
+        yield from self.read(partial(self._api_get, resource="groups"), params=params)
+
+
+class GroupMembersAPI(StreamAPI):
+    def process_response(self, response: Dict) -> Iterator[dict]:
+        return response.get("members", [])
+
+    def list(self, fields: Sequence[str] = None) -> Iterator[dict]:
+        groups = GroupsAPI(self._api)
+        for group in groups.list():
+            params = {"groupKey": group["id"]}
+            yield from self.read(partial(self._api_get, resource="members"), params=params)

airbyte-source-google-directory-0.2.1/source_google_directory/client.py

@@ -0,0 +1,49 @@
+#
+# Copyright (c) 2023 Airbyte, Inc., all rights reserved.
+#
+
+
+from typing import Any, Generator, Mapping, Tuple
+
+from airbyte_cdk.models import AirbyteStream
+from airbyte_cdk.sources.deprecated.client import BaseClient
+
+from .api import API, GroupMembersAPI, GroupsAPI, UsersAPI
+
+
+class Client(BaseClient):
+    def __init__(self, credentials: Mapping[str, Any] = None, credentials_json: str = None, email: str = None):
+        # supporting old config format
+        if not credentials:
+            credentials = {"credentials_json": credentials_json, "email": email}
+        self._api = API(credentials)
+        self._apis = {"users": UsersAPI(self._api), "groups": GroupsAPI(self._api), "group_members": GroupMembersAPI(self._api)}
+        super().__init__()
+
+    def get_stream_state(self, name: str) -> Any:
+        pass
+
+    def set_stream_state(self, name: str, state: Any):
+        pass
+
+    def _enumerate_methods(self) -> Mapping[str, callable]:
+        return {name: api.list for name, api in self._apis.items()}
+
+    def health_check(self) -> Tuple[bool, str]:
+        alive = True
+        error_msg = None
+
+        try:
+            params = {"customer": "my_customer"}
+            self._api.get(name="users", params=params)
+        except Exception as error:
+            alive = False
+            error_msg = repr(error)
+
+        return alive, error_msg
+
+    @property
+    def streams(self) -> Generator[AirbyteStream, None, None]:
+        for stream in super().streams:
+            stream.source_defined_primary_key = [["id"]]
+            yield stream

airbyte-source-google-directory-0.2.1/source_google_directory/run.py

@@ -0,0 +1,14 @@
+#
+# Copyright (c) 2023 Airbyte, Inc., all rights reserved.
+#
+
+
+import sys
+
+from airbyte_cdk.entrypoint import launch
+from source_google_directory import SourceGoogleDirectory
+
+
+def run():
+    source = SourceGoogleDirectory()
+    launch(source, sys.argv[1:])

airbyte-source-google-directory-0.2.1/source_google_directory/schemas/group_members.json

@@ -0,0 +1,27 @@
+{
+  "$schema": "http://json-schema.org/draft-07/schema#",
+  "type": "object",
+  "properties": {
+    "kind": {
+      "type": ["null", "string"]
+    },
+    "id": {
+      "type": ["null", "string"]
+    },
+    "email": {
+      "type": ["null", "string"]
+    },
+    "role": {
+      "type": ["null", "string"]
+    },
+    "type": {
+      "type": ["null", "string"]
+    },
+    "etag": {
+      "type": ["null", "string"]
+    },
+    "status": {
+      "type": ["null", "string"]
+    }
+  }
+}

airbyte-source-google-directory-0.2.1/source_google_directory/schemas/groups.json

@@ -0,0 +1,42 @@
+{
+  "$schema": "http://json-schema.org/draft-07/schema#",
+  "type": "object",
+  "properties": {
+    "kind": {
+      "type": ["null", "string"]
+    },
+    "id": {
+      "type": ["null", "string"]
+    },
+    "etag": {
+      "type": ["null", "string"]
+    },
+    "email": {
+      "type": ["null", "string"]
+    },
+    "name": {
+      "type": ["null", "string"]
+    },
+    "directMembersCount": {
+      "type": ["null", "string"]
+    },
+    "description": {
+      "type": ["null", "string"]
+    },
+    "adminCreated": {
+      "type": ["null", "boolean"]
+    },
+    "aliases": {
+      "type": ["null", "array"],
+      "items": {
+        "type": ["null", "string"]
+      }
+    },
+    "nonEditableAliases": {
+      "type": ["null", "array"],
+      "items": {
+        "type": ["null", "string"]
+      }
+    }
+  }
+}

airbyte-source-google-directory-0.2.1/source_google_directory/schemas/users.json

@@ -0,0 +1,294 @@
+{
+  "$schema": "http://json-schema.org/draft-07/schema#",
+  "type": "object",
+  "properties": {
+    "kind": {
+      "type": ["null", "string"]
+    },
+    "id": {
+      "type": ["null", "string"]
+    },
+    "username": {
+      "type": ["null", "string"]
+    },
+    "name": {
+      "type": ["null", "object"],
+      "properties": {
+        "givenName": {
+          "type": ["null", "string"]
+        },
+        "familyName": {
+          "type": ["null", "string"]
+        },
+        "fullName": {
+          "type": ["null", "string"]
+        }
+      }
+    },
+    "isAdmin": {
+      "type": ["null", "boolean"]
+    },
+    "isDelegatedAdmin": {
+      "type": ["null", "boolean"]
+    },
+    "lastLoginTime": {
+      "type": ["null", "string"]
+    },
+    "creationTime": {
+      "type": ["null", "string"]
+    },
+    "agreedToTerms": {
+      "type": ["null", "boolean"]
+    },
+    "hashFunction": {
+      "type": ["null", "string"]
+    },
+    "suspended": {
+      "type": ["null", "boolean"]
+    },
+    "changePasswordAtNextLogin": {
+      "type": ["null", "boolean"]
+    },
+    "ipWhitelisted": {
+      "type": ["null", "boolean"]
+    },
+    "emails": {
+      "type": ["null", "array"],
+      "items": {
+        "type": "object",
+        "properties": {
+          "address": {
+            "type": ["null", "string"]
+          },
+          "type": {
+            "type": ["null", "string"]
+          },
+          "customType": {
+            "type": ["null", "string"]
+          },
+          "primary": {
+            "type": ["null", "boolean"]
+          }
+        }
+      }
+    },
+    "externalIds": {
+      "type": ["null", "array"],
+      "items": {
+        "type": "object",
+        "properties": {
+          "value": {
+            "type": ["null", "string"]
+          },
+          "type": {
+            "type": ["null", "string"]
+          },
+          "customType": {
+            "type": ["null", "string"]
+          }
+        }
+      }
+    },
+    "relations": {
+      "type": ["null", "array"],
+      "items": {
+        "type": "object",
+        "properties": {
+          "value": {
+            "type": ["null", "string"]
+          },
+          "type": {
+            "type": ["null", "string"]
+          },
+          "customType": {
+            "type": ["null", "string"]
+          }
+        }
+      }
+    },
+    "organizations": {
+      "type": ["null", "array"],
+      "items": {
+        "type": "object",
+        "properties": {
+          "name": {
+            "type": ["null", "string"]
+          },
+          "title": {
+            "type": ["null", "string"]
+          },
+          "primary": {
+            "type": ["null", "boolean"]
+          },
+          "customType": {
+            "type": ["null", "string"]
+          },
+          "description": {
+            "type": ["null", "string"]
+          }
+        }
+      }
+    },
+    "phones": {
+      "type": ["null", "array"],
+      "items": {
+        "type": "object",
+        "properties": {
+          "value": {
+            "type": ["null", "string"]
+          },
+          "type": {
+            "type": ["null", "string"]
+          }
+        }
+      }
+    },
+    "aliases": {
+      "type": ["null", "array"],
+      "items": {
+        "type": ["null", "string"]
+      }
+    },
+    "nonEditableAliases": {
+      "type": ["null", "array"],
+      "items": {
+        "type": ["null", "string"]
+      }
+    },
+    "customerId": {
+      "type": ["null", "string"]
+    },
+    "orgUnitPath": {
+      "type": ["null", "string"]
+    },
+    "isMailboxSetup": {
+      "type": ["null", "boolean"]
+    },
+    "includeInGlobalAddressList": {
+      "type": ["null", "boolean"]
+    },
+    "etag": {
+      "type": ["null", "string"]
+    },
+    "languages": {
+      "type": ["null", "array"],
+      "items": {
+        "type": ["null", "object"],
+        "properties": {
+          "languageCode": {
+            "type": ["null", "string"]
+          },
+          "preference": {
+            "type": ["null", "string"]
+          }
+        }
+      }
+    },
+    "isEnforcedIn2Sv": {
+      "type": ["null", "boolean"]
+    },
+    "isEnrolledIn2Sv": {
+      "type": ["null", "boolean"]
+    },
+    "archived": {
+      "type": ["null", "boolean"]
+    },
+    "primaryEmail": {
+      "type": ["null", "string"]
+    },
+    "suspensionReason": {
+      "type": ["null", "string"]
+    },
+    "locations": {
+      "type": ["null", "array"],
+      "items": {
+        "type": ["null", "object"],
+        "properties": {
+          "area": {
+            "type": ["null", "string"]
+          },
+          "buildingId": {
+            "type": ["null", "string"]
+          },
+          "type": {
+            "type": ["null", "string"]
+          }
+        }
+      }
+    },
+    "thumbnailPhotoEtag": {
+      "type": ["null", "string"]
+    },
+    "thumbnailPhotoUrl": {
+      "type": ["null", "string"]
+    },
+    "addresses": {
+      "type": ["null", "array"],
+      "items": {
+        "type": ["null", "object"],
+        "properties": {
+          "formatted": {
+            "type": ["null", "string"]
+          },
+          "type": {
+            "type": ["null", "string"]
+          }
+        }
+      }
+    },
+    "recoveryPhone": {
+      "type": ["null", "string"]
+    },
+    "recoveryEmail": {
+      "type": ["null", "string"]
+    },
+    "gender": {
+      "type": ["null", "object"],
+      "properties": {
+        "type": {
+          "type": ["null", "string"]
+        }
+      }
+    },
+    "sshPublicKeys": {
+      "type": ["null", "array"],
+      "items": {
+        "type": ["null", "object"],
+        "properties": {
+          "expirationTimeUsec": {
+            "type": ["null", "string"]
+          },
+          "fingerprint": {
+            "type": ["null", "string"]
+          },
+          "key": {
+            "type": ["null", "string"]
+          }
+        }
+      }
+    },
+    "posixAccounts": {
+      "gid": {
+        "type": ["null", "string"]
+      },
+      "homeDirectory": {
+        "type": ["null", "string"]
+      },
+      "operatingSystemType": {
+        "type": ["null", "string"]
+      },
+      "primary": {
+        "type": ["null", "boolean"]
+      },
+      "systemId": {
+        "type": ["null", "string"]
+      },
+      "uid": {
+        "type": ["null", "string"]
+      },
+      "username": {
+        "type": ["null", "string"]
+      }
+    }
+  }
+}

airbyte-source-google-directory-0.2.1/source_google_directory/source.py

@@ -0,0 +1,12 @@
+#
+# Copyright (c) 2023 Airbyte, Inc., all rights reserved.
+#
+
+
+from airbyte_cdk.sources.deprecated.base_source import BaseSource
+
+from .client import Client
+
+
+class SourceGoogleDirectory(BaseSource):
+    client_class = Client

airbyte-source-google-directory-0.2.1/source_google_directory/spec.json

@@ -0,0 +1,78 @@
+{
+  "documentationUrl": "https://docs.airbyte.com/integrations/sources/google-directory",
+  "connectionSpecification": {
+    "$schema": "http://json-schema.org/draft-07/schema#",
+    "title": "Google Directory Spec",
+    "type": "object",
+    "required": [],
+    "additionalProperties": true,
+    "properties": {
+      "credentials": {
+        "title": "Google Credentials",
+        "description": "Google APIs use the OAuth 2.0 protocol for authentication and authorization. The Source supports <a href=\"https://developers.google.com/identity/protocols/oauth2#webserver\" target=\"_blank\">Web server application</a> and <a href=\"https://developers.google.com/identity/protocols/oauth2#serviceaccount\" target=\"_blank\">Service accounts</a> scenarios.",
+        "type": "object",
+        "oneOf": [
+          {
+            "title": "Sign in via Google (OAuth)",
+            "description": "For these scenario user only needs to give permission to read Google Directory data.",
+            "type": "object",
+            "required": ["client_id", "client_secret", "refresh_token"],
+            "properties": {
+              "credentials_title": {
+                "type": "string",
+                "title": "Credentials Title",
+                "description": "Authentication Scenario",
+                "const": "Web server app",
+                "order": 0
+              },
+              "client_id": {
+                "title": "Client ID",
+                "type": "string",
+                "description": "The Client ID of the developer application.",
+                "airbyte_secret": true
+              },
+              "client_secret": {
+                "title": "Client secret",
+                "type": "string",
+                "description": "The Client Secret of the developer application.",
+                "airbyte_secret": true
+              },
+              "refresh_token": {
+                "title": "Refresh Token",
+                "type": "string",
+                "description": "The Token for obtaining a new access token.",
+                "airbyte_secret": true
+              }
+            }
+          },
+          {
+            "title": "Service Account Key",
+            "description": "For these scenario user should obtain service account's credentials from the Google API Console and provide delegated email.",
+            "type": "object",
+            "required": ["credentials_json", "email"],
+            "properties": {
+              "credentials_title": {
+                "type": "string",
+                "title": "Credentials Title",
+                "description": "Authentication Scenario",
+                "const": "Service accounts",
+                "order": 0
+              },
+              "credentials_json": {
+                "type": "string",
+                "title": "Credentials JSON",
+                "description": "The contents of the JSON service account key. See the <a href=\"https://developers.google.com/admin-sdk/directory/v1/guides/delegation\">docs</a> for more information on how to generate this key.",
+                "airbyte_secret": true
+              },
+              "email": {
+                "type": "string",
+                "title": "Email",
+                "description": "The email of the user, which has permissions to access the Google Workspace Admin APIs."
+              }
+            }
+          }
+        ]
+      }
+    }
+  }
+}

airbyte-source-google-directory-0.2.1/source_google_directory/utils.py

@@ -0,0 +1,12 @@
+#
+# Copyright (c) 2023 Airbyte, Inc., all rights reserved.
+#
+
+
+def rate_limit_handling(error):
+    retried_cases = [
+        (403, "quotaExceeded"),
+        (429, "rateLimitExceeded"),
+    ]
+
+    return (error.resp.status, error.resp.reason) not in retried_cases