apify 1.0.0b3__py3-none-any.whl → 1.0.0b5__py3-none-any.whl
This diff represents the content of publicly available package versions that have been released to one of the supported registries. The information contained in this diff is provided for informational purposes only and reflects changes between package versions as they appear in their respective public registries.
Potentially problematic release.
This version of apify might be problematic. Click here for more details.
- apify/_version.py +1 -1
- {apify-1.0.0b3.dist-info → apify-1.0.0b5.dist-info}/METADATA +39 -58
- {apify-1.0.0b3.dist-info → apify-1.0.0b5.dist-info}/RECORD +6 -6
- {apify-1.0.0b3.dist-info → apify-1.0.0b5.dist-info}/LICENSE +0 -0
- {apify-1.0.0b3.dist-info → apify-1.0.0b5.dist-info}/WHEEL +0 -0
- {apify-1.0.0b3.dist-info → apify-1.0.0b5.dist-info}/top_level.txt +0 -0
apify/_version.py
CHANGED
|
@@ -1 +1 @@
|
|
|
1
|
-
__version__ = '1.0.
|
|
1
|
+
__version__ = '1.0.0b5'
|
|
@@ -1,6 +1,6 @@
|
|
|
1
1
|
Metadata-Version: 2.1
|
|
2
2
|
Name: apify
|
|
3
|
-
Version: 1.0.
|
|
3
|
+
Version: 1.0.0b5
|
|
4
4
|
Summary: Apify SDK for Python
|
|
5
5
|
Home-page: https://github.com/apify/apify-sdk-python
|
|
6
6
|
Author: Apify Technologies s.r.o.
|
|
@@ -75,76 +75,57 @@ It provides useful features like actor lifecycle management, local storage emula
|
|
|
75
75
|
If you just need to access the [Apify API](https://docs.apify.com/api/v2) from your Python applications,
|
|
76
76
|
check out the [Apify Client for Python](https://docs.apify.com/api/client/python) instead.
|
|
77
77
|
|
|
78
|
-
##
|
|
78
|
+
## Documentation
|
|
79
79
|
|
|
80
|
-
|
|
80
|
+
For usage instructions, check the documentation on [Apify Docs](https://docs.apify.com/sdk/python/).
|
|
81
81
|
|
|
82
|
-
|
|
83
|
-
To do that, simply run `pip install apify` in your terminal.
|
|
82
|
+
## Example
|
|
84
83
|
|
|
85
|
-
|
|
84
|
+
```python
|
|
85
|
+
from apify import Actor
|
|
86
|
+
from bs4 import BeautifulSoup
|
|
87
|
+
import requests
|
|
86
88
|
|
|
87
|
-
|
|
88
|
-
|
|
89
|
-
|
|
90
|
-
|
|
91
|
-
|
|
92
|
-
|
|
93
|
-
For local development, it is required to have Python 3.8 installed.
|
|
94
|
-
|
|
95
|
-
It is recommended to set up a virtual environment while developing this package to isolate your development environment,
|
|
96
|
-
however, due to the many varied ways Python can be installed and virtual environments can be set up,
|
|
97
|
-
this is left up to the developers to do themselves.
|
|
98
|
-
|
|
99
|
-
One recommended way is with the built-in `venv` module:
|
|
100
|
-
|
|
101
|
-
```bash
|
|
102
|
-
python3 -m venv .venv
|
|
103
|
-
source .venv/bin/activate
|
|
89
|
+
async def main():
|
|
90
|
+
async with Actor:
|
|
91
|
+
response = requests.get('https://apify.com')
|
|
92
|
+
soup = BeautifulSoup(response.content, 'html.parser')
|
|
93
|
+
await Actor.push_data({ 'url': url, 'title': soup.title.string })
|
|
104
94
|
```
|
|
105
95
|
|
|
106
|
-
|
|
107
|
-
and [direnv](https://github.com/direnv/direnv) to automatically activate/deactivate the environment when you enter/exit the project folder.
|
|
108
|
-
|
|
109
|
-
### Dependencies
|
|
110
|
-
|
|
111
|
-
To install this package and its development dependencies, run `make install-dev`
|
|
112
|
-
|
|
113
|
-
### Formatting
|
|
114
|
-
|
|
115
|
-
We use `autopep8` and `isort` to automatically format the code to a common format. To run the formatting, just run `make format`.
|
|
116
|
-
|
|
117
|
-
### Linting, type-checking and unit testing
|
|
118
|
-
|
|
119
|
-
We use `flake8` for linting, `mypy` for type checking and `pytest` for unit testing. To run these tools, just run `make check-code`.
|
|
120
|
-
|
|
121
|
-
### Integration tests
|
|
96
|
+
## What are Actors?
|
|
122
97
|
|
|
123
|
-
|
|
124
|
-
|
|
125
|
-
and
|
|
98
|
+
Actors are serverless cloud programs that can do almost anything a human can do in a web browser.
|
|
99
|
+
They can do anything from small tasks such as filling in forms or unsubscribing from online services,
|
|
100
|
+
all the way up to scraping and processing vast numbers of web pages.
|
|
126
101
|
|
|
127
|
-
|
|
128
|
-
you
|
|
102
|
+
They can be run either locally, or on the [Apify platform](https://docs.apify.com/platform/),
|
|
103
|
+
where you can run them at scale, monitor them, schedule them, or publish and monetize them.
|
|
129
104
|
|
|
130
|
-
|
|
105
|
+
If you're new to Apify, learn [what is Apify](https://docs.apify.com/platform/about) in the Apify platform documentation.
|
|
131
106
|
|
|
132
|
-
|
|
133
|
-
We document every user-facing class or method, and enforce that using the flake8-docstrings library.
|
|
107
|
+
## Creating Actors
|
|
134
108
|
|
|
135
|
-
|
|
136
|
-
|
|
109
|
+
To create and run Actors through Apify Console,
|
|
110
|
+
see the [Console documentation](https://docs.apify.com/academy/getting-started/creating-actors#choose-your-template).
|
|
137
111
|
|
|
138
|
-
|
|
112
|
+
To create and run Python Actors locally, check the documentation for [how to create and run Python Actors locally](https://docs.apify.com/sdk/python/docs/overview/running-locally).
|
|
139
113
|
|
|
140
|
-
|
|
114
|
+
## Guides
|
|
141
115
|
|
|
142
|
-
|
|
143
|
-
|
|
116
|
+
To see how you can use the Apify SDK with other popular libraries used for web scraping,
|
|
117
|
+
check out our guides for using
|
|
118
|
+
[Requests and HTTPX](https://docs.apify.com/sdk/python/docs/guides/requests-and-httpx),
|
|
119
|
+
[Beautiful Soup](https://docs.apify.com/sdk/python/docs/guides/beautiful-soup),
|
|
120
|
+
[Playwright](https://docs.apify.com/sdk/python/docs/guides/playwright),
|
|
121
|
+
[Selenium](https://docs.apify.com/sdk/python/docs/guides/selenium),
|
|
122
|
+
or [Scrapy](https://docs.apify.com/sdk/python/docs/guides/scrapy).
|
|
144
123
|
|
|
145
|
-
|
|
124
|
+
## Usage concepts
|
|
146
125
|
|
|
147
|
-
|
|
148
|
-
|
|
149
|
-
|
|
150
|
-
|
|
126
|
+
To learn more about the features of the Apify SDK and how to use them,
|
|
127
|
+
check out the Usage Concepts section in the sidebar,
|
|
128
|
+
particularly the guides for the [Actor lifecycle](https://docs.apify.com/sdk/python/docs/concepts/actor-lifecycle),
|
|
129
|
+
[working with storages](https://docs.apify.com/sdk/python/docs/concepts/storages),
|
|
130
|
+
[handling Actor events](https://docs.apify.com/sdk/python/docs/concepts/actor-events)
|
|
131
|
+
or [how to use proxies](https://docs.apify.com/sdk/python/docs/concepts/proxy-management).
|
|
@@ -2,7 +2,7 @@ apify/__init__.py,sha256=5ReamWDeR2AYTdg3-rzJ6qDEpNWtrknZxW6n5uvEylY,244
|
|
|
2
2
|
apify/_crypto.py,sha256=KAopiLUY5fKNSs-O-VwvVNC9bpAvv3ronL8QGWtRYZc,5741
|
|
3
3
|
apify/_types.py,sha256=7EGjstUEY5jo9mTxWs98BB9icDRgI74swZoQJnaij-E,405
|
|
4
4
|
apify/_utils.py,sha256=WgtPphrl87k7YP5ApIF0yeF8-E3iN18iJ7Maddawi34,15554
|
|
5
|
-
apify/_version.py,sha256=
|
|
5
|
+
apify/_version.py,sha256=Q5b_p6btYINem9C9yEEY4s4HB2jC42Td2-ylSsoXVhg,23
|
|
6
6
|
apify/actor.py,sha256=UK8asEhHofZkcyt88PVsU14uQH8oJA2p_A4ZsHyjkPo,57957
|
|
7
7
|
apify/config.py,sha256=7r1sa0WPnxZ6JksOMSqrdtB2bCwV5M8LHXKOeOSeeLs,8717
|
|
8
8
|
apify/consts.py,sha256=3oSTGlW2GBIhLpxG8RBaYm63g0yOCDEi6flmthW4l8k,7045
|
|
@@ -28,8 +28,8 @@ apify/storages/dataset.py,sha256=b6ygo1Oi8W_8KyfXaYUCpLTEV4YP2XxlBTu9L9e6izU,233
|
|
|
28
28
|
apify/storages/key_value_store.py,sha256=Kn_NfX53AZEFJ7UogDGecHspi-3oPkNNipl-7UiBJzE,10102
|
|
29
29
|
apify/storages/request_queue.py,sha256=LxqzIvpuVAsUryT_uXmu8M8YrtBL9nN4nRD1iyRgGF8,25732
|
|
30
30
|
apify/storages/storage_client_manager.py,sha256=A3BNgHZ51p5gIAZ1bYNmsHsNwxHqpJp0iBPwF_wibhs,2214
|
|
31
|
-
apify-1.0.
|
|
32
|
-
apify-1.0.
|
|
33
|
-
apify-1.0.
|
|
34
|
-
apify-1.0.
|
|
35
|
-
apify-1.0.
|
|
31
|
+
apify-1.0.0b5.dist-info/LICENSE,sha256=_yIHo4TZezG4fMaWG1Er6OH7DW7MiZI-KO4dnONASZI,11355
|
|
32
|
+
apify-1.0.0b5.dist-info/METADATA,sha256=-G4207u__6-FkKcBIq8X99YZal206AmjSKz0-hBSYjU,6126
|
|
33
|
+
apify-1.0.0b5.dist-info/WHEEL,sha256=2wepM1nk4DS4eFpYrW1TTqPcoGNfHhhO_i5m4cOimbo,92
|
|
34
|
+
apify-1.0.0b5.dist-info/top_level.txt,sha256=2oFNsHggn5m_rCaaP7xijQg_-Va2ByOSYuvKgACsS5w,6
|
|
35
|
+
apify-1.0.0b5.dist-info/RECORD,,
|
|
File without changes
|
|
File without changes
|
|
File without changes
|