Apify Keboola Extractor

You can use it to connect data from Apify platform into Keboola platform.

Resources

• Apify/Keboola integration tutorial
• Apify component on Keboola page on Keboola developer platform
• Keboola documentation for developers
• Keboole API reference

---

Local Development

If you are interested in adding a new feature or fixing a bug in the integration, feel free to open a pull request.

Before you start developing this integration, you will need your Apify API token and user ID. You can find the token and user ID on the Integrations page of your Apify account.

Run Configuration

The run of integration depends on configuration. You can specify which action you want to run and its parameters in the configuration file config.json. On the Keboola platform, this config will be generated for each run based on user input. Base configuration:

{
  "action": "run",
  "parameters": {
    "actionType": "runActor",
    "userId": "myUserId",
    "#token": "myToken",
    "actorId": "my-user-name/actor",
    "input": {
      "pages": 1
    },
    "memory": "512",
    "build": "latest"
  }
}

With this configuration, you will run the actor with specific options. This folder contains all possible examples of configuration.

Run Action locally

1. Install dependencies npm i
2. Create empty data dir for input and output of action mkdir -p ./.temp/data
3. In data dir create config.json file and fill with an action you want to run cp ./test/configs/actor_run.json ./.temp/data/config.json
4. Run the action using npm run dev

Tests

There are integrations tests, which check each action if it works with the Apify platform as expected. You can run these tests with your Apify token and user ID. You can find the token and user ID on the Integrations page of your Apify account.

1. Install dependencies npm i
2. Run integration tests DATA_DIR=./data APIFY_TEST_TOKEN=<apify toke> npm run test

Release & Deploy

Only Apify team members can deploy new versions, and there is a document in Notion on how to do it.