Skip to content

Create and manage Intake Runners

To begin creating and managing your Intake Runners via the STACKIT CLI, ensure you have the following in place:

The Intake Runner is the engine for your data ingestion. You must create an Intake Runner before you can create an Intake.

At first you need to determine the maximum throughput capacity your Intake Runner should be able to sustain across all its intakes. We provide hints on how to Plan your Intake Runner.

You establish the maximum throughput capacity for your Intake Runner by defining two parameters:

  • max-message-size-kib: The maximum size, in kibibytes, for a single message.
  • max-message-size-per-hour: The maximum number of messages the runner can process per hour.
  1. Open your project in the STACKIT Portal.

  2. Navigate to Data & AI > Intake.

  3. In sidebar, click on Intake Runners.

  4. In the topbar, click on Create Intake Runners.

  5. Fill in the fields:

    FieldDescriptionOptionsDefaultOptional
    Namea human readable name for the Intake RunnerString, not longer than 32 characters
    Max message sizethe maximum size for a single message in kibibytes, for a single messageInteger, between 1 and 1024. Product with max-messages-per-hour not allowed to exceed 20 GiB/h
    Max message rate (per h)the maximum number of messages that can be processed across all Intakes, per hourInteger, at least 1. Product with max-message-size-kib not allowed to exceed 20 GiB/h
    Descriptiona textual description of the Runner’s purposeString, not longer than 1024 characters""
  6. Click on Order feed-based.

  1. Open your project in the STACKIT Portal.
  2. Navigate to Data & AI > Intake.
  3. In sidebar, click on Intake Runners.

Now you can see the list of Intake Runners in your project.

  1. Open your project in the STACKIT Portal.
  2. Navigate to Data & AI > Intake.
  3. In sidebar, click on Intake Runners.
  4. Click on the Intake Runner you want to view.

Now you can see the details of the selected Intake Runner.

  1. Open your project in the STACKIT Portal.

  2. Navigate to Data & AI > Intake.

  3. In sidebar, click on Intake Runners.

  4. Click on the Intake Runner you want to update.

  5. In General Information, click on Edit.

  6. Update the fields you want to change:

    FieldDescriptionOptions
    Namea human readable name for the Intake RunnerString, not longer than 32 characters
    Max message sizethe maximum size for a single message in kibibytes, for a single messageInteger, between 1 and 1024. Product with max-messages-per-hour not allowed to exceed 20 GiB/h or to shrink.
    Max message rate (per h)the maximum number of messages that can be processed across all Intakes, per hourInteger, at least 1. Product with max-message-size-kib not allowed to exceed 20 GiB/h or to shrink.
    Descriptiona textual description of the Runner’s purposeString, not longer than 1024 characters
  7. Click on Save.

  1. Open your project in the STACKIT Portal.
  2. Navigate to Data & AI > Intake.
  3. In sidebar, click on Intake Runners.
  4. Click on the three dots to the right of the Intake Runner you created.
  5. Select Delete.
  6. Confirm the deletion by entering the Intake Runner name.
  7. Press Delete.

Deleting an Intake Runner is an irreversible operation. It will also delete all associated Intakes and Intake users.