Connect to an AWS S3 Bucket

Overview

By default, buckets that use the s3:// URI scheme, will be redirected to the STACKIT Object Storage service. This guide explains how to configure a Dremio S3 source to point at a custom HTTP endpoint (including AWS’ native endpoints).

Prerequisites

• You have a STACKIT Dremio instance
• You have an AWS S3 Bucket with a dataset
• You have valid credentials for the AWS S3 buckets
• You know the AWS region where the S3 bucket has been created

Step-by-Step configuration

1. Log into Dremio and head over to the Datasets menu

   

2. Click “Add Source”

3. Scroll down and choose “S3”

   

4. In “General”, configure the following

   • Name: choose an arbitrary you can use to refer to this source later
   • Authentication: choose the adequate Authentication type, depending on your use case
   • Add Bucket: Click and add the name of the bucket you want Dremio to connect to

5. In “Advanced Options”:

   Under “Connection Properties”, click “Add property” and configure the key fs.s3a.endpoint with the value s3.<aws-region>.amazonaws.com where aws-region corresponds to the AWS Region where the bucket has been created.

6. Click save. The source is now available for querying.