> ## Documentation Index
> Fetch the complete documentation index at: https://docs.mirage.strukto.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# MinIO

> Virtualize a self-hosted MinIO bucket from Node or the browser.

`MinIOVFS` mounts one bucket on a self-hosted MinIO server: every object becomes
a file and every `/` in a key a folder. It reaches MinIO through its S3 API.
Set up credentials as in [MinIO setup](https://docs.mirage.strukto.ai/home/setup/minio.md).

## Install

```bash theme={null}
npm install @struktoai/mirage-node
```

## Configure

```ts theme={null}
import { MinIOVFS, MountMode, Workspace } from '@struktoai/mirage-node'

const minio = new MinIOVFS({
  bucket: process.env.MINIO_BUCKET!,
  endpoint: process.env.MINIO_ENDPOINT!,
  accessKeyId: process.env.MINIO_ACCESS_KEY!,
  secretAccessKey: process.env.MINIO_SECRET_KEY!,
})
const ws = new Workspace({ '/minio': minio }, { mode: MountMode.WRITE })

const result = await ws.shell("ls /minio && find /minio -name '*.csv'")
console.log(result.stdoutText)
await ws.close()
```

`endpoint` is required, since the server is self-hosted. `region` defaults to
`us-east-1`. A mount takes `MountMode.READ`, `WRITE` or `EXEC`.

### Fields

**bucket** `string` *required*

Name of the bucket to mount.

**accessKeyId** `string`

Access key ID; set it with `secretAccessKey`. Unset uses the AWS SDK credential chain.

**secretAccessKey** `string`

Secret access key paired with `accessKeyId`.

**sessionToken** `string`

Session token for temporary credentials, sent with the access key pair.

**profile** `string`

Named profile in the shared AWS config and credentials files that supplies credentials when no access key pair is given.

**forcePathStyle** `boolean` (default: true)

Address the bucket in the URL path (`<endpoint>/<bucket>/<key>`) instead of as a subdomain of the endpoint.

**keyPrefix** `string`

Key prefix inside the bucket that the mount treats as its root; keys outside it are not visible. Leading slashes are dropped and a trailing `/` is added.

**timeout** `number` (default: DEFAULT\_TIMEOUT)

Seconds a request may wait to connect, or between two reads of its answer, before it fails; a download that keeps flowing is never cut off.

**proxy** `string`

Proxy URL for every HTTP and HTTPS request to the endpoint.

**region** `string` (default: 'us-east-1')

Region requests are signed for; the gateway's endpoint does not depend on it.

**endpoint** `string` *required*

URL of the self-hosted S3 gateway, such as `http://localhost:9000`.

Fields marked secret are redacted in snapshots.

## Authentication

Credentials come from `accessKeyId` and `secretAccessKey`, a MinIO access key,
with `sessionToken` for temporary credentials. Without them, the AWS SDK reads
its own chain: environment variables, `~/.aws/credentials`, then the instance or
container role.

The key inherits its user's policies: `readonly` to read, `readwrite` to write.
A request the credentials may not make answers `Permission denied`.

## Layout

```text theme={null}
/minio/
  data/
    config.json
    file.txt
  reports/
    q1.csv
    q2.csv
```

`/minio/data/file.txt` is the key `data/file.txt`. Folders come from the `/` in
keys; MinIO stores no folder objects.

## Behavior

* **Key prefix:** `keyPrefix: 'users/42/'` mounts only that part of the bucket,
  so `/minio/notes.md` is the key `users/42/notes.md`.
* **Conditional writes:** MinIO ignores copy and delete conditions, so under
  `write: conditional` Mirage refuses a `cp` or `mv` within the mount, a `mv`
  out of it, `rm` and `find -delete` (`ENOTSUP`); a `cp` or `mv` into it from
  another mount is a write and goes through. See
  [S3-compatible VFSes](https://docs.mirage.strukto.ai/home/setup/s3.md#s3-compatible-vfses).

## Browser

The browser `MinIOVFS` from `@struktoai/mirage-browser` keeps credentials off
the page: a server signs a URL for each S3 call with the MinIO keys, and the
browser fetches it.

```bash theme={null}
npm install @struktoai/mirage-browser
```

```ts theme={null}
import { MinIOVFS, MountMode, Workspace } from '@struktoai/mirage-browser'

const minio = new MinIOVFS({
  bucket: 'my-bucket',
  presignedUrlProvider: async (path, op, opts) => {
    const r = await fetch('/presign', {
      method: 'POST',
      headers: { 'Content-Type': 'application/json' },
      body: JSON.stringify({ path, op, opts }),
    })
    return ((await r.json()) as { url: string }).url
  },
})
const ws = new Workspace({ '/minio': minio }, { mode: MountMode.READ })
```

* MinIO answers CORS for every origin by default. To restrict it, set
  `MINIO_API_CORS_ALLOW_ORIGIN=http://localhost:5173,https://app.example.com` on
  the server and restart it.
* A browser mount cannot declare `write: conditional`, and any HTTP 403 from a
  signed URL, an expired one included, answers `Permission denied`.
* `keyPrefix` set in the browser is no security boundary: enforce the prefix in
  the signing server.
* `endpoint` only names the mount's storage location: requests go to the host
  each signed URL names.

> [accordion] Signing server
>
> An Express route that signs URLs:
>
> ```ts theme={null}
> import {
>   CopyObjectCommand,
>   DeleteObjectCommand,
>   GetObjectCommand,
>   HeadObjectCommand,
>   ListObjectsV2Command,
>   PutObjectCommand,
>   S3Client,
> } from '@aws-sdk/client-s3'
> import { getSignedUrl } from '@aws-sdk/s3-request-presigner'
>
> const client = new S3Client({
>   region: 'us-east-1',
>   endpoint: process.env.MINIO_ENDPOINT,
>   forcePathStyle: true,
>   credentials: {
>     accessKeyId: process.env.MINIO_ACCESS_KEY!,
>     secretAccessKey: process.env.MINIO_SECRET_KEY!,
>   },
> })
> const BUCKET = process.env.MINIO_BUCKET!
>
> app.post('/presign', async (req, res) => {
>   const { path, op, opts } = req.body as {
>     path: string
>     op: 'GET' | 'PUT' | 'HEAD' | 'DELETE' | 'LIST' | 'COPY'
>     opts?: Record<string, unknown>
>   }
>   const key = path.replace(/^\/+/, '')
>   const ttl = typeof opts?.ttlSec === 'number' ? opts.ttlSec : 300
>   let cmd
>   switch (op) {
>     case 'GET':    cmd = new GetObjectCommand({ Bucket: BUCKET, Key: key }); break
>     case 'PUT':    cmd = new PutObjectCommand({ Bucket: BUCKET, Key: key, ContentType: opts?.contentType as string | undefined }); break
>     case 'HEAD':   cmd = new HeadObjectCommand({ Bucket: BUCKET, Key: key }); break
>     case 'DELETE': cmd = new DeleteObjectCommand({ Bucket: BUCKET, Key: key }); break
>     case 'LIST':   cmd = new ListObjectsV2Command({
>       Bucket: BUCKET,
>       Prefix: opts?.listPrefix as string | undefined,
>       Delimiter: opts?.listDelimiter as string | undefined,
>       ContinuationToken: opts?.listContinuationToken as string | undefined,
>     }); break
>     case 'COPY':   cmd = new CopyObjectCommand({
>       Bucket: BUCKET,
>       Key: key,
>       CopySource: `${BUCKET}/${opts?.copySource as string}`,
>     }); break
>   }
>   const url = await getSignedUrl(client, cmd, { expiresIn: ttl })
>   res.json({ url })
> })
> ```
>
> MinIO uses path-style URLs, since virtual-hosted buckets need extra DNS setup on
> a self-hosted server.
>
> Sign only the operations the app needs: a viewer needs `GET`, `HEAD` and `LIST`.

> [accordion] Browser fields
>
> **bucket** `string` *required*
>
> Name of the bucket to mount.
>
> **presignedUrlProvider** `function` *required*
>
> Function `(path, operation, options)` that returns a signed URL for each S3 operation; your server signs it, so the browser holds no keys.
>
> **region** `string`
>
> Region of the bucket. Most providers derive the endpoint from it; requests go to the host each presigned URL names.
>
> **endpoint** `string`
>
> Endpoint URL that replaces the one the provider derives. Requests go to the host each presigned URL names; the mount uses it to name its storage location.
>
> **defaultContentType** `string` (default: 'application/octet-stream')
>
> `Content-Type` stored with every object the mount writes.
>
> **keyPrefix** `string`
>
> Key prefix the mount treats as its root. The browser can change it before a URL is signed, so enforce the prefix on the signing server.
>
> **timeout** `number` (default: DEFAULT\_TIMEOUT)
>
> Seconds a request may wait to connect, or between two reads of its answer, before it fails; a download that keeps flowing is never cut off.
>
> Fields marked secret are redacted in snapshots.

## Integration

MinIO answers these commands through its own API, so fewer objects are read. See
[Integration](https://docs.mirage.strukto.ai/home/integration/overview.md).

* `md5sum`: the object's ETag, when it is the MD5 (a single-part upload,
  unencrypted or under SSE-S3).
* `find`: one recursive listing.
* `du`: one recursive listing.
* `ls -R` and `tree`: one recursive listing.

## VFS.md

The [VFS.md](https://docs.mirage.strukto.ai/home/setup/vfs-md.md) an agent reads with MinIO mounted at `/<path>`.
`<mode>` is the mount's mode: `read`, `write` or `exec`. The commands shown are
those of a `write` mount.

> [tab] Rendered
>
> **Virtual Filesystem**
>
> | Path | Description |
> | - | - |
> | `/<path>` | `<mode>` |
>
> **Supported Unix Commands for VFS**
>
> Unix commands work on each path as on a local filesystem, as far as the path supports them:
>
> | Path | Supported |
> | - | - |
> | `/<path>` | Almost all Unix commands. |
>
> **Limitations of Unix Commands for VFS**
>
> Where a path differs from a local filesystem:
>
> | Path | Limitations |
> | - | - |
> | `/<path>` | `grep -r`, `find` and `du` stop after 1000 files; a glob matching more, `tar -c`, `cp -r` and `rm -r` are refused. |
>
> Run `man <cmd>` or `<cmd> --help` for one command's usage.

> [tab] Raw
>
> ```markdown theme={null}
> ---
> name: workspace-filesystem
> description: The virtual filesystem layout of this workspace.
> ---
>
> # Virtual Filesystem
>
> | Path | Description |
> | --- | --- |
> | `/<path>` | `<mode>` |
>
> ## Supported Unix Commands for VFS
>
> Unix commands work on each path as on a local filesystem, as far as the path supports them:
>
> | Path | Supported |
> | --- | --- |
> | `/<path>` | Almost all Unix commands. |
>
> ## Limitations of Unix Commands for VFS
>
> Where a path differs from a local filesystem:
>
> | Path | Limitations |
> | --- | --- |
> | `/<path>` | `grep -r`, `find` and `du` stop after 1000 files; a glob matching more, `tar -c`, `cp -r` and `rm -r` are refused. |
>
> Run `man <cmd>` or `<cmd> --help` for one command's usage.
> ```


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.