Run it where
your work belongs.

One computer or a private server. The same clear boundary.

One machine. Your workspace.

For individual work, with the workspace and model running on the computer you use.

  1. Install the workspace

    Run the workspace on your computer and open its local address in your browser.

  2. Choose a local model

    Download a compatible open-weight model. Allow for download size, memory, and disk space.

  3. Create your first project

    Add selected files, set agent permissions, and try a short workflow before adding more work.

Start with a model
your hardware can hold.

Smaller models need less memory and are a practical place to begin. Larger models can need substantially more memory, especially with long documents or concurrent runs.

Estimated total memory planning ranges for 4-bit models, including room for the operating system. These are starting points, not supported-hardware guarantees.
Model sizePlanning rangeConsiderations
3–4B parameters8–12 GB memoryStart small; test short documents first.
7–8B parameters16–24 GB memoryLeave room for context and other applications.
13–14B parameters24–48 GB memoryPlan more headroom for longer context.
30–32B parameters48–64+ GB memoryAssess accelerator memory and speed carefully.
Memory use varies with model architecture, quantization, context length, and concurrency. Dedicated accelerator memory and system memory are not always interchangeable. Confirm the requirements of the specific model and runtime before buying hardware.

A few decisions
before you begin.

Allow time for the first download. Model weights can be several gigabytes. Installation and model downloads need network access, even when later inference runs locally.

Start with one run at a time. Increase concurrency after checking memory use. Keeping a model loaded reduces loading time but reserves memory between runs.

Own the server basics. For a private server, arrange authenticated access, encrypted connections, updates, and backups. Keep it on a private network unless you have configured and reviewed remote access.

Talk about your setup

Source material

Sample source material for this product walkthrough.