Menu

Private AI Infrastructure

You don't have to pick an AI model. We set up the right mix.

Not every task needs ChatGPT, or a server in your office. Cortex sends routine work to private models, uses simple rules where AI isn't needed, and calls a cloud model only when the job needs one.

Three ways to run it

We decide this after we've seen the work. Hardware is a workload decision, not a line item we add so the proposal looks heavier.

Cloud

Fast to start. Fine for many first deployments, two follow-up paths, a morning summary, no collision files leaving the building. You do not need a server room on day one.

Private / local

Dedicated hardware you own or control. More privacy for customer and job files, more predictable cost for work that runs every night whether anyone is in the building.

Hybrid

Usually the practical answer. Local for the overnight watch and the briefing. Cloud when a job needs more. Rules when a model is not needed at all.

How we decide where a job runs

Classify the work. Put continuous jobs where cost is stable. Keep sensitive records closer to the shop when it matters. Connect the same way we always connect.

  1. 01

    Sort the work, not the vendor

    Every task is one of three things: a simple rule (“repair order older than three days, no note”), a small writing task (draft the morning briefing), or a hard task (a messy email that needs a stronger model). Rules do not need AI. Small tasks can run locally. Hard ones can go to the cloud.

  2. 02

    Put continuous work where the cost is stable

    Overnight checks and morning briefings run whether anyone is in the building. Paying per use for cloud AI is a bad fit if it is the same job every night. Dedicated hardware you control makes that cost predictable. Occasional hard work (a tough customer email at 2pm) can still use a capable cloud model.

  3. 03

    Keep sensitive records closer to the shop when it matters

    Customer names, repair order notes, collision files, invoices. Some owners do not want that leaving the building for a routine check. Private or hybrid setups keep more of that data on hardware they own. Details depend on each setup. We do not pretend every company needs a server rack.

  4. 04

    Connect the same way we always connect

    APIs, approved integrations, webhooks. For Detail Driven, collision data came through a local CCC ONE EMS export, files CCC already knows how to create. We do not scrape private databases to make a privacy story true.

Why we do it this way

Sending every ticket to the largest cloud model is how you buy a surprising invoice and a privacy argument.

  1. 01

    Not every task needs the same model

    Sending every ticket to the biggest cloud model is how you get a surprise bill and a privacy argument. Match the model to the task, because the work is not all the same.

  2. 02

    Private hardware is not a status symbol

    A server room does not make the company serious. It is the right answer when privacy, round-the-clock workload, or cost call for it. Plenty of first builds start in the cloud. The audit says which.

  3. 03

    Hybrid is usually the practical answer

    Local for the overnight checks and the briefing. Cloud when a job needs more. Rules when AI is not needed at all. Designed around your work, not around an AI company’s keynote.

Infrastructure

Cloud, private, or hybrid, routed per job.

Routine work can stay on hardware you control. Hard reasoning can still call a cloud model. Rules when AI is not needed at all.

cortex@infra · router
local.mdcloud.mdrules.mdrouter.log
$ █

without cortex · someone still has to remember to look

with cortex · the layer watches, drafts, and waits for you

What this looks like when it is real

Detail Driven runs dedicated Linux on site. We also tell operators when a rack would be theatre.

Detail Driven · infrastructure

Dedicated Linux on site. Cloud when the job actually needs it.

The problem
Four shop types, customer files, collision estimates, ads, and books. A nightly check and a morning briefing that should not depend on whether a cloud provider is having a bad week. Collision files the owner did not want treated like a public demo.
What we build
Dedicated Linux hardware they control. Local models for the overnight checks and the morning briefing. Cloud models when a job needs more. CCC via a local EMS export. The dashboard runs on that same setup. We do not publish a photograph of the rack. The point is ownership.
Why this way
Routine AI work does not have to leave the building. Occasional hard tasks can. That split is the whole case for private AI, not “we are more secure because we said the word local.”

When we tell you not to buy hardware

Two follow-up workflows do not need a server rack.

The problem
A single HVAC or plumbing company, first build, two workflows, no collision files, no reporting across several companies. The missed follow-up is real. The volume does not need AI hardware running 24/7.
What we build
Cloud to start. Same permissions, same logs, same off switch. If workload, privacy, or cost later call for private hardware, we design it then. We do not sell you a box so the proposal looks bigger.
Why this way
Hardware depends on the workload. Selling it on day one to every owner is how consultants pad a proposal.

What private hardware is actually for

We design the architecture around privacy, performance, reliability, and cost, not around a specific model provider.

Greater control

More of the stack sits on infrastructure you own. Routine inference does not have to leave the building.

Privacy options

Sensitive records can stay closer to the shop. Collision files and RO notes are not a public demo.

Predictable cost

Reduce variable inference costs for high-volume, every-night workloads. Burst jobs can still call the cloud.

Still hybrid when needed

A hard reasoning job can still go to a capable cloud model. Private does not mean nothing ever leaves.

Questions operators actually ask

Do we need our own AI server?

No. Many companies start in the cloud. A private server is an option when privacy, cost, or control make it the better fit. The audit says which.

Does private mean nothing ever goes to the cloud?

No. Hybrid is common. Routine jobs stay local. A hard reasoning job can still go to a capable cloud model. You decide what is allowed to leave.

Is my company data used to train a public model?

Agents only see the systems and records you approve. Private or hybrid setups keep more of the work on systems you control. Training policy is set per build. By default, we do not train a public model on your repair orders.

The audit includes the infrastructure question.

Cloud, private, or mixed. We'll say which fits your workloads, privacy needs, and cost.