Inferyes holds the document, prompt or parameters you send for as long as it takes to run your request, hands you the result once, and keeps neither. Below is what that means precisely, how to check it, and what we are not claiming.
We hold it
The document, the prompt or the operation's parameters are kept in the database for as long as a run needs them — in the case of a document, until the text has been extracted and the steps that read it have run.
We run it
The request goes to a language model on our own self-hosted, on-premises inference servers. That is the only system outside this gateway that sees your content, and it sees it in order to answer.
We hand it back, and clear it
The result is delivered once: in the response to a synchronous call, or through GET /api/v1/runs/:id/output, which is an acknowledged fetch
— taking the output is what clears it. An output nobody collects is cleared an hour
after the run ends. The input is cleared the moment the run reaches a final state.
Kept
Not kept
GET /api/v1/runs/:id
— a finished run whose output you already took answers with an empty
output
and an output_cleared_at
timestamp, so it is distinguishable from a run that produced nothing.
POST /api/v1/runs/:id/cancel
— a cancelled run gives up its input on the spot.
The gateway's routes are in the documentation, and the service's current numbers are on the overview.