Local LLMs vs. cloud AI for document work
Acrylic
Compare where local LLMs and cloud AI run, what resources they use, and how Acrylic combines desktop document editing with cloud AI.
A document can be saved on your computer while an AI request is processed elsewhere. Where you store the file and where the model runs are separate questions.
That distinction helps explain the difference between local LLMs and cloud AI, especially when working with reports, spreadsheets, and presentations.
Where does the model run?
A large language model, or LLM, processes your request to generate a response. With a local LLM, that processing runs on your device. With a cloud model, it runs on a remote service.
| What changes | Cloud model | Local model |
|---|---|---|
| Where the request is processed | A remote service | Your device |
| Resources used to run the model | Provided by the service | Your device's memory and computing power |
| Connection for inference | A connection to the service is required | Inference can run on the device after setup |
Model downloads and connected tools may still need internet access, even when inference runs locally.
What does this mean for a document?
To revise a report, an AI model uses your instructions and the document content it reads. The model's execution location determines where that material is processed.
For work documents, check where the AI request is sent as well as where the file is stored. This gives you a clearer picture of how the content is handled.
How Acrylic combines editing and AI
Acrylic's document editors run in the desktop app, and its AI features currently use cloud models. You can work on DOCX, XLSX, and PPTX files in the editor and ask the agent to help revise them.
For example:
Shorten the summary in this report using the figures already in the document. Keep the dates and units.
You can read the updated summary in the editor, make further changes, and save the file.
Read about Acrylic's document editors for a closer look at that workflow. Product and download information is available on the Acrylic website.