Category: AI (Artificial Intelligence)
-
The 11.8 Gigabyte 27B
A 27-billion-parameter model in an 11.8 gigabyte file, scoring the same as the 54-gigabyte original. Which size fits your card, how to run it, and why the method itself is the bigger story.
-
How to Configure OpenWork for Local AI
Here’s how you’d do this entirely through the OpenWork UI — two approaches: Method 1: Settings UI (Recommended for most users expected on Cloud App versions) Step 1 — Open AI Provider Settings In the OpenWork Cloud app (yes – the CLOUD App – we need to distinguish this early, OpenWork has two versions: a…
-
Local Doesn’t Mean Locked
Security firm Cyera found 10 vulnerabilities in llama.cpp — the engine behind Ollama, LM Studio and most local AI. Five were still unpatched at their June 2026 re-check. Here’s what they are in plain English, and what to do if you run local AI at home or in the office.
-
From Chatting to Delegating: Why Professionals Should Learn OpenWork
21st Aug 2026 Let’s be honest about where most professional AI use actually lives. You’ve got ChatGPT or Claude open in a tab, you type a prompt, it hands you back text. You draft the email, it summarises the doc, you brainstorm, it throws out an idea. Useful. But it’s still a chatbot. It talks…
-
OpenWork: The Claude Cowork Alternative
Aug 18th, 2026 I Pointed an AI at My Homelab. Setup Was One Line. It Still Hasn’t Broken Anything. Every AI app is an island. You connect your Google account in one, teach it a skill in another, and the moment you switch apps, you’re back to square one. For most people that’s an annoyance.…
-
The Truth About Open-Source Chinese AI Models
Are They Secretly “Calling Home”? I had to write this out to get it off my chest right now, just because most recently in the midst of a conversation, a client declared that all Chinese AI models have ‘backdoors’ for the China government to access, a notion picked up from his ‘social networking’ with local…
-
The Great AI Showdown: Why Ditch Google’s “Flash” for Qwen as your Local Agent
Jul 24th, 2026 Let’s be honest: I have a bit of a love-hate relationship with Google’s new AI Mode. On one hand, it’s free. On the other hand, it’s a black box. I use it constantly for those “hey, how does this tech thing work?” questions that don’t involve my bank password or my pet’s…
-
The Private Local AI Server Install
Completed my operational setup of a private Local AI Chat that can process audio, video, images, text file, PDFs and can even hook up with MCP servers. And my choice of AI model? I chose the Qwen 3.6 35B-A3B UD Q4_K_M MTP model finetuned by unsloth studio. The 35B-A3B Architecture is an MoE (Mixture of…
-
Initial Trials of A Local AI Server Testing
Jul 2, 2026 Initial performance trials for my Local AI server setup with 2 GPUs was promising, certainly with help coming from finetuning flags in Llama.cpp (big shoutout to Georgi Gerganov, luv your work!) that allows me to split up the 35B AI model into 2 GPUs with differing (6GB and 22GB) VRAMs. Utilizing a…
-
AI Guide: How to Install Llama.cpp onto your Desktop PC for Local AI
June 16th, 2026 After some weeks of research, trials and errors, I managed to successfully install Llama.cpp and have it working with my AMD GPU using vulkan instead of RoCm on Linux Mint v22.3 OS. Learnt many lessons from the experience, and happy to share that here. The next thing now would be to install…