ARTICLE ·

Putting an AI assistant inside a live product without letting it break anything

You’ve seen the demo. You type “block YouTube for the kids after 9pm” and the AI just does it. It looks like magic.

Most of those demos fall apart the moment real people run a real business on them. The problem is rarely the AI model. The problem is everything around it.

Since 2024 I’ve had an AI assistant running inside AccessHub, a platform that controls internet access for whole networks. I build and run it for an internet-safety company. You can ask the assistant to create a user, move someone to another group, or add a rule with a time limit. You can also ask it “why was this blocked?” and it answers from the live setup.

Here are the four rules that make it safe enough to ship. They’re simple, and they work for any AI feature, not just mine.

Rule 1: The AI suggests, a human approves

The assistant never changes anything by itself. When you ask it to add a rule, it prepares the change and shows the admin exactly what will happen. The admin clicks approve. Only then does it go live.

That might sound like it defeats the point. It doesn’t. The slow part was never the click to approve. The slow part was turning “my son should only get school sites on weekdays” into the right users, groups, websites and schedules. The AI is good at that. The human is good at catching the one time the AI got it wrong. Split the work that way and you get the speed without giving up control.

I use the same rule for AI-drafted client replies. The AI reads each request, sorts it by priority, and drafts an answer. A person reads and approves every single send. Replies go out in minutes instead of hours, and nothing leaves without a human reading it.

Rule 2: It reads the real system, it doesn’t guess

Half of what people ask the assistant is questions, not commands. Who can reach this site? Why did this get blocked? What rules apply to this person?

The shortcut is to let the AI answer from its general knowledge. That’s wrong. Instead, I give it tools that look up the actual settings and the actual logs, and it answers from what it finds.

The difference shows up fast. An admin changes a rule, then asks the assistant about it a minute later. An AI that guesses describes the old setup with total confidence. An AI that checks the live system gets it right. And if it can’t find the answer, it says so instead of making one up.

Rule 3: Every change can be undone

An AI-made change goes through the same path as a change a human makes by hand. It’s logged the same way. It can be traced the same way. It can be rolled back the same way. There’s no special “the AI did this” path with different rules.

I ship AccessHub as small, numbered releases, over a hundred so far. That habit is what let me add AI to it without fear. If the assistant does something odd, I treat it like any other bug: find it, fix it, release, roll back if needed.

Rule 4: It stops when it isn’t sure

Some tasks take several steps: gather information, decide, act, check the result. For those, the AI plans the steps, calls the right systems, and checks its own work against the rules. When it isn’t confident, it stops and hands the task to a person.

Stopping is a feature, not a failure. An AI that pushes through when unsure gives you a confident wrong answer. In a filtering product, a confident wrong answer means a child reaches something they shouldn’t, or an adult loses access to something they need. So the system is built to pause, explain what it’s unsure about, and wait.

None of this is special

These four rules aren’t clever tricks. They’re the same care I put into everything I build: plan the edge cases first, find the real cause of a problem, prove a fix works before calling it done. AI features get exactly the same treatment.

If you’re looking at an AI tool for your own business, ask the vendor four questions. Does it act on its own, or does a person approve? Does it check real data, or guess? Can its changes be undone? Does it stop when unsure? If the answers are vague, be careful about where you put it.

START
Tell me what you're building.

Or what's breaking. I reply within 24 hours on weekdays.

© 2026 Priyank Maniar · Independent software developer ← Back to the surface