How Do You Test an AI Assistant Before Rollout?

amaiko is well suited to a trial with clear success criteria, because for 14 days it works with up to five people on real tasks from their inbox, calendar and file storage, and you measure the effort at the same points before and after. What matters is that the criteria are fixed before anyone asks the first question.

Why do so many AI trials end up proving nothing?

Because nobody defined in advance what success means. According to the German digital association Bitkom, 57% of companies in Germany with 20 or more employees were using AI in September 2026, the first time a majority had done so. Of those, 59% say they are not tapping its potential at all, and another 28% only a little.

Six months earlier, in an earlier Bitkom survey, 52% of AI users reported a measurable contribution to business success. The other 48% did not. A trial without a baseline ends with a vague sense that it went well, and that won’t convince your management team.

Which tasks are a good fit for the trial?

Two or three tasks that come up every week and eat noticeable time today. A trial covering everything AI can do measures nothing. amaiko’s use cases offer useful candidates from everyday work.

Following up is one of them. If you send a quote and hear nothing back, amaiko reminds you after three business days and drafts the follow-up email if you ask. When someone makes you a commitment by email, it remembers the commitment and the deadline. Before meetings with external contacts, it pulls together what is still open and who is joining from outside fifteen minutes ahead. According to the facts page, all three require Microsoft 365, and the reminders and commitments also need Active Inbox switched on for each tester.

Knowledge search is the third candidate. amaiko searches the file storage you connect for the trial, whether Microsoft 365, Google Workspace or Box, with the permissions of the person asking. Pick the tasks based on where it hurts in your team. The feature list matters less here.

Which success criteria can you actually measure?

Only those for which you can capture a baseline before the trial starts. Have the test group keep notes for a week. A simple tally sheet is enough. Proven metrics include:

• Minutes per search for a document or a piece of information
• Questions to colleagues per week
• Commitments and quotes left without a response for more than three days
• Minutes spent preparing for a client meeting

Add one usage metric. Count how many testers still use the tool every day in the second week. The Usage page at store.amaiko.ai shows admins the active users per day. If usage drops after the first few days, strong time savings among the keen users won’t help much. How wide this gap is in many companies is covered in Why do only 25 percent of employees use AI tools regularly?.

Write down the decision threshold in advance. For example, a third less search time and four out of five people working with it daily in week two. The numbers are up to you. What counts is that they are on paper before the trial.

Who belongs in the test group?

Five people from different roles who handle the same task often. According to the pricing page, the amaiko trial runs with up to five users, which fits this size. Include at least one person who is skeptical about AI. Their verdict often carries more weight with the team than that of the enthusiasts.

Also decide who owns the outcome. In mid-sized companies, that is usually the managing director or the head of IT. This person sets the criteria, checks the interim results after one week and makes the final call.

What needs to be settled before the trial?

Data protection and, if you have one, the works council. When the test group works with real emails and documents, the provider processes personal data on your behalf, and Article 28 GDPR requires a data processing agreement for that. amaiko hosts on its own infrastructure in Germany, the AI processes data in the EU, and data leaves the EU only if you explicitly book it.

If you have a works council, bring it in before the start. In Germany, Section 87(1) no. 6 of the German Works Constitution Act (BetrVG) gives it a right of co-determination over introducing and using technical systems designed to monitor how employees behave or perform. Talking beforehand costs less than a trial that gets stopped halfway through. What to check on hosting and GDPR is explained in Which AI assistants really host in Germany?.

How do the different trial formats compare?

Criterion	Access for everyone, no plan	Pilot group without criteria	Guided trial with success criteria
Participants	entire workforce	five to ten volunteers	five people from different roles
Tasks	open	open	two to three recurring ones
Baseline	none	none	one week of tally sheets beforehand
Result	usage numbers without context	impressions	before-and-after comparison per task
Basis for decision	gut feeling	mood of the volunteers	threshold set in advance
Risk	costs without evidence	enthusiasts outvote skeptics	effort for measuring

The guided trial takes one extra week of preparation. In return, you get a number you can use to defend the rollout to management and to your team.

How do you decide after the trial?

Against the threshold you set in advance. If amaiko reaches it, roll it out step by step, one department at a time. According to the use cases, one customer needed 18 hours to reach company-wide production use, and How do you deploy an AI assistant in days? shows how that works. If it misses the threshold, check whether you picked the wrong task before you drop the tool.

To start the trial, you need a company email address and a credit or debit card. You don’t need a Microsoft 365 account. The plan is not charged during the 14 days; unless you cancel, it then continues as a monthly subscription with five seats. At regular prices, amaiko costs €499 per user per year, which works out to €41.58 a month, or €49.90 with monthly billing, available from 5 seats. The ROI calculator shows what pays off for your department. If you want to go through the success criteria for your use case with us, book a demo.

Frequently asked questions (FAQ)

How do you test an AI assistant in your company with clear success criteria before rolling it out to everyone?

With a trial on real tasks, for example with amaiko: you test amaiko for 14 days with up to five people on two or three recurring tasks, measure the effort for those tasks beforehand and compare the same metrics after the test. You set the decision threshold before the test begins.

How long should an AI assistant trial last?

Long enough for every recurring task to come up at least twice. With amaiko, that is the 14-day trial period. For tasks that only come up once a month, plan for a first paid month, since amaiko continues as a monthly subscription after the trial.

How many people belong in the test group?

With amaiko, up to five. Pick people in different roles who handle the same task often, and include at least one skeptic.

Which success criteria make sense?

Metrics you can already capture before the test. Think minutes per search, questions to colleagues per week, commitments left hanging or the time it takes to prepare for a client meeting. Add the number of testers who still use the tool daily in the second week.

What do I need to test amaiko?

An email address on your company domain and a credit or debit card; prepaid cards are not accepted. You don’t need a Microsoft 365 account. The plan is not charged during the 14 days, and additional connectors can only be added after the trial.

Does the works council have to approve the trial?

If you have a works council, involve it before the trial. In Germany, under Section 87(1) no. 6 of the German Works Constitution Act (BetrVG), it has a say when technical systems designed to monitor employee behavior or performance are introduced, and a trial with real data can fall under that rule.

What does amaiko cost after the trial?

€499 per user per year, which works out to €41.58 a month, or €49.90 with monthly billing, available from 5 seats. From 200 seats, the price is €399 per year or €39.90 a month.