What is Monthly Tested Users (MTU)?

Tested users are the individuals who visit your website and are included in any of the A/B tests you're conducting using the platform, Howuku Optimize.

To simplify, here's what we mean by users:

When people enter your website, these are known as site visitors. But, not every visitor is a tested user on Howuku Optimize.

We only refer to those visitors as tested users who are part of the online tests happening on your website. We ignore those visitors who are part of multiple tests to ensure we don't double count anyone. 

So, let's imagine two tests, each seen by 100,000 visitors. The total number of tested users would be:

200,000, if there's no overlap between the two groups of 100,000.

Less than 200,000, if there's overlap between these groups. For example, if both groups have 50,000 distinct individuals and another 50,000 who are a part of both tests, the number of tested users will then be 150,000.

Therefore, the count of tested users will either match or be lower than the total visitor count on your website, and it's determined by how you allocate the visitors to your tests.

What is an experiment on Howuku Optimize? 

A website experiment is a process where different versions of a website are shown to different users in order to test and see which one performs better for a specific goal. 

This might involve changing elements like the wording, layout, images, or features of a website. The users' reactions or interactions are then tracked, analyzed, and used to decide which version of the website is more effective. 

This type of experimentation is often done to improve online experiences, increase user engagement, and boost conversions or sales.

There are five types of experiments that you can run on Howuku Optimize. Learn more about these experiment types here.

What is a Website Project on Howuku Optimize?

A website project in Howuku Optimize is like a separate section within your main account. Every project comes with its own set of details including a specific code snippet, set of experiments, and different collaborators. This makes it easier to arrange and manage your different tests across various websites or parts of a big website. 

Consider a project as a way of grouping your tests in a method that works best for your needs. For instance, if you conduct tests across several domains, you could dedicate an individual project to each domain. And you have the option to invite other users to work with you on a project without giving them total control over your account.

Before you start a project, you should be aware that:

• Every project has its unique tracking code, which ensures visitor information is kept private and cannot be used again in another project.
• There's no limit to the number of subdomains, seats, experiments, variations, or goals you can include in a project.

What is Version History?

Version history is just a sort of 'record' or 'log' that tracks all the different changes and updates that have happened in a Howuku experiment over time. 

It's a way to keep track and see what modifications have been made, when they were made, and by whom, allowing users to revisit and understand previous versions of their experiments. 

What is Traffic Allocation?

Traffic allocation in A/B testing is about controlling how much of your total website traffic will be part of the experiment.

Let's say your website has 100,000 visitors. If you set your traffic allocation to 50%, then only 50,000 of those visitors would be included in your A/B test. These 50,000 visitors will be randomly split between the different versions of your site that you're testing (like Version A and Version B).

The purpose of this is to limit the number of visitors who see your test versions. This way, not all of your visitors are affected by any changes you're testing and you can control the size of your experiment.

What is Multi-arm Bandit Test?

This test type dynamically adjusts the rates at which different variations are shown to visitors, based on their performance. It reduces the risk of choosing a poor-performing variant early in the test while still providing useful data on which variant performs best. 

Rather than splitting traffic equally, the multi-arm bandit test allocates more traffic to better-performing variations, optimizing for both exploration of variants and exploitation of the current winner.

What is deployment?

Deployment refers to the process of implementing or launching the changes that have been tested and proven to be effective during the experiment. This could be anything from new features, design elements, or content. 

Once these changes have been deployed, they become a permanent part of the website's front-end code and are visible to all users. This final step is critical as it's when experiment-led improvements are utilized to enhance user experience or meet desired goals.

How does the MTU quota refresh monthly?

The refresh of the MTU (Monthly Tracked Users) quota takes place at the start of each new calendar month, specifically on the 1st day of the month.

What is anti-flicker protection?

Anti-flicker protection is a feature used to prevent a quick 'flicker' effect that may occur when different designs of a webpage are being tested. This flicker can happen as the webpage initially loads one design and then swiftly switches to the other. 

To avoid this, Howuku Optimize applies an anti-flicker technique to keep the page from displaying until the design is ready. This way, we ensure that your users enjoy a seamless browsing experience without experiencing any distractions or discomfort due to flickering during tests.

What happens if I use up all of my MTU quota?

If you run out of your MTU quota, all ongoing tests and data collecting will stop. The quota will not automatically extend. If you need more quota, please get in touch with us here. 

Does Howuku Optimize support cross-domains tracking? 

Absolutely, Howuku Optimize is designed to support cross-domain tracking. This allows you to apply a test across multiple domains and monitor the achievement of goals across these different sites.

What is the timeframe for which I can access campaign data?

There is no limit. Essentially, your data will only be removed if you choose to delete the campaign or account.

How do basic and advanced targeting differ?

Basic targeting allows you to target based on elements such as the page URL and the visitor's country. Whereas advanced targeting allows you to target certain segments by user attributes or behavioral events.

What does 'editor URL page' and 'Page URL targeting' mean?

The term 'editor URL page' is used when you start a new experiment. This is the specific webpage you want to change or edit.

On the other hand, 'page targeting' is the specific webpage where you want your visitors to see these changes.

For example, if you want to test different names for your navigation menu, you will use your homepage's URL as the 'editor URL page'. Here, you change the menu titles using Howuku Optimize. If the navigation menu appears on all your site's pages and you'd like the new titles to show on all pages, on the 'page targeting', you can use a wildcard to include all the pages for your experiment.