{"id":6823,"date":"2022-08-13T00:48:00","date_gmt":"2022-08-13T00:48:00","guid":{"rendered":"https:\/\/omaha-seo.com\/blog\/?p=6823"},"modified":"2022-08-13T00:51:11","modified_gmt":"2022-08-13T00:51:11","slug":"a-beginners-guide-to-a-b-testing","status":"publish","type":"post","link":"https:\/\/omaha-seo.com\/blog\/a-beginners-guide-to-a-b-testing\/","title":{"rendered":"A Beginners Guide to A\/B Testing"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_82_2 counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-69f27ee9bf562\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-69f27ee9bf562\"  aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/omaha-seo.com\/blog\/a-beginners-guide-to-a-b-testing\/#A_Beginners_Guide_to_A_B_Testing\" >A Beginners Guide to A B Testing<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/omaha-seo.com\/blog\/a-beginners-guide-to-a-b-testing\/#Significance_levels\" >Significance levels<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/omaha-seo.com\/blog\/a-beginners-guide-to-a-b-testing\/#Sample_size\" >Sample size<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/omaha-seo.com\/blog\/a-beginners-guide-to-a-b-testing\/#Calculating_the_duration_of_a_test\" >Calculating the duration of a test<\/a><\/li><\/ul><\/li><\/ul><\/nav><\/div>\n<h2><span class=\"ez-toc-section\" id=\"A_Beginners_Guide_to_A_B_Testing\"><\/span>A Beginners Guide to A B Testing<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p>This article will introduce you to the basics of <a href=\"https:\/\/omaha-seo.com\/\">A\/B testing<\/a>, including Sample size, Significance level, and Results. You will also learn how to calculate the duration of a test and calculate sample sizes. The key to successful A\/B testing is to never stop testing. Once you start noticing some success, it is time to move on to the next test element. This is where the guide really shines!<\/p>\n<p><img decoding=\"async\" class=\" wp-image-3712 aligncenter\" src=\"https:\/\/omaha-seo.com\/blog\/wp-content\/uploads\/2022\/03\/Omaha-SEO-company-1024x576-1-300x169.jpg\" alt=\"\" width=\"985\" height=\"555\" srcset=\"https:\/\/omaha-seo.com\/blog\/wp-content\/uploads\/2022\/03\/Omaha-SEO-company-1024x576-1-300x169.jpg 300w, https:\/\/omaha-seo.com\/blog\/wp-content\/uploads\/2022\/03\/Omaha-SEO-company-1024x576-1-768x432.jpg 768w, https:\/\/omaha-seo.com\/blog\/wp-content\/uploads\/2022\/03\/Omaha-SEO-company-1024x576-1-513x289.jpg 513w, https:\/\/omaha-seo.com\/blog\/wp-content\/uploads\/2022\/03\/Omaha-SEO-company-1024x576-1-573x322.jpg 573w, https:\/\/omaha-seo.com\/blog\/wp-content\/uploads\/2022\/03\/Omaha-SEO-company-1024x576-1-600x338.jpg 600w, https:\/\/omaha-seo.com\/blog\/wp-content\/uploads\/2022\/03\/Omaha-SEO-company-1024x576-1-335x188.jpg 335w, https:\/\/omaha-seo.com\/blog\/wp-content\/uploads\/2022\/03\/Omaha-SEO-company-1024x576-1.jpg 1024w\" sizes=\"(max-width: 985px) 100vw, 985px\" \/><\/p>\n<h3><span class=\"ez-toc-section\" id=\"Significance_levels\"><\/span>Significance levels<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>A common mistake made by beginner optimizers is stopping tests as soon as they reach statistical significance. This is a common mistake because lifts at significance levels do not necessarily translate to increased revenue. As a result, beginner optimizers risk generating false positives and excluding external validity threats. To avoid such problems, pre-determine sample sizes and run tests for at least two weeks. A Beginners Guide to A B Testing discusses the significance levels in detail.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Sample_size\"><\/span>Sample size<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>When it comes to A\/B testing, knowing the right sample size is crucial. While a thousand visitors are sufficient for a small site, you might need a larger sample size if you have a large site. Small sample sizes are risky since they give ambiguous results. Most A\/B tests are designed to last a month before determining a final conclusion. You can estimate the sample size of your test by using your website&#8217;s average monthly traffic.<\/p>\n<h3><span class=\"ez-toc-section\" id=\"Calculating_the_duration_of_a_test\"><\/span>Calculating the duration of a test<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>The duration of a test can be calculated by taking into account the number of variants and the proportion of users. The latter is calculated from the previous weeks&#8217; data. Its minimum is approximately two hours. Its optimal value is three or four hours. If the number of variants is known, calculating the duration is straightforward. The remaining parameters, including the number of users per week, are unknown. The basic idea of this argument is illustrated in Figure 1.<\/p>\n<p>One method is to estimate the duration of the test by using the number of students who take the test. Assume there are N students. Each student takes the exam. Calculate the number of incorrect answers. Then divide the number of tests by N to get the total test duration. The total test duration would correspond to the number of failures. Moreover, the number of students who fail the test can vary between two different periods. However, if the re-takes fraction is different for the producer and the consumer, the solution will be different.<\/p>\n<p>The classical test theory model is another method of determining the duration of a test. This theory assumes that test items may be added or deleted without affecting its difficulty or content. This approach also assumes that an examiner can make modifications to the test by adding or removing test items. These are known as homogeneous tests and a continuous test duration. The theoretical basis for determining test duration is presented in the next section of this article.<\/p>\n<p style=\"text-align: center;\"><iframe loading=\"lazy\" style=\"border: 0;\" src=\"https:\/\/www.google.com\/maps\/embed?pb=!1m28!1m12!1m3!1d11999.893404555913!2d-96.02917190580956!3d41.24413839233211!2m3!1f0!2f0!3f0!3m2!1i1024!2i768!4f13.1!4m13!3e6!4m5!1s0x87938db72b7cf8d1%3A0x4de9441ec355ae17!2sElmwood%2018%20Hole%20Golf%20Course!3m2!1d41.249147099999995!2d-96.0085196!4m5!1s0x87938c3d0c948869%3A0x391f88e01c1aab8a!2sOmaha%20SEO%2C%205223%20Grover%20St%2C%20Omaha%2C%20NE%2068106!3m2!1d41.22665!2d-95.99607499999999!5e0!3m2!1sfil!2sph!4v1659032618080!5m2!1sfil!2sph\" width=\"600\" height=\"450\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n","protected":false},"excerpt":{"rendered":"<p>A Beginners Guide to A B Testing This article will introduce you to the basics of A\/B testing, including Sample size, Significance level, and Results. You will also learn how to calculate the duration of a test and calculate sample sizes. The key to successful A\/B testing is to never stop testing. Once you startRead More &raquo;<\/p>\n","protected":false},"author":1,"featured_media":3364,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-6823","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-search-engine-optimization","cat-1-id"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.5 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>A Beginners Guide to A\/B Testing - Omaha SEO<\/title>\n<meta name=\"description\" content=\"SEO Professionals that provide industry-leading Online Marketing from Search Engine Optimization &amp; Website Design to bring you more traffic.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/omaha-seo.com\/blog\/a-beginners-guide-to-a-b-testing\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"A Beginners Guide to A\/B Testing - Omaha SEO\" \/>\n<meta property=\"og:description\" content=\"SEO Professionals that provide industry-leading Online Marketing from Search Engine Optimization &amp; Website Design to bring you more traffic.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/omaha-seo.com\/blog\/a-beginners-guide-to-a-b-testing\/\" \/>\n<meta property=\"og:site_name\" content=\"Omaha SEO\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/4socialmedia\/\" \/>\n<meta property=\"article:published_time\" content=\"2022-08-13T00:48:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-08-13T00:51:11+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/omaha-seo.com\/blog\/wp-content\/uploads\/2022\/02\/Depositphotos_185299358_XL-scaled.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2560\" \/>\n\t<meta property=\"og:image:height\" content=\"1709\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Phil Belleville\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@MySocialMediaCo\" \/>\n<meta name=\"twitter:site\" content=\"@MySocialMediaCo\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Phil Belleville\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"A Beginners Guide to A\/B Testing - Omaha SEO","description":"SEO Professionals that provide industry-leading Online Marketing from Search Engine Optimization & Website Design to bring you more traffic.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/omaha-seo.com\/blog\/a-beginners-guide-to-a-b-testing\/","og_locale":"en_US","og_type":"article","og_title":"A Beginners Guide to A\/B Testing - Omaha SEO","og_description":"SEO Professionals that provide industry-leading Online Marketing from Search Engine Optimization & Website Design to bring you more traffic.","og_url":"https:\/\/omaha-seo.com\/blog\/a-beginners-guide-to-a-b-testing\/","og_site_name":"Omaha SEO","article_publisher":"https:\/\/www.facebook.com\/4socialmedia\/","article_published_time":"2022-08-13T00:48:00+00:00","article_modified_time":"2022-08-13T00:51:11+00:00","og_image":[{"width":2560,"height":1709,"url":"https:\/\/omaha-seo.com\/blog\/wp-content\/uploads\/2022\/02\/Depositphotos_185299358_XL-scaled.jpg","type":"image\/jpeg"}],"author":"Phil Belleville","twitter_card":"summary_large_image","twitter_creator":"@MySocialMediaCo","twitter_site":"@MySocialMediaCo","twitter_misc":{"Written by":"Phil Belleville","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/omaha-seo.com\/blog\/a-beginners-guide-to-a-b-testing\/#article","isPartOf":{"@id":"https:\/\/omaha-seo.com\/blog\/a-beginners-guide-to-a-b-testing\/"},"author":{"name":"Phil Belleville","@id":"https:\/\/omaha-seo.com\/blog\/#\/schema\/person\/d89831df4731d968e121c58c93febdd2"},"headline":"A Beginners Guide to A\/B Testing","datePublished":"2022-08-13T00:48:00+00:00","dateModified":"2022-08-13T00:51:11+00:00","mainEntityOfPage":{"@id":"https:\/\/omaha-seo.com\/blog\/a-beginners-guide-to-a-b-testing\/"},"wordCount":499,"publisher":{"@id":"https:\/\/omaha-seo.com\/blog\/#organization"},"image":{"@id":"https:\/\/omaha-seo.com\/blog\/a-beginners-guide-to-a-b-testing\/#primaryimage"},"thumbnailUrl":"https:\/\/omaha-seo.com\/blog\/wp-content\/uploads\/2022\/02\/Depositphotos_185299358_XL-scaled.jpg","articleSection":["Search Engine Optimization"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/omaha-seo.com\/blog\/a-beginners-guide-to-a-b-testing\/","url":"https:\/\/omaha-seo.com\/blog\/a-beginners-guide-to-a-b-testing\/","name":"A Beginners Guide to A\/B Testing - Omaha SEO","isPartOf":{"@id":"https:\/\/omaha-seo.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/omaha-seo.com\/blog\/a-beginners-guide-to-a-b-testing\/#primaryimage"},"image":{"@id":"https:\/\/omaha-seo.com\/blog\/a-beginners-guide-to-a-b-testing\/#primaryimage"},"thumbnailUrl":"https:\/\/omaha-seo.com\/blog\/wp-content\/uploads\/2022\/02\/Depositphotos_185299358_XL-scaled.jpg","datePublished":"2022-08-13T00:48:00+00:00","dateModified":"2022-08-13T00:51:11+00:00","description":"SEO Professionals that provide industry-leading Online Marketing from Search Engine Optimization & Website Design to bring you more traffic.","breadcrumb":{"@id":"https:\/\/omaha-seo.com\/blog\/a-beginners-guide-to-a-b-testing\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/omaha-seo.com\/blog\/a-beginners-guide-to-a-b-testing\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/omaha-seo.com\/blog\/a-beginners-guide-to-a-b-testing\/#primaryimage","url":"https:\/\/omaha-seo.com\/blog\/wp-content\/uploads\/2022\/02\/Depositphotos_185299358_XL-scaled.jpg","contentUrl":"https:\/\/omaha-seo.com\/blog\/wp-content\/uploads\/2022\/02\/Depositphotos_185299358_XL-scaled.jpg","width":2560,"height":1709},{"@type":"BreadcrumbList","@id":"https:\/\/omaha-seo.com\/blog\/a-beginners-guide-to-a-b-testing\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/omaha-seo.com\/blog\/"},{"@type":"ListItem","position":2,"name":"A Beginners Guide to A\/B Testing"}]},{"@type":"WebSite","@id":"https:\/\/omaha-seo.com\/blog\/#website","url":"https:\/\/omaha-seo.com\/blog\/","name":"Omaha SEO","description":"Omaha SEO Experts - SEO Omaha Services","publisher":{"@id":"https:\/\/omaha-seo.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/omaha-seo.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/omaha-seo.com\/blog\/#organization","name":"Omaha SEO","url":"https:\/\/omaha-seo.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/omaha-seo.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/omaha-seo.com\/blog\/wp-content\/uploads\/2022\/03\/OMAHA-SEO-LOGO-NEW.jpg","contentUrl":"https:\/\/omaha-seo.com\/blog\/wp-content\/uploads\/2022\/03\/OMAHA-SEO-LOGO-NEW.jpg","width":480,"height":92,"caption":"Omaha SEO"},"image":{"@id":"https:\/\/omaha-seo.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/4socialmedia\/","https:\/\/x.com\/MySocialMediaCo","https:\/\/www.linkedin.com\/in\/philbelleville","https:\/\/www.pinterest.com\/4socialmedia\/","https:\/\/www.youtube.com\/user\/4socialmanagement\/"]},{"@type":"Person","@id":"https:\/\/omaha-seo.com\/blog\/#\/schema\/person\/d89831df4731d968e121c58c93febdd2","name":"Phil Belleville","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/9383199381d5c80a2a662b9c35dd0eb2636dcd1201f868c82d026916be0a3934?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/9383199381d5c80a2a662b9c35dd0eb2636dcd1201f868c82d026916be0a3934?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/9383199381d5c80a2a662b9c35dd0eb2636dcd1201f868c82d026916be0a3934?s=96&d=mm&r=g","caption":"Phil Belleville"},"description":"I\u2019ve been doing SEO since 1995, back when getting a website to rank meant testing, breaking, fixing, and testing again. After leaving a CFO role at a seven\u2011figure nonprofit, I built my first online business and hit #1 in AOL search within weeks\u2014then clients started asking me to replicate those results for them. Since then, I\u2019ve helped businesses turn WordPress sites into high\u2011performing assets through technical SEO, site architecture, speed, and content strategy, and I\u2019ve built and sold a WordPress site after growing it to 1,000+ organic keyword rankings. Today I own or co\u2011own multiple city\u2011based SEO properties that compete at the top in tough U.S. markets, and I now offer AI SEO so brands can show up in Google results and AI\u2011generated answers. To work with me, book a call from the homepage of Omaha SEO (Omaha\u2011SEO.com).","url":"https:\/\/omaha-seo.com\/blog\/author\/philbell\/"}]}},"_links":{"self":[{"href":"https:\/\/omaha-seo.com\/blog\/wp-json\/wp\/v2\/posts\/6823","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/omaha-seo.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/omaha-seo.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/omaha-seo.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/omaha-seo.com\/blog\/wp-json\/wp\/v2\/comments?post=6823"}],"version-history":[{"count":0,"href":"https:\/\/omaha-seo.com\/blog\/wp-json\/wp\/v2\/posts\/6823\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/omaha-seo.com\/blog\/wp-json\/wp\/v2\/media\/3364"}],"wp:attachment":[{"href":"https:\/\/omaha-seo.com\/blog\/wp-json\/wp\/v2\/media?parent=6823"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/omaha-seo.com\/blog\/wp-json\/wp\/v2\/categories?post=6823"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/omaha-seo.com\/blog\/wp-json\/wp\/v2\/tags?post=6823"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}