TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Ask HN: High traffic sites use A/B testing. What can low traffic sites use?

6 pointsby briggersalmost 14 years ago
Stated another way: why wait for your first few thousand visitors before making your first data-driven decision?<p>Is this a problem that needs solving?<p>[Edit: formatting]

5 comments

_deliriumalmost 14 years ago
It would be possible to at least improve the situation. An approach common in machine learning is, before a lot of directly-on-point data comes in, to bootstrap predictions using a background dataset of existing data, which can at least give you hints about the structure of the space, and where in it you might fall.<p>In this case, if you (or some service) had a large data set of user interactions collected from many other websites, then even though the first N data points on your site might not be enough to make strong conclusions on their own, they could be used to match your website up to scenarios in the background dataset that are most similar. There are a lot of different approaches, ranging from Bayesian ones where the background dataset is used as a prior in one way or another, to more clustering-based ones, where your small initial dataset is used to match you to a set of "similar, as far as user-experience lessons go" websites in the existing dataset.
coopertmynasalmost 14 years ago
You can't make a data based decision without data.<p>What you can do is test on an individual basis. Companies have been doing this long before computers came along. Look up videos by Steve Krug on how to properly run user testing.<p>There are a lot of tools geared toward this already. Some offer testers, others just give you the capability to test with your own anonymous users. My rule of thumb is if someone else is making money off it, there is still money to be made.<p>This kind of testing doesn't identify things like a red button converting better than a green button, but it can tell you if some users aren't seeing the button at all.
评论 #2667801 未加载
Travisalmost 14 years ago
In my most recent experience, I had so many different tasks to do that were more important than optimization. By the time I had the bare essential stuff done, I had enough data to start to make decisions on.
carbocationalmost 14 years ago
You need data to make a data-driven decision. Can you elaborate on how you propose to solve the problem of "making a data-driven decision without sufficient data"? I'm pretty skeptical, as you can see.
评论 #2667799 未加载
pkambalmost 14 years ago
Write down the top 5 tasks people will be doing on your site.<p>Get 3 people, tell them to attempt to complete those tasks.<p>Watch.