TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Ask HN: High traffic sites use A/B testing. What can low traffic sites use?

6 点作者 briggers将近 14 年前
Stated another way: why wait for your first few thousand visitors before making your first data-driven decision?<p>Is this a problem that needs solving?<p>[Edit: formatting]

5 条评论

_delirium将近 14 年前
It would be possible to at least improve the situation. An approach common in machine learning is, before a lot of directly-on-point data comes in, to bootstrap predictions using a background dataset of existing data, which can at least give you hints about the structure of the space, and where in it you might fall.<p>In this case, if you (or some service) had a large data set of user interactions collected from many other websites, then even though the first N data points on your site might not be enough to make strong conclusions on their own, they could be used to match your website up to scenarios in the background dataset that are most similar. There are a lot of different approaches, ranging from Bayesian ones where the background dataset is used as a prior in one way or another, to more clustering-based ones, where your small initial dataset is used to match you to a set of "similar, as far as user-experience lessons go" websites in the existing dataset.
coopertmynas将近 14 年前
You can't make a data based decision without data.<p>What you can do is test on an individual basis. Companies have been doing this long before computers came along. Look up videos by Steve Krug on how to properly run user testing.<p>There are a lot of tools geared toward this already. Some offer testers, others just give you the capability to test with your own anonymous users. My rule of thumb is if someone else is making money off it, there is still money to be made.<p>This kind of testing doesn't identify things like a red button converting better than a green button, but it can tell you if some users aren't seeing the button at all.
评论 #2667801 未加载
Travis将近 14 年前
In my most recent experience, I had so many different tasks to do that were more important than optimization. By the time I had the bare essential stuff done, I had enough data to start to make decisions on.
carbocation将近 14 年前
You need data to make a data-driven decision. Can you elaborate on how you propose to solve the problem of "making a data-driven decision without sufficient data"? I'm pretty skeptical, as you can see.
评论 #2667799 未加载
pkamb将近 14 年前
Write down the top 5 tasks people will be doing on your site.<p>Get 3 people, tell them to attempt to complete those tasks.<p>Watch.