WordPress usage worldwide

By only profiling the top 1M sites, I wonder if this may be sampling from a set not normally distributed? I suspect the frequency of use of WordPress might go up the further down the list you go — some random blog is less likely to be on the top 1M list yet be more likely to use WordPress.

The test is likely to be under-reporting WordPress installations as it stands.<p>The script seems to detect a WordPress site by looking for a meta generator tag containing WordPress:<p><a href="https:&#x2F;&#x2F;github.com&#x2F;tanrax&#x2F;calculate-wordpress-usage&#x2F;blob&#x2F;5aa344aa2d55c43ae0885b1b8c8f4fa09a787c0a&#x2F;src&#x2F;wordpress_used&#x2F;core.clj#L24" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;tanrax&#x2F;calculate-wordpress-usage&#x2F;blob&#x2F;5aa...</a><p>It&#x27;s pretty common to remove that meta tag — popular WordPress theme frameworks like Genesis do it by default.<p>A more reliable test would be to look for additional strings in the source that point to the use of WordPress, such as “wp-content” and “wp-includes”.<p>A faster way that avoids string searches would be to send an HTTP head request to `&#x2F;wp-login.php` and check for:<p>Set-Cookie: wordpress_test_cookie<p>(&#x2F;wp-login.php doesn&#x27;t always appear in the root directory and it&#x27;s not always accessible to all IPs, but that setup is most common).

The way this works seems to check if there&#x27;s the &quot;generator&quot; meta tag in the &lt;head&gt;.<p>Custom themes etc. might choose to omit that so it&#x27;s not a 100% reliable check

you have to use a larger sample. There are 300M+ domains. The longer tail will surely have more wordpress in it.

&gt; the list of the first million domains with the most visits<p>How is that a random sample?

Only ? Looks like a big number for worldwide usage, no ?

Google Translate link for the article at the end of the repo:<p><a href="https:&#x2F;&#x2F;translate.google.com&#x2F;translate?sl=auto&amp;tl=en&amp;u=https%3A%2F%2Fprogramadorwebvalencia.com%2Fanalizando-un-millon-de-paginas-para-saber-cuanto-se-usa-wordpress-2019%2F" rel="nofollow">https:&#x2F;&#x2F;translate.google.com&#x2F;translate?sl=auto&amp;tl=en&amp;u=https...</a>

The Readme says &quot;Warning that it can take a long time: between 20 to 30 days.&quot;<p>How in the world can it take so long time? The csv file seems to be 24mb in size and the computation performed can&#x27;t be that advanced. Did the author do something seriously wrong?

This is a pretty amazing feat. The top 1 million sites includes many who have the money to afford custom sites and yet Wordpress is still almost 1&#x2F;5 of sites.

so they studied the top 1M websites and found 19% is using wordpress? man, that&#x27;s a good chunk if you ask me.

I’m wondering why this takes 20-30 days to run all up? Seems crazy for 1M requests. Could one make this a concurrent task and get much greater efficiency?