TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

After self-hosting my email for twenty-three years I have thrown in the towel

1887 pointsby carlesfeover 2 years ago

191 comments

zahllosover 2 years ago
I&#x27;m on 12 years of self hosting email and counting. Once every so often, I do end up being blocked, usually by Outlook and once by Yahoo. I&#x27;m in their &#x27;sender program&#x27; and they still don&#x27;t actually bother to contact postmaster@, but a few emails is usually enough to unblock the block within 24h.<p>Agree with a sibling comment that many major providers fail to operate the SPF&#x2F;DKIM&#x2F;DMARC tools they insist you do.<p>Each to their own, but ultimately if we don&#x27;t hold on to the freedom to operate our own mailservers, it will be taken away through inaction. This means doing some things right: DMARC, DKIM, SPF of course, server maintenance, good password policies and of course IP reputation. The best way I can recommend for IP reputation is to use a dedicated provider or VPS provider that disallows things like VPN endpoints, where it is less likely they&#x27;ll assign an address with a poor reputation. A good provider might also ask you what you intend to host, and you might be able to discuss IP addresses with them.
评论 #32716767 未加载
评论 #32716571 未加载
评论 #32716652 未加载
评论 #32724111 未加载
评论 #32734275 未加载
评论 #32720497 未加载
评论 #32716416 未加载
评论 #32721510 未加载
jwrover 2 years ago
I&#x27;ve been hosting my mail for 20+ years now, with minor issues. I guess I&#x27;ve been lucky.<p>Reading the comments here makes me incredibly sad. Every answer that tells me to use a provider misses the point. The Internet was created so that there could be many independent nodes, not so that everybody has to rely on one of several blessed providers. I should be able to run my own E-mail.<p>The real problem is lack of incentives. The big corps do not care about e-mail. It doesn&#x27;t make money and isn&#x27;t easily controllable. You can&#x27;t turn it into a walled garden and lock users in. So, it gets minimal attention, and only defensive measures are developed.<p>Either we solve the spam problem, or things will get worse. The big tech corps won&#x27;t solve it for us.
评论 #32717860 未加载
评论 #32718142 未加载
评论 #32719558 未加载
评论 #32719783 未加载
评论 #32720592 未加载
评论 #32717972 未加载
评论 #32719905 未加载
评论 #32721675 未加载
评论 #32724098 未加载
评论 #32728083 未加载
评论 #32720647 未加载
femtoover 2 years ago
Maybe there needs to be a self-hosting association&#x2F;union that self-hosters can join? It could advocate for adherence to open standards, and an equal standing for small servers. It could also be a repository of advice for current best practise in small server administration and configuration. Should it be under the auspices of an existing group such as FreedomBox?
评论 #32720889 未加载
评论 #32721503 未加载
评论 #32720796 未加载
评论 #32721147 未加载
评论 #32720842 未加载
jasodeover 2 years ago
The sweet spot for having control over your email while simultaneously minimizing unforseen headaches is to simply own your domain name and point the MX record to whatever hosting provider you want instead of self-hosting a server at home.<p>Same philosophy for exposing a your personal blog of html files or content like mp4 videos. The sweet spot is to focus on buying a domain name you control. Then let Amazon S3, or Cloudflare, Hezner etc, host your html or mp4 files.<p>I quit self-hosting email at home over 15 years ago. It&#x27;s just not something I want to babysit anymore because I have other things to focus on. As long as I control the MX record on my own domain, that&#x27;s really all that&#x27;s necessary.
评论 #32716138 未加载
评论 #32717077 未加载
评论 #32716159 未加载
评论 #32716017 未加载
评论 #32716070 未加载
评论 #32716627 未加载
评论 #32716585 未加载
评论 #32716510 未加载
评论 #32718829 未加载
评论 #32719641 未加载
评论 #32717827 未加载
评论 #32715998 未加载
评论 #32717018 未加载
评论 #32719535 未加载
评论 #32720543 未加载
评论 #32719169 未加载
评论 #32717533 未加载
armchairhackerover 2 years ago
I support the author but let me tell you a counterargument I don’t think he devotes enough to:<p>Spam is a real issue.<p>The amount of spam emails which get sent are absurd and likely <i>orders of magnitude more than non-spam</i>. And spammers do a lot to mimic real emails, including just hacking legitimate addresses and adding them to botnets.<p>Even on gmail, I still get spam sent to my inbox. Fortunately very rarely, but it still happens.<p>And even if it isn’t bad today, spam has the potential to be much worse in the future with transformer networks and hostile state actors.<p>And even if it really isn’t that bad and never will be, the big companies and those arguing against self-hosting will claim it is. They don’t want to allow a relative few self-hosted email servers in exchange for much more difficult and less effective spam detection. Forget Gmail and Outlook, why not just use Fastmail or Protonmail?<p>If you want a legitimate argument for self-hosted emails you <i>need</i> to address the spam. It may be as simple as registering your official email with some organization sponsored by open-source, and all the big companies can trust that one organization. Then the org has to deal with spam registrations but maybe there won’t be much and it will work out. idk much about self-hosting so this org might already exist.<p>But this article doesn’t mention that org, in fact doesn’t say much at all about spam besides “keep existing spam-prevention because it already works”. But you should at least explain why. Because spam is a legitimate argument for big-co forming an oligarchy that’s not just “so they can make more money”, and it’s the main argument that big-co uses.
评论 #32718343 未加载
评论 #32716974 未加载
评论 #32718076 未加载
hardwaresoftonover 2 years ago
For those who might choose to run their own email these days, you don&#x27;t have to postfix + dovecot:<p><a href="https:&#x2F;&#x2F;github.com&#x2F;foxcpp&#x2F;maddy" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;foxcpp&#x2F;maddy</a><p><a href="https:&#x2F;&#x2F;blitiri.com.ar&#x2F;p&#x2F;chasquid&#x2F;" rel="nofollow">https:&#x2F;&#x2F;blitiri.com.ar&#x2F;p&#x2F;chasquid&#x2F;</a><p>These options are much easier to set up, will do things like generate DKIM for you, etc.<p>I talk about this a lot[0]. There are positively awesome tools for email out there.<p>[EDIT] - Since I&#x27;m repeating myself I&#x27;ve collected all the options into a post[1] I can just link to.<p>[0]: <a href="https:&#x2F;&#x2F;hn.algolia.com&#x2F;?dateRange=all&amp;page=0&amp;prefix=true&amp;query=maddy%20hardwaresofton&amp;sort=byPopularity&amp;type=comment" rel="nofollow">https:&#x2F;&#x2F;hn.algolia.com&#x2F;?dateRange=all&amp;page=0&amp;prefix=true&amp;que...</a><p>[1]: <a href="https:&#x2F;&#x2F;vadosware.io&#x2F;post&#x2F;its-never-been-easier-or-harder-to-self-host-email&#x2F;" rel="nofollow">https:&#x2F;&#x2F;vadosware.io&#x2F;post&#x2F;its-never-been-easier-or-harder-to...</a>
评论 #32720264 未加载
评论 #32729133 未加载
评论 #32725298 未加载
评论 #32720769 未加载
评论 #32721136 未加载
评论 #32724771 未加载
jacobsenscottover 2 years ago
It was a huge mistake for email receivers to take on the cost of filtering spam. Of course given the evolution of the internet and email it is easy to see how that mistake happened. Nobody had a crystal ball. But the only solution here is to raise the cost of sending email to the point where spam is no longer profitable.<p>It seems like one solution is to bcrypt hash (or some similarly expensive algorithm) the email and include the hash in a header. Of course you need to hash per receiver or a spammer can just hash it once and spam away.<p>The receiving client hashes the email and compares the result with the value in the header and discards emails that don&#x27;t match.<p>You&#x27;ll never get industry buy in though - the FAANG companies don&#x27;t want to pay that cost for their semi-legitimate email. They prefer to keep that cost externalized.<p>I believe there have been attempts at something like this, but it clearly never went anywhere.
评论 #32716926 未加载
评论 #32716422 未加载
评论 #32716806 未加载
评论 #32716630 未加载
评论 #32716437 未加载
评论 #32722515 未加载
mastaziover 2 years ago
The address 929@homeaffairs.gov.au, which must be used by Australian permanent residents to update their personal details, refuses to accept email messages unless they are from big tech.<p>Shame on you, Australian Department of Home Affairs.<p>And shame on Telstra, which provides the service.<p>---<p>Remote-MTA: dns; dibp-ibmail2.msng.telstra.com.au<p>Diagnostic-Code: smtp; 554-mx.msng.telstra.com.au 554 Your access to this mail system has been rejected due to the sending MTA&#x27;s poor reputation. If you believe that this failure is in error, please contact the intended recipient via alternate means.
评论 #32720031 未加载
评论 #32720017 未加载
teddyhover 2 years ago
E-mail is complicated, sure. But I’ve had it up to here with people who give up running their own server and then go on to vastly exaggerate how infeasible it is, in order to placate their own conscience. It’s not that they’ve gotten tired of doing it, oh no; (they say,) it’s entirely the fault of Google, Microsoft, etc. who’ve made it literally <i>impossible</i> to run your own e-mail server. Except it’s not <i>impossible</i> – lots of us do it, still. And now there’s one fewer of us, so the rest of us have to work that much harder when the next monopolizing standard comes along (BIMI, anyone?). Sure, you don’t <i>owe</i> us anything, but thanks for nothing when making these public rants; you are <i>scaring away</i> people who might still be inclined to help!
评论 #32718544 未加载
评论 #32716857 未加载
intcover 2 years ago
We still are fighting the oligopoly with our vaulted c1.fi email service. Please feel free to check us at <a href="https:&#x2F;&#x2F;c1.fi&#x2F;v&#x2F;hn20220905&#x2F;?lang=en" rel="nofollow">https:&#x2F;&#x2F;c1.fi&#x2F;v&#x2F;hn20220905&#x2F;?lang=en</a>.<p>Here&#x27;s EU&#x27;s JRC-MECSA report on our service: <a href="https:&#x2F;&#x2F;mecsa.jrc.ec.europa.eu&#x2F;en&#x2F;finderRequest&#x2F;b5daceffc76ec763386936c6af1ce323" rel="nofollow">https:&#x2F;&#x2F;mecsa.jrc.ec.europa.eu&#x2F;en&#x2F;finderRequest&#x2F;b5daceffc76e...</a>.<p>Support for client&#x27;s own domain is currently under works. Our webmail supports PGP and one can use IMAPS&#x2F;SMTPS or ActiveSync based native email clients too.<p>All servers self hosted (we run C1&#x2F;Gentoo!) in our own computing facility in Finland. =)
评论 #32857333 未加载
capdeckover 2 years ago
My fear is that something similar will slowly happen to everything &quot;compute&quot;. How long before my bank&#x27;s website won&#x27;t let me login if I don&#x27;t use a computer with secure boot and a browser installed from an app store? McDonalds app on Android won&#x27;t run on a de-googled or rooted device... At this point one may argue that there will always be computers that you can compile and install your own Linux. Yes, that is true. But just like I am not likely to have un-googled andorid for some apps and googled one for others, the same way it won&#x27;t be practical to have one computer for some apps and the other one for others. And the one that will win will be the one that lets you login into your bank account, for simple and practical reasons.
npteljesover 2 years ago
I agree with the pains, but the options are not juts Big Tech or self-hosting. There&#x27;s a myriad of not-big-tech email providers out there, for example there&#x27;s Posteo, who use open source software and green energy. They are going strong for 13 years now with 400+k accounts.<p><a href="https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Posteo" rel="nofollow">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Posteo</a>
gingerlimeover 2 years ago
Sending email out is a royal pain. Trying to deal with a Microsoft ban on my IP even though it’s sparkling clean for several years. DKIM, DMARC, SPF etc all ser up, reverse dns, you name it. Looks like Linode is being blocked as a whole pretty much?<p>Hate the level of centralization, particularly since there’s still a shit ton of spam still around. Sorry for the rant.<p><a href="https:&#x2F;&#x2F;docs.microsoft.com&#x2F;en-us&#x2F;answers&#x2F;questions&#x2F;674558&#x2F;550-57511-access-denied-banned-sender.html?page=1&amp;pageSize=10&amp;sort=oldest" rel="nofollow">https:&#x2F;&#x2F;docs.microsoft.com&#x2F;en-us&#x2F;answers&#x2F;questions&#x2F;674558&#x2F;55...</a>
评论 #32716546 未加载
评论 #32716325 未加载
评论 #32716277 未加载
评论 #32716482 未加载
评论 #32720287 未加载
评论 #32718405 未加载
jrm4over 2 years ago
This isn&#x27;t actually that hard to fix, it&#x27;s just that for whatever reason, we seem to frequently have this blindspot that we don&#x27;t seem to have in other industries.<p>Namely that &quot;do it yourself at home&quot; and &quot;massive oligopolist&quot; aren&#x27;t the only two options. It&#x27;s like saying &quot;You can only have hamburgers two ways, cook them yourself or McDonalds.&quot;<p>I do the third and it&#x27;s been great. I let my paid webhost handle it. (hostdime if you&#x27;re interested, but I&#x27;m sure others do it well also)
评论 #32717150 未加载
massaman_yamsover 2 years ago
I am not a Google employee, but I do work with email anti-spam at scale. There&#x27;s a lot to critique here but it boils down to three points:<p>1. Spam filter behavior has changed because spam has increased in volume and sophistication, not because ISPs want to save money, or to eliminate competition. Some techniques that worked well 5 years ago aren&#x27;t as effective anymore. One of the consequences of this has been a reduction in the value of IP reputation, from a spam signal perspective, particularly for low-volume IPs.<p>2. IP range reputation does matter. The increase in the value of IP range reputation, as a spam signal, has paralleled the decline in value of low-volume IP reputation. In practice, this means you need to either send enough volume to outweigh the reputation of your IP range (exact quantity varies based on a lot of variables, but as a <i>very</i> rough approximation, 1000 messages a day), or find an IP range with good reputation.<p>IP range reputation is not easy to assess, sometimes even for email professionals. So you can either gamble with a residential ISP IP, or a VPS IP, or you can find a provider that spends time, effort, and expertise on managing IP range reputation. The practical solution for most senders is the latter. Many of these offer a free tier, and many options are available among providers of all sizes.<p>3. The filtering behavior reported here is either misunderstood or misrepresented. First, no, no major ISP (Gmail, Yahoo, Microsoft&#x2F;Outlook, icloud) is going to permanently block an IP range; filters are designed to be dynamic. In severe, ongoing, high-volume spam scenarios, you could see a 2-week block, maybe occasionally 30 days. But never &quot;one strike&quot;.<p>Mail deletion without a bounce also cam happen, particularly at Microsoft, but again it&#x27;s almost never seen for legitimate mail - that response is reserved for long-term, severe spam scenarios, where anyone reasonable would agree that a block is warranted. And, again, this is dynamic.<p>So it looks like OP is either exaggerating, or has been trying to send from IP ranges with unusually bad spam problems.
评论 #32719227 未加载
评论 #32720653 未加载
评论 #32720452 未加载
m3nuover 2 years ago
Have around 100 users on my self-hosted mailserver. Works alright for the most part. Once or twice a year, there are connection issues to small companies with weird settings. I just route those over an external ESP.<p>Then there is also mxroute.com, which is an indie email provider. He seems to do fine too. Didn&#x27;t use them yet.<p>So I think having at least some sending volume is key to running an indie server. You can&#x27;t do it just for a few mailboxes&#x2F;users.<p>I still wouldn&#x27;t recommend to learn or start with email in 2022. There are better uses of your time.
评论 #32716472 未加载
lxchaseover 2 years ago
Reminds me of this fun story:<p>A person at a company mistakenly created an email list segment (or lack thereof) resulting in an email to the entire email list of hundred of thousands of emails. This combined with inexistent (we were a naive startup without an email specialist role) list hygiene practices meant we were blacklisted by Gmail after some time.<p>Took a year to get a hold of someone on Gmail&#x27;s spam team. We found out were on 4+ Gmail blocklists, some of which were ML-based. We couldn&#x27;t do anything to remove ourselves after we fixed the issues. A $1-2 million revenue channel dried up because we couldn&#x27;t get out of the Gmail blackhole (short of rebranding completely, rewriting content, and using a different ESP). Fun times.
asimover 2 years ago
This thread is quite enlightening. It seems the engineering community predominantly would like to be able to self host email (and presumably other services). By proxy of that I guess that email hosting is not just for one user but maybe also friends and family or some community that you are part of. It&#x27;s quite clear that managed centralised services accelerated the adoption of the internet, email, etc and the majority of consumers don&#x27;t really care about self hosting but it also speaks to the fact that we&#x27;ve given up ownership of this aspect of our lives without clear understanding of how it will affect us in the long term. If no one but large corporations own all the services we use then it puts us in a pretty precarious position.
yonixwover 2 years ago
&gt; ... [They use] spam as a scapegoat to nerf deliverability and stifle competition.<p>Disagree. It was a way too open protocol to begin with. From a time of innocence best suited for places with inherit trust like inside a business. And it&#x27;s not just spam. Phishing is also a huge issue.<p>As much as I want to sympathise, Email for the big WWW is unsalvageable IMO. Too many bad actors are out there.<p>&gt; [Solution:...] * There should be a recourse for legitimate servers<p>This is the same Big tech story. They want to cut cost, you want a human touch. You can see similar stories here in HN every week. Which is why I think it will never happen.
评论 #32716056 未加载
tounover 2 years ago
The topic often comes up. Can&#x27;t say I share the experience. My servers have never been put on a blacklist in the 7 years they&#x27;ve been running, and one of them operates from my residential DSL connection. Standard postfix+dovecot stack on an Archlinux VPS, I log in once a year to update the packages and make sure there is enough disk space left.
评论 #32718088 未加载
beprogrammedover 2 years ago
Know what will kill self-hosted email? Giving up and hosting your email with the big guys, the less self hosted email servers there are the less the big guys feel any requirement to support it
okasakiover 2 years ago
All that &quot;security&quot; just to fight spam. IIRC it was estimated that globally spammers make $300M per year from their spam. It doesn&#x27;t seem like much. Somebody joked that it would be better if we just paid them that much to do nothing.
评论 #32715874 未加载
评论 #32716443 未加载
评论 #32715811 未加载
评论 #32720836 未加载
derekzhouzhenover 2 years ago
I am still doing it, on a cheap VPS no less. Yes, it is hard, and yes, some large email vendors drop my emails for no reason. However, if everyone throws in the towel, they (the monopolies) won.
type_Ben_structover 2 years ago
I relate to this. I also stopped hosting my own mail server for this exact reason.<p>However I do think it’s a case of damned if you do damned if you don’t. As a consumer of big tech email I become equally frustrated when spam makes it past the filter and I expect them to do more.<p>If it’s easy for the average person to setup a mail sever with high reputation then it’s easy for spammers to do the same. I can’t think of a great way to manage this at scale for the average person using a $5 a month Digital Ocean VPS sending &lt; 10 emails a month.<p>One thing I have noticed is that there’s still a load of large organisations failing to implement basic deliverability best practices like SPF records. These organisations have themselves to blame.
评论 #32716296 未加载
the_third_waveover 2 years ago
Oddly enough I do not have these problems after self-hosting for close to 27 years now (i.e. from before spam became a problem). I hardly ever get any spam and my messages seem to arrive where they need to be even when that destination lies in Microsoft- or Google-land. I have the usual assortment of DKIM&#x2F;SPF configured for my domain, I send mail through a smart host operated by my IAP (at no extra charge) but for the rest I do not do anything special. Am I the exception to the rule, am I just lucky that my IAP&#x27;s smart host has not been blacklisted by the likes of Microsoft and Google or is the perception of self-hosting mail to be fraught with problems erroneous? I suspect the latter to be true, self-hosting is neither difficult nor bound to fail just as long as a) you have some good spam filters (easy), b) your MTA is set up with the correct SPF and DKIM records (also easy) and c) you send outgoing mail through a smart host (easy to configure once you&#x27;ve found one).
tsaixingweiover 2 years ago
I tried to operate my own email server as well on a VPS, and I have been thinking that the way to solve these problems is to solve the problem of spam itself. Detecting spam puts the costs on the email providers... when the costs should be born by spammers.<p>Perhaps some sort of digital stamp (digital signatures similar to stamps on physical envelopes) for each email sent paid for with micropayments in a cryptocurrency like nano (note: I don&#x27;t own any crypto). Small cost per email like 0.01 cents that is trivial for legitimate senders but not for bulk-sending spammers. SMTP servers should put all incoming unsigned emails into spam folders. This will disincentivize spamming (probably not eliminate it) enough that self-hosting emails might be possible again without having to swim against the tide.
评论 #32721452 未加载
评论 #32720311 未加载
评论 #32720275 未加载
rkwasnyover 2 years ago
After 19+ years of hosting my own email - It&#x27;s worth it!<p>Imagine someone revokes your access or deletes all your emails because of an error, at the scale of gmail or outlook.com it just happens.<p>For spam there is one solution:<p>- implement greylisting. It just solves the problem.
评论 #32717443 未加载
awinter-pyover 2 years ago
Hard to untangle the incentive for collusion + need to police legit bad behavior.<p>This <i>could</i> be a few large providers saying &#x27;we control most email traffic, let&#x27;s control <i>all</i> email traffic&#x27;. Or it could be serious players saying &#x27;spam hurts our users, let&#x27;s stop criminals using a blanket rule&#x27;.<p>More likely it&#x27;s a schelling point where large players are rent-seeking (crowding out some competition), but only to the extent they can preserve the illusion this is about policing spam.<p>Suspect we&#x27;ll start asking platforms to offer something like due process in the law -- administrative checks that increase the cost to administer a system, and reduce the quality to end users, but increase transparency and make it harder for the platform to engage in corruption.
tony-allanover 2 years ago
&quot;Newsletters from my alumni organization go to spam. Medical appointments from my doctor who has a self-hosted server with a patient intranet go to spam. Important withdrawal alerts from my bank go to spam. Purchase receipts from e-commerces go to spam. Email notifications to users of my company&#x27;s SaaS go to spam.&quot;<p>Are you talking here about incoming emails? I expected that these would be reliably delivered to you and that the problem is only with emails you send to the large providers?
pifover 2 years ago
Part of the problem is that the wrong people are complaining.<p>Using Google as an example, the author has no right to push anything to a gmail inbox. Google has no contract with the author to accept mail from him.<p>What Google is doing, it&#x27;s failing <i>its</i> customers, the people who signed on gmail to have an address where other people could send data to.<p>And now those people are not receiving everything they could, but it&#x27;s only up to them to decide whether this is actually a problem and whether it&#x27;s serious enough to contact gmail support.<p>I do understand the point and the spirit of the author, but he is actually conflating the freedom of speech with the right to be listened to.
评论 #32720858 未加载
devyover 2 years ago
OP Carlos Fenollosa mentioned this:<p>&gt; Over time I realized that residential IP blocks were banned on most servers. &gt; You just cannot create another first-class node of this network. &gt; Email is now an oligopoly, a service gatekept by a few big companies which does not follow the principles of net neutrality.<p>It&#x27;s unfortunately true. However, the reason that how we end up like this is more nuanced than just the big players trying to power grab (perhaps) but rather because of the rise of spam&#x2F;scams&#x2F;phishing&#x2F;malware. All big players like Google (Gmail), Microsoft(Outlook&#x2F;Live.com&#x2F;Hotmail), Yahoo!, Apple (iCloud) are suffering from those threats, wasted bandwidth and compute on spam detection heuristic AI.<p>There are industry consortiums like Spamhause and commercial entities like Barracuda to maintain blacklist&#x2F;whitelist to restrict access of major MTA network interconnect to fight off spams&#x2F;malwares&#x2F;phishing&#x2F;malware delivery from botnets and individuals. And it helps, at the mean time, it consolidated the control of who can send outbound emails.<p>We are seeing this trend repeatedly in other communication channels like phone calls (due to robocalls, VoIP numbers are being blacklisted by all major players&#x27; services) or Text messaging (due to spam texts, major U.S. wireless carriers band together established Campaign Registry to control who can mass send outbound text messages. This is also known as 10DLC registration).<p>I think the vulnerabilities of previous communication protocols (email, VoIP, SMS&#x2F;MMS) lie in the fact those protocols are designed with security in mind. Modern community protocols like Push Notification has been designed with security in mind, which make it less susceptible to abuse and spamming. That&#x27;s probably the way go forward.
kazinatorover 2 years ago
&gt; <i>So, starting today, the MX records of my personal domain no longer point to the IP of my personal server. They now point to one of the Big Email Providers. </i><p>A MX records don&#x27;t have to point to an IP; it can point to a host name.<p>My MX record is a dynamic DNS host name.<p>&gt; <i>Big email servers permanently blacklist whole IP blocks and delete their emails without processing or without notice. Some of those blacklists are public, some are none.</i><p>OK, but if you&#x27;re having trouble sending, that&#x27;s no reason to do anything with your MX record, which is for receive only. Just route outbound SMTP through someone forwarding service.<p>I&#x27;ve run my mail domain for twelve years. In that time, I&#x27;ve not sent SMTP directly to anyone; always through the SMTP forwarding host run by my ISP.<p>Well, you know, the mail is going through that ISP anyway! If I could directly connect to port 25 of various hosts around the net, I would still be routing through that ISP&#x27;s hardware. So the fact that mail is routed at a higher semantic level through their SMTP server, rather than just at the IP level, just almost just a footnote.
评论 #32716747 未加载
评论 #32717089 未加载
评论 #32741545 未加载
jwildeboerover 2 years ago
My little e-mail Server on an OVH VPS is happily sending and receiving e-Mails to&#x2F;from the big ones without problems for my 20+ domains. Just a basic postfix&#x2F;dovecot setup with letsencrypt certificates and SPF&#x2F;DKIM&#x2F;DMARC working the way it should. I described everything in a short blog series at <a href="https:&#x2F;&#x2F;jan.wildeboer.net&#x2F;2022&#x2F;08&#x2F;Email-0-The-Journey-2022&#x2F;" rel="nofollow">https:&#x2F;&#x2F;jan.wildeboer.net&#x2F;2022&#x2F;08&#x2F;Email-0-The-Journey-2022&#x2F;</a> in case you are interested.
tedivmover 2 years ago
I started hosting my own email in 2004 before finally giving up and migrating my email to Fastmail last year.<p>Besides the problems mentioned in this post the real problem I had was dealing with spam. The open source community around spam has really degraded over time, to the point where most solutions are extremely high maintenance and require regular tweaking. Methods that used to work, like greylisting, cause problems when dealing with GMail because google doesn&#x27;t play nicely with it. The big spam blacklists have also gotten a bit less trustworthy over the years.
评论 #32716992 未加载
评论 #32716742 未加载
评论 #32716713 未加载
reuvenover 2 years ago
Yeah, I ran my own e-mail server from 1995 until about 10 years ago. It used to be fairly simple, but between incoming spam and attacks, the various standards that were developed, and my e-mail not getting through... this became a problem that was worth paying someone a few dollars a month to solve for me.<p>I still use my own domain, but I&#x27;ll let actual delivery and security experts deal with the day-to-day running of things, while I run my business (which definitely isn&#x27;t that).<p>It was a bit sad to give up, but the time and frustration it saved have been more than worthwhile.
electric_mayhemover 2 years ago
The fix here is use a commercial provider for outbound smtp but continue to self-host inbound.<p>Not ideal, but it works.
评论 #32716331 未加载
评论 #32716387 未加载
bob1029over 2 years ago
Proper, artisanal self-hosting of email can still be viable depending on your expectations and tolerance levels for random issues.<p>These days, I operate with the medium-temperature bowl of porridge: AWS WorkMail with custom domains &amp; users. My use case is basically &quot;Replace gmail for personal email&quot;. I don&#x27;t have a lot of patience for running an actual email server, so this is about as custom as I can get.<p>Running a custom email domain can have other practical implications, such as having to carefully re-iterate spelling when mentioning your email address over the phone to a customer support agent. With a gmail or hotmail account, virtually everyone can type that hostname in without thinking about it. This concern is moderated by being able to select a username with fewer than 5 characters, rather than your full legal name appended with your date of birth.
Joel_Mckayover 2 years ago
The cloud services providers have some of the worst IP blocks for spam. Cheap hosting blocks are a distant second place.<p>Google for example, doesn&#x27;t even hide the fact you have to request whitelisting using their online business services portal. They don&#x27;t give a toss what kind of sender authentication&#x2F;signing hoops you have jumped through already, and user letters may still end up in the spam bin.<p>Many users have indeed migrated to the web platforms, and don&#x27;t care about people data-mining their business communications. The real issue is so have many spammers&#x2F;scams, a side-effect keeping their trade on life support by removing technological administrative barriers for the desperate... and you can&#x27;t block Google&#x2F;Outlook&#x2F;Redmond.
zh3over 2 years ago
Hosting an email server on a consumer IP does seem to a losing proposition,<p>Hosting an email server on a cheap (reputable) cloud server and doing the basics (PTR records, SPF etc) still works well.
评论 #32716238 未加载
seomintover 2 years ago
Completely agree this is anticompetitive and worthly of examination under the light of antitrust laws. Of course the defense that will be offered and one which is partially true will be one of providing safety from spam, phishing, and other evils prevalent in the email system today. Maybe texting is the new email after all...
sgtover 2 years ago
Very interesting, I&#x27;ve self hosted my e-mail since 1999, which incidentally is 23 years ago. My current server is at Hetzner in Germany.
评论 #32716618 未加载
gerdesjover 2 years ago
The real problem is and always has been &quot;reputation&quot;. Now the big boys fuck that up by definition from the start and require you to do the heavy lifting: DNS, SPF, DMARC, DKIM and so on.<p>I run several email domains quite happily in the UK. I know why it works and I don&#x27;t resort to magical thinking. My ISP is considered a business one and my IPs are static. I&#x27;ve owned both my work and personal ranges for a while.<p>Feel free to contact: furtle@blueloop.net - I&#x27;d love to hear your ideas.<p>Cheers Jon
ryan-cover 2 years ago
I&#x27;ve been self-hosting since 2004. I currently route via a VPS. The only issues I have seem to be with outlook.com&#x2F;hotmail.com&#x2F;etc - free Microsoft accounts. That goes to junk, though replies seem to work fine. Paid Outlook365 seems fine.<p>Even after speaking with Microsoft&#x27;s email admin team on the phone a couple times, I still have issues. It&#x27;s kind of infuriating.<p>I have properly configured SPF+DKIM (selector rotated daily)+DMARC, and I&#x27;ve gotten set up with dnswl.org.
psyfiover 2 years ago
I hosted my mailman stack on VPS for some time, it worked well<p>I stopped self-hosting because it&#x27;s too much hassle, but it was any difficult to maintain, (by difficult I mean complex)<p>It didn&#x27;t worth the time I spent though, so I quit, but I would do it again if I need to<p>If I had to maintain a server at home and my ISP blocks it, I would get a VPS and host proxies on the VPS and use VPN tunnel to keep the mails stored locally<p>But I don&#x27;t have any reason to do that currently, as well as most people
deknosover 2 years ago
I already wrote this also in another thread. Which was not also only was suggested by me:<p>* implement and publish policies which emails you accept (regex&#x2F;strings on domains, emails, headers, signatures and so on)<p>* found a association where all use this strict (which shall potentially be stricter than gmail and so on) settings and if gmail does not accept these emails, sue them for discrimination.
thewebcountover 2 years ago
Totally naive questions:<p>Could we come up with a new protocol (possibly based on SMTP&#x2F;IMAP&#x2F;whatever), that would only guarantee to get your email to its recipient if you included some sort of token generated by the recipient and given to you? Something where you could text&#x2F;message&#x2F;whatever a unique token to a friend&#x2F;business&#x2F;etc. and then they can send you email? And if you email someone, your outgoing email includes the token necessary for them to reply? The contents (including who it’s being sent to) would be encrypted by default rather than being plain text that anyone in between sender and recipient (or at least sender and recipient servers) could read. Is something like that possible?<p>Obviously at first nobody would have it implemented, so you’d have to get developers interested in writing server and client software, and convince people and companies to use it instead of or in addition to regular email. But I wonder how many people would be interested in such a system and whether it would be workable?
评论 #32719090 未加载
Daegalusover 2 years ago
I gave up self-hosting ages ago. For a while I even used the old Google for Families grandfathred in setup. That also went the way of the dodo a few years ago for me.<p>I signed up for ImprovMX, setup my domains there, and just route my emails to whatever service I want. I use a random gmail account that I use for my login and Google services, but the email itself is never exposed anywhere, I only give out the custom domain one.<p>ImproveMX handles routing for my whole family. My mom uses Outlook, and it routes there for her. If google, microsoft, or whatever give me trouble or ban me, I just quickly switch the email and nothing lost.<p>If you pay for their service, since they have a super generous free tier, you also get SMTP servers to use as outbound, which lets me send emails through them and not have the `on behalf of` email thing. Also they do all the work to make sure their IPs aren&#x27;t blocked and in good standing with MS, Google, etc.
评论 #32719647 未加载
betwixthewiresover 2 years ago
I know a lot of older guys will disagree with me here, the guys that use mailing lists to work on FOSS projects, many of whom I respect very much, but I think email sucks. I only use it for the same reason I have a phone number: because some people need me to have one in order to contact me.<p>I don&#x27;t like email. I think the problems with it are shortcomings of the protocol. I&#x27;d rather not use it. But I do, as a last resort contact method.<p>For me, people that use email are like people that primarily communicate over SMS. If I need to talk to you and that&#x27;s all you&#x27;ll use, I can. But if there&#x27;s another way to talk to you I&#x27;d rather use that. Xmpp, matrix, signal, shit even telegram and discord if I have to, are preferable to SMS or email. But otherwise, yeah I have some email addresses and a phone number if you insist on doing things that way.
prmoustacheover 2 years ago
Author do not mention the frictions of going the other side (gmail&#x2F;hotmail&#x2F;live):<p>- you might not receive all the emails people sent to you, for the reasons mentionned in this very article<p>- you will receive much more spam&#x2F;unwanted email. I quit using a gmail account because I kept reveiving newsletter and notifications from other people who kept mistaking his account with mine. There was probably a one letter difference in their real email address and mine. I surrendered and gave up trying to tell his relative they weren&#x27;t reaching the right person, only had fun once by powning his NAS with a &quot;cloud function&quot;, and gave up after receiving tons of newsletters and other shit.<p>- you can lose your account any day, for any reason without any possibility to get it back. I&#x27;ve seen it happen to 2 people with hotmail.
rootusrootusover 2 years ago
Of course it all started with spam. But the response was just as destructive. I worked for a small ISP (25K email customers) back in the mid-2000s, and it was so hard to keep email flowing. All it took was one random customer somewhere on our DSL who had a misconfigured open relay, and spamhaus would blacklist us. They wouldn&#x27;t respond when we&#x27;d try to get the block lifted. We tried and tried to work with them to streamline the process, nobody wanted spam to go through our servers, but they weren&#x27;t really interested in any cooperation. They were perfectly happy to stop all legitimate email if it stopped a single spam.<p>I don&#x27;t work there any more, but I&#x27;d be surprised if that little ISP hosts their own email servers nowadays. It&#x27;s so expensive to deal with such issues, it&#x27;s just not worth it.
exabrialover 2 years ago
How do people that work for Google on HN continue to work there without their conscience bothering them? These are terrible monopoly abuses and you’re contributing.
评论 #32719432 未加载
williamtraskover 2 years ago
It’s time for the US mail service to digitise and fulfill its constitutional obligation to provide a private, secure mail service for all American citizens.
thayneover 2 years ago
How I wish spam was handled:<p>1. Any email that isn&#x27;t signed with DKIM is blocked (having a signature specific to the source email address would be better, but that is probably too much to ask for)<p>2. If the sender isn&#x27;t in your contact list, block it, or at least mark it as spam.<p>3. Have an easy way to add new entries to you contact list, maybe a new url scheme similar to mailto:? So that it reduces the friction of say getting a confirmation email when signing up for something, or making sure you get emails from a new acquaintance. It would probably be good to have a way to add a full domain to the allowlist as well.<p>But that would make selling&#x2F;sharing email addresses a lot less valuable, so there might be some resistance to that from marketing and adtech.
rabiteover 2 years ago
&gt; Blacklists should not include whole IP blocks. I am not responsible for what my IP neighbor is doing with their server.<p>This is obviously laughably naive and creates infinite sources of spam.<p>Before doing a proposal on a core Internet technology you should be required to be on the other side for a while. Do anti-spam at a large retail e-mail service provider for a year and then you can understand the problem space.<p>You might not be responsible for what your neighbor is doing with their server, but the ESP is responsible for filtering it. The idea that they need to treat each and every comcast IP with equal weight is nuts. IP reputation is the single most valuable tool in the industry; the largest statistical predictor of whether or not an email is abusive.
shirroover 2 years ago
I have self hosted for 20 years. If you want perfect delivery then completely self-hosting isn&#x27;t for you. It is a good learning experience and once setup it does not require much attention.<p>A compromise solution is to outsource delivery which is by far the shittiest part of self hosting because of bad business practices and lack of regulation. It is the least interesting bit anyway.<p>My email server is setup with policies commented out to send outbound emails through another host I maintain if required. When a very large company hosting lots of email for many domains mass ip blacklisted my hosting provider late last year I used this to maintain connectivity while the companies sorted out their dispute.
janandonlyover 2 years ago
It&#x27;s strange that in his list of possible solutions to keep e-mail spam free, there is zero mentioning of hashcash [1].<p>No, that is not a shitty crypto coin. It&#x27;s just a computational proof that your computer spend some seconds on hashing, which is fine if you send 1-to-1 emails like real people do, but not if you are a spammer who bought a file with 6 million leaked e-mail addresses.<p>See Back&#x27;s 2002 paper &quot;Hashcash - A Denial of Service Counter-Measure&quot;.[2]<p><pre><code> [1] https:&#x2F;&#x2F;wikiless.org&#x2F;wiki&#x2F;Hashcash [2] http:&#x2F;&#x2F;www.hashcash.org&#x2F;papers&#x2F;hashcash.pdf</code></pre>
Kim_Bruningover 2 years ago
It should be possible for everyone to participate in internet systems equally as peers.<p>Somehow it seems like the Overton window has shifted such that people find it acceptable that ordinary individuals can no longer take part in the email infrastructure as equal peers.
评论 #32717766 未加载
systems_glitchover 2 years ago
This is pretty much exactly the reason I stopped running my own mail. I had the mail host on a static IP, part of a block of &quot;pristine&quot; IPs from a local colocation operation (iNOC in Albany, NY). Ran fine for years, but I started having to call more and more customers about &quot;why haven&#x27;t you answered my email from two weeks ago?&quot; only to find out I ended up in the spam bin. Wasn&#x27;t worth it when the risk was losing business.<p>I moved to Proton Mail as I like their simple interface and support their goals. Pretty good service so far, worth paying for, but I do sort of miss running my own services.<p>If you run your own mail server in 2022, you are the resistance.
gwnywgover 2 years ago
I host my mail for around 12 years so only half as long as the author of the article, I faced the same problem- that my emails land in spam for some people. In most cases it&#x27;s those people who care to receive my email and I always tell them it&#x27;s their provider who is at wrong and that they should switch. We have some laugh together, exchange some jokes and continue with our lives. I&#x27;m one of not many who love postfix and dovecot enough to use it to self host, but I&#x27;m fine with that, I won&#x27;t throw towel and will continue to run my email, hopefully I&#x27;ll be lucky enough to run it for next 12 years :) Peace everyone :)
ShowalkKamaover 2 years ago
&gt;I implemented all the acronyms, secured antispam measures, verified my domain, made sure my server is neither breached nor used to relay actual spam, added new servers with supposedly clean IPs from reputable providers, tried all the silver bullets recommended by Hacker News, used kafkaesque request forms to prove legitimity, contacted the admins of some blacklists.<p>I cloned a repo, edited two lines in a yaml file, ran docker-compose, logged into a web ui, added my domain, added a couple of dns records (MX, spf, dkim, dmarc) and everything worked (yes, I can deliver emails to gmail and outlook).<p>I honestly have no idea why so many people say that self hosting emails is hard.
评论 #32716430 未加载
评论 #32716408 未加载
评论 #32716490 未加载
评论 #32716494 未加载
评论 #32716403 未加载
yonrgover 2 years ago
I&#x27;ll keep going with my private server (on a vps). I just moved it to another hoster, meaning new IP block. This caused blocking issues: Some but not all gmail address delivered to the spam folder. Another big mail provider asked me to set up a web page with contact info on the same domain I use for mail. And another self hosted mail server from a public service agency had me on block list.<p>This caused me some headaches and I was thinking this could be the end and I have to use one of the big players. But I did not give up, invested time and it works now again!
hpcjoeover 2 years ago
I&#x27;ve been debating whether to do this myself (throw in the towel on mail). I am getting tired of fighting all the assorted battles.<p>This said, my concern is that the big players seem like they could, at a whim, drop you as a customer, with no recourse. This is what is giving me pause going to the big providers.<p>I&#x27;ve been looking at mail distributions like Mail-in-a-box, and modoba as an intermediate, though none of them seem to be great. Basically I don&#x27;t want to stitch together several different opinionated tools into a working mail system anymore.
评论 #32720700 未加载
unixheroover 2 years ago
I am self hosting. It works and I have no problems.<p>I use <a href="https:&#x2F;&#x2F;cloudron.io" rel="nofollow">https:&#x2F;&#x2F;cloudron.io</a> for orchestration, security - to run it on a VPS. Everything just works.
tayiorrobinsonover 2 years ago
I did training provided by a large email security firm, and one thing the presenter said was along the lines of &quot;this spam filter defaults to block the senders domain &amp; IP, you can set an expiration on that block butI don&#x27;t see a reason why you would&quot;. One misconfigured server sending out a single email and I assume by extension someone impersonating your domain could get you perma-blocked from sending emails to that company, and I assume it&#x27;d reduce your trust rating for other orgs using that provider.
naikrovekover 2 years ago
to me, the root cause of this is just money. a LOT of people have zero scruples when it comes to money, so they consider sending email to every email address they can find, in order to hopefully make a sale, to be a perfectly valid tradeoff.<p>these people deny that they are causing a problem, or that they ever caused a problem, because admitting that would mean they are a bad person, and they&#x27;re not a bad person! they&#x27;re &quot;just trying to feed [their] kids, man.&quot;<p>making decisions based on money alone is always a bad idea. ALWAYS. I do not care if it is one person and one decision, or if it is a business making a decision on behalf of their stock holders, or anything else.<p>if money <i>alone</i> is your decision-making criteria, you are making a bad decision, or you are making a decision on bad criteria.<p>someone always pays for everyone&#x27;s scramble for money. someone always pays, and it is always an unjust payment.<p>in this case, spammers have cost us our ability to self-host email, which is a very significant problem, as described by the author of the linked article, with rather severe consequences if you hope to have any freedom on the internet.<p>so, if you work for a company that will, over time, do just about anything to get people to click on ads, you are slowly destroying the internet as it was intended to be, and was, for 2-4 decades, depending on how you define that.
aimorover 2 years ago
Funny thing happened to me today: Gmail sent its own Google Fi customer support email to spam. Haha, wish I noticed that before spending my morning going in circles with chat support.
评论 #32716340 未加载
krater23over 2 years ago
I self host my private email server since 2005. Never had big problems. One time my server was wrong configured and then marked on spamhaus. Just fill in a form and all works fine again. Maybee gmail will blacklist me in some weeks, but fuck you gmail, I have nearby no one that uses a gmail account. I had in all this year no problem with any other peer. So, maybee the writer has just a malconfigured mailserver or don&#x27;t know that he is marked on spamhaus because any reason.
jwieover 2 years ago
The range IP bans hit home. Been hit by this more than a few times. You don’t have to be sending spam, but if someone in the range did, ever, you will be blacklisted all the same, and treated like a spammer.<p>The people who run these blacklists are unreasonable. I can understand why, they tend to interact with the bowels of the internet and the heuristic is effective. Usually people who need to talk to them are doing something naughty, so why bother taking a chance?<p>Guilty until proven innocent would be an improvement.
bArrayover 2 years ago
I know of some small servers that get a lot of spam and hacking attempts, and their most effective tool against abuse is an IPv4 block ban. Increasingly this became more and more difficult, and I assume email servers are at the same point. Thanks to VPNs, people appear to be able to spawn insane numbers of random IPs.<p>One solution this decentralized server system came up with is the concept of accounts that have some barrier to entry to create (which involves a delay and proving identity). This account has a private key and it uses this to access the servers through any IP. Abuse on this account and any connected accounts of course leads to the key being temporarily revoked. Lots of positive interactions with well established accounts increases your credibility. Lots of reports decreases you credibility.<p>If you have been sending credible emails with multiple hosts for 10 years, even if you did get flagged, you would be given the benefit of the doubt. Hell, it should be easy to email the host and give them the headers and the reason why the email was flagged.<p>About the email space now being owned by big tech, it could simply be time for a boycott until they improve their practices. There is far too much centralization on the web now, and we all contribute to it every time we use an external service rather than host our own.
评论 #32717622 未加载
daitangioover 2 years ago
I am still hosting my emails via docker mailserver[1] I got some trouble with outlook.com bans, but Linode helped me to switch to a “good” ip address and it is working fine for now.<p>I will try ti resist as much as possible, because email is your primary identity “link” on the Internet, and you deserves to own it if you want.<p>[1]: <a href="https:&#x2F;&#x2F;gioorgi.com&#x2F;2020&#x2F;mail-server-on-docker&#x2F;" rel="nofollow">https:&#x2F;&#x2F;gioorgi.com&#x2F;2020&#x2F;mail-server-on-docker&#x2F;</a>
评论 #32722514 未加载
sys_64738over 2 years ago
1999 was a pretty late adopter to the self-hosting email cause since it was pretty apparent since 1997 that free email was going to win out. As Gmail filters get smarter then it becomes an altogether more fruitless cause. Email hosting at the individual level died out for most due to this and the pointless rivers of spam you had to deal with. If you&#x27;ve only now come to the realization that you can&#x27;t make it then you&#x27;ve been wasting a lot of your life.
xeno42over 2 years ago
I&#x27;ve been hosting my email on my own server since the 90s, but got tired of dealing with keeping up with spam filters. Updated the MX to deliver inbound to mailroute.net and have them do the filtering before forwarding to my server and that&#x27;s been working great for years. Not free, but not expensive and still gives me 99% of the control i want with very good spam filtering too.<p>Outbound mail is relayed via mailroute too, which solves the tainted IP delivery problem.
znpyover 2 years ago
In fairness, things like postfix usually ship with very poor (not to say “moronic”) defaults.<p>Like, postfix won’t even try to connect to tls-enabled smtp for outgoing email by default, and you have to explicitly point it at the certificate bundle it’s supposed to consider valid.<p>And you have to tell explicitly to reject incoming plaintext connections from the public internet.<p>And quite a bit more… Like, why doesn’t postfix have its own freaking spf&#x2F;dkim implementation BUILT IN?
评论 #32720067 未加载
评论 #32717878 未加载
jeffbeeover 2 years ago
Is there actually a &quot;big tech&quot; email provider that accepts a message with a 2xx SMTP code and then deletes it? The only one I personally know of never does that. That one also does not use anything like an IP address blacklist. This article doesn&#x27;t name names, it just waves its hands and throws around some innuendo. But as far as my own personal experience goes, this author has no idea what they are talking about.
评论 #32722863 未加载
评论 #32717094 未加载
评论 #32716784 未加载
jokethrowawayover 2 years ago
Sending emails with dkim + sfp and I never had big problems with reachability and a postfix server on Digital Ocean.<p>I haven&#x27;t done it since last year though. Has something gone terribly wrong?<p>I remember debugging issues with email sent via aws ses to Hotmail addresses at $dailyJob but I can&#x27;t think of a single Microsoft product that works well (windows, teams, azure, now even GitHub is starting to work every other day) so it doesn&#x27;t surprise me.
cushover 2 years ago
Big email companies were never threatened by self-host. Spammers ruined it, not big email companies. Spam is an incredibly difficult problem to solve.
AlbertCoryover 2 years ago
I managed 3+Mail at 3Com 35 years ago, and in fact, it gets its own subplot in The Big Bucks (<a href="https:&#x2F;&#x2F;www.albertcory.io&#x2F;the-big-bucks" rel="nofollow">https:&#x2F;&#x2F;www.albertcory.io&#x2F;the-big-bucks</a>), back when email was brand-new (well, for most people).<p>However, nowadays I&#x27;m bored with stuff like this. PITA. So I totally sympathize with the author.
ttulover 2 years ago
My company exists to solve this problem at scale for the web hosting industry. It’s too bad that self-hosting isn’t viable because of IP reputation problems, but it’s a reality that is unlikely to change any time soon.<p>I’d say if you want to continue self-hosting, just let go of the delivery part. Use a service like SendGrid; it probably won’t cost you anything and it’s easy to set up.
indigochillover 2 years ago
I&#x27;ve been trying for the past week or so to break into the self-hosted email game since I had a VPS and found some tutorials and documentation for postfix + dovecot. I did eventually get inbound and outbound email working although I was using an alias when I think I needed to use a virtual mailbox (to both receive and send email from a user with a different name from the unix user behind it, as right now outbound still leaks my unix username).<p>But then I looked at Protonmail&#x27;s cost and it&#x27;s less than I&#x27;m paying for my VPS (which is already cheap for the use I get out of it) so I&#x27;m on the fence whether I keep hammering away at that (and then have to wrestle with the big players treating me like a spammer and do my own spam filtering) vs just pay for that convenience. The VPS is staying in any case so it&#x27;s just a question of whether I pay a little more every month for convenient secure mail.
jgsaauover 2 years ago
G&#x27;Day Carlos We started hosting own SMTP servers on IBM OS2 using a BBS. Long before retail NET was in Oz. Fast forward to today and we have a DB with millions of IPV4 address and have never used IPV6, cloudflare or a 3rd party to 100% stop spam like we do day in day out. You are absolutely right, there are a lot of criminals you are wearing suits who are selling snake oil. We have X simple rules, one is that inbound port 25 sessions from spammers are put to sleep and we give them a very poor service. Our servers seem overworked and they often go away never to return. I read your blog post and from approx. 30 years experience including SMTP at gov.au and gov.nz content filtering does not work. Our NoSpamAccepted ( NSA ) AI powered SMTP servers use the network to stop spam. How many domains &amp; sub-domains are you self hosting ? TIA KG BTW - We have never been in the BLs as we only relay our outbound
SailingCactus33over 2 years ago
I have been self hosting email for just over 23 years and I am more emboldened than ever to keep doing so. Even with SPF&#x2F;DKIM&#x2F;DMARC setup, I am constantly asking people to check their spam folder, add me to their contacts, etc. I refuse to pay an email tax to one of the larger players to solidify their hold over the protocols.
mcvover 2 years ago
Are the big tech email servers truly not used for spam at all? Because if they are, shouldn&#x27;t they be permabanning each other as hard as they ban the little guy?<p>Clearly they&#x27;re using different rules against each other than against small email servers, and I think that&#x27;s all the evidence you need to get the EU to take action here.
评论 #32722285 未加载
doubledad222over 2 years ago
Did you properly set up DKIm, Dmarc and SPF? I have been hosting my own email through a VM in Texas for about two decades. Whenever I had problems with rejected deliveries, they were solved by moving to the new standards the internet invented to fight spam. Did you use a dmarc analyzer to verify you were set up correctly?
citrin_ruover 2 years ago
I self-host email for a bit less than 20 years and still not given up. Being blackholed by Microsoft or Google is a real risk (though I was lucky so far), but at least I fully control receiving side - if I expect a message I can check my logs to see if there was a delivery attempt if it was not successful why.
peter_retiefover 2 years ago
I tried to host a home email server a few times and it was a pain to say the least. Finally I created a droplet on Digital Ocean and used Mail in a Box <a href="https:&#x2F;&#x2F;mailinabox.email&#x2F;" rel="nofollow">https:&#x2F;&#x2F;mailinabox.email&#x2F;</a> with a glue record to act as a name server. So far so good
taf2over 2 years ago
I like a lot of what’s being discussed here. One thing to consider is a similar problem I am facing is people trying to hack into a login page. We see thousands of requests per minute from different IPs… many from VPS, some from obviously hacked TVs&#x2F;devices. We could implement an exponential back off on abusive IPs but detection requires observation of action that action could result in a compromised account… so another idea is we simply block large ranges of know bad IPs from blacklists… I think this is similar to the email sending issue… it’s not fair and I think a solution could be some kind of “block chain” - make it expensive to login… make it expensive to send an email… but I’m not sure and for email it’s way harder because you need agreement from the oligopoly of email providers… not sure what the solution is
gistover 2 years ago
There is even a much larger problem here other than not being able to self-host your own email. The issue is that large providers and large companies have no accountability. No way to ever have a conversation with an actual person (email or by phone) to resolve a simple problem or mistake in an algorithm or automated process (or even a manual process if that&#x27;s what it is). Canned replies not reply to follow up question not a care in the world or a conscience. And the fact that the service is free (to someone) does not mean a company should be able to so easily do what they want and cause aggravation to others.<p>And it happens even with paid services at large companies.<p>That is not &#x27;just business&#x27; and has never been the way business operated pre-internet except in a few super rare (and perhaps rare monopoly) situations.
eductionover 2 years ago
The Helm email server — funded by future YC CEO Garry Tan’s VC firm, but I bought one before he returned – is a really great compromise between privacy and convenience.<p>The IP block is managed by the Helm co., they tunnel connections and sell you the (tiny, silent) server and software. Each Helm server generates its own TLS cert, so the tunneling does not violate your privacy (unless it was delivered without TLS, in which case your privacy already vanished upstream).<p>The only delivery issues I hit are sometimes with Outlook&#x2F;Microsoft managed domains. It’s been at least a year since I had that issue. When I first bought one someone on gmail had to move a message of mine out of spam, but it’s been fine since. Last I checked their infra is hosted on AWS but apparently they have some screening technique for getting clean IPs.
secabeenover 2 years ago
The general rule of thumb for my home server is that messages to people I&#x27;ve contacted before, or to addressees that were in a thread that I&#x27;m also part of get delivered reliably. Messages to new people I&#x27;ve never emailed before often go to spam. I&#x27;ve learned to accept this.
评论 #32716265 未加载
avnigoover 2 years ago
Not to mention that your email is tied to your online identity in many ways when mostly every account you make asks for an email to use as your username, verify your account, or recover access to your lost account.<p>Handing over control of your online identity like that to a centralized third party when you could be cut off at any point [insert here any recent news about people wrongfully losing access to their Gmail account and not getting it reinstated] seems like the wrong solution to be allowed the privilege of sending email.<p>I guess the very least we could do to keep some control is to own (read: rent) your email domain you could move elsewhere in case you lose access, but then you gotta make sure you don&#x27;t also lose access to your email domain.<p>Is there an actual solution to all of this?
评论 #32721825 未加载
zxcvbn4038over 2 years ago
Giving large providers a taste of their own medicine might be interesting, let gmail spend 24 hours on a black hole list, make sure the removal forms have a captcha so they can’t be filled out by automation, when people complain on social media then let people know what it’s about. Social media really gets Google’s attention, it draws them out from behind their algorithms and silence when nothing else will.<p>Utilizing IPv6 more might help also since at some point it becomes absurd to have quintillions of addresses blocked for all eternity.<p>There are monopoly and racketeering angles also, since Google and Outlook are suppressing independent mailers in favor of their own paid products. Nobody will make any money except the lawyers but that’s ok as long as the situation improves.
评论 #32720466 未加载
drchiuover 2 years ago
A big problem with the way the big companies fight spam is that sometimes it is a bit too aggressive. Happened a couple of times where legitimate government-agency emails had trouble getting through.<p>Personally, I prefer defining my own spam list rather having an algo decide what pops into my inbox.
RockingGoodNiteover 2 years ago
What do I do? I got rid of Spamassassin after being challenged by someone on HN or Reddit, can&#x27;t recall which. Spamassassin is pretty effective but was consuming too much of my time.<p>So I stopped. I analyzed mail for a few weeks to look for patterns in the wild with my server. I came to the conclusion to block all but the top level TLD&#x27;s. That decision yielded very positive results.<p>I then wrote a simple SPAM blocking server to allow me to block habitual or suspicious TLD SPAM sending domains, as well as a few custom checks for common sense things.<p>As a result of those two decisions, I am now at or better at blocking SPAM than I was with Spamassassin and 2 other related tools I just remembered I also stopped using, spamass-milter and postgrey.
rospayaover 2 years ago
RBLs and other blacklists have been annoying for decades, even more so when they were maintained by annoyed individuals rather than corporations like today. You had to beg a single person to remove you off a list that an ISP somewhere used without thinking twice about it.
renewiltordover 2 years ago
Honestly wish there were a mode where you pay me $x to send me email and I can sort by spend.
评论 #32716589 未加载
kmeisthaxover 2 years ago
&gt;In many countries politicians are forced to deploy their own email servers for security and confidentiality reasons. We only need one politician&#x27;s emails not delivered due to poorly implemented or arbitrary hellbans and this will be a hot button issue.<p>&quot;I just the other day got... an Internet was sent by my staff at 10 o&#x27;clock in the morning on Friday. I got it yesterday!&quot;, as Ted Stevens would say.<p>Unfortunately the man said this as part of a massive, uninformed speech[0] about why big tech[1] needs <i>less</i> regulation.<p>[0] <a href="https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Series_of_tubes" rel="nofollow">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Series_of_tubes</a><p>[1] Comcast inclusive
评论 #32716682 未加载
alyandonover 2 years ago
I&#x27;d like to consider migrating from my self-hosted solution but it seems like all major email providers want $ per month per user|mailbox. Are there any providers out there that charge a reasonable fixed amount for say 50 mailboxes?
评论 #32720915 未加载
f1recatover 2 years ago
Same here, I’ve been hosting my email since 2007 and gave up in the beginning of this year, mostly due to constant delivery issues with microsoft infrastructure, which can be mitigated for a couple of months before coming back again
almogover 2 years ago
&gt; The industry should fix email interoperability before politicians do. We will all win.<p>Not sure if by &quot;politicians&quot; he means legislators, but given very few players that control today&#x27;s email deliverability, while doing very little to provide observability (=feeback loop) to the users who needs it most (that is users who cannot afford to build an expensive pipeline that optimize deliverability), given all that, I think regulation around distributed protocols observability&#x2F;fairness is not unlike AI explainability regulation, only I expect that with mail it shouldn&#x27;t be as hard to implement.
warentover 2 years ago
For those interested, I made a post related to this topic a few months ago: <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=31180379" rel="nofollow">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=31180379</a>
评论 #32716543 未加载
chasingover 2 years ago
Yup. I have to pay Google a chunk of change every month to do something I used to be able to do for myself for free. Because suddenly they flagged my domain and no one would get any of my e-mails.<p>And there ain’t nothing I can do but pay.
martin_aover 2 years ago
I&#x27;ve been self-hosting my mail for 17 or 18 years now, by purchasing just some managed webhosting package from somebody who cares about their services not being used for shady stuff (any reputable managed hosting provider) and I think I&#x27;ve never &quot;lost&quot; an outgoing mail for personal use.<p>I don&#x27;t understand what the author thinks it&#x27;s so hard here and why he&#x27;s painting it so black and white. There&#x27;s lots of more to &quot;my own e-mail&quot; than choosing between some old notebook running and collecting dust in your garage and using GMail.<p>Some people just want to find a hair in the soup.
stillbourneover 2 years ago
I&#x27;ve been using exchange online for my personal email. I had to do a bit of fenagling with my dns records, which is old hat at this point, to get it to work but it basically costs $4 per month per user and since I&#x27;m the only user it gives me the freedom to use my own domain name and not have to worry about selfhosting. Prior to that I was using exim as my SMTP server and dovecot as my imap&#x2F;pop3. But managing it was a huge hassle. $4 a month is worth the effort of not maintaining it myself.
cerolover 2 years ago
Totally unrelated. But this guy has an amazing OS-from-scratch tutorial [0].<p>[0] <a href="https:&#x2F;&#x2F;github.com&#x2F;cfenollosa&#x2F;os-tutorial" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;cfenollosa&#x2F;os-tutorial</a>
tjbiddleover 2 years ago
&gt; Email is now an oligopoly, a service gate kept by a few big companies which does not follow the principles of net neutrality.<p>While I understand what they&#x27;re getting at here, I disagree. There are certainly other providers you can go with - You just need to pay up.<p>Happy customer of FastMail here. All of my personal domains, and multiples businesses are tied to it. Wonderful service, no deliverability issues, great features, etc.<p>So - clearly other companies are able to get it right. Self-hosting is probably difficult, but it&#x27;s not like you&#x27;re forced to go to Big Tech.
评论 #32720395 未加载
评论 #32720921 未加载
damirover 2 years ago
I would just like to point out, you _don&#x27;t_ actually own your domain...
throwawaygramover 2 years ago
It&#x27;s ironic, 23 years for me too and my towel is not thrown in at all.
no_timeover 2 years ago
Just did a test with my own mailserver hosted on a small-ish local vps.<p>Outlook: OK (had to bother with this one when I started out) Google: OK iCloud: OK<p>I have a pristine track record and not a single byte of outgoing spam so I cannot attest how easy is it to get back into the game after an incident. I do agree with the larger point being made here. It is clear some kind of anti racketeering legislation would be the only fix. Sadly, currently there is zero will from both the EU and the US to fix any of these blatant anti competitive issue on the internet.
评论 #32718135 未加载
simonebrunozziover 2 years ago
The dream is a self-hosting email, which is also super easy to setup, so much that any person in the world could do so without specific technical knowledge.<p>How? I don&#x27;t know. But it would be great.
kuonover 2 years ago
I just moved from fastmail to self hosted and it works with no email blocked so far. Had that setup for 6 months. The most important point being sure to have a static IP with reverse DNS.
ivanstameover 2 years ago
I am running my own mail server for 3 years now. There were some issues (outlook pushing emails to spam folder) and an IP change (not sure how that affected things but I resubmitted the IP to the Microsoft email tools, can&#x27;t remember the name of the service). I would like to join some movement or a class-action lawsuit against big tech for anti-competitive practices regarding private mail servers if such thing exist, and if not i would suggest we make one.
optimalsolverover 2 years ago
I love the idea of self-hosting my email, but there&#x27;s no way I&#x27;m going through all that work if getting my mail delivered will be a toss-up. Complete motivation-killer.
wzwyover 2 years ago
&gt; <i>We are all experiencing what happened when politicians regulated the web. I hope you are enjoying your cookie modals; browsing the web in 2022 is an absolute hell.<p>What would they do with email?</i><p>To be honest, I kinda like seeing a lot of cookie modals out there. Yeah, the experience can be hellish, but it highlights how many sites are actually collecting data from their users.<p>With that said, I wonder what alternative regulations are feasible if we don’t rely on politician-mandated regulations.
vzalivaover 2 years ago
I also came to the same conclusions 8 years ago after hosting my own email for more than 2 decades. You just can&#x27;t do it on your own anymore. There are some proposals how to fix this, but I think a more sane approach is whole email system overhaul&#x2F;replacement with something better. Many people are thinking about this and come up with good ideas. I hope eventually one of them will get enough traction to replace our frankly outdated email technology.
greatjack613over 2 years ago
I have had the exact opposite experience, I used mail in a box and set it up on digital ocean on a 5$ droplet.<p>Have not had any spam or blacklisting issues and it was super easy to setup.
评论 #32716174 未加载
评论 #32715885 未加载
gorgoilerover 2 years ago
At what level of the net does IP address reputation operate? Do the blocklists ban whole ASNs based on some measured volume of spam?<p>More transparency (or more likely, less ignorance on my part) here would be helpful.<p>Can anyone recommend a one stop tool &#x2F; script for looking oneself up in the reputation services? (And on that note, it is abhorrent that Big Email providers don’t have open reputation databases, or at least ones where I can look myself up.)
mrbover 2 years ago
«<i>So, starting today, the MX records of my personal domain no longer point to the IP of my personal server. They now point to one of the Big Email Providers.</i>»<p>I would have kept the MX records pointing to my personal server, and I would have changed only my configuration to send outgoing email through a third-party relay (eg. Gandi). This would have solved all the author&#x27;s problems (deliverability issues) while staying 99% self-hosted.
sylwareover 2 years ago
Wrote my smtp server 5 years ago. Still running.<p>BTW, did you know the smtp protocol works without DNS?<p>You just need to puth the ipv4 between brackets @[xxx.xxx.xxx.xxx] and for ipv6 @[ipv6:...].<p>spam? simplicity and freedom has a price (personnaly, I have have very, very little spam since I am self-hosted), and don&#x27;t think corpos won&#x27;t try to force you to use their servers one way or another... Whose coding the virus? It is sane to presume it is the seller of anti-virus software...
评论 #32718594 未加载
angelmmover 2 years ago
I self-hosted my email during some years. My IP was banned in certain providers a few times, I guess due to neighbors. I also found quite complex to manage the service using dovecot at that time, but I guess today we have simpler servers.<p>However, I ended up moving away. Sadly, dealing with deny-lists and the management overhead was not worth for me. Fortunately, there are alternatives that doesn&#x27;t require you to go to big providers :)
jdnordyover 2 years ago
&gt; We are all experiencing what happened when politicians regulated the web. I hope you are enjoying your cookie modals; browsing the web in 2022 is an absolute hell.<p>This. Just This.<p>Seriously though, as someone fairly uneducated in the space of how standards, protocols, and regulations get set in place, how can the ship be moved on this issue? Tech companies will likely only move &#x2F; allocate resources if there is financial incentive. So what do we do?
评论 #32719976 未加载
mhdwrkover 2 years ago
A similar problem does exist when hosting your own crawler. No matter how polite your crawler is, after a few days your IP address gets blocked.
mleonhardover 2 years ago
The suggestions are good. Do Postfix and other FOSS email servers implement them?<p>&gt; - Let&#x27;s keep antispam measures. ...<p>&gt; - Change blacklisting protocols so they are not permanent and use an exponential cooldown penalty. ...<p>&gt; - Blacklists should not include whole IP blocks. ...<p>&gt; - Stop blackholing. ...<p>&gt; - There should be a recourse for legitimate servers. ... doing some paperwork or paying a fee to prove I&#x27;m legit ...
basketheadover 2 years ago
Nah. I&#x27;m glad that people like the OP are squeezed out of sending their own email. I have no problem with an email oligopoly at this point.<p>For every &quot;good&quot; email server owner, there&#x27;s probably a million bad ones. And the problem of spam is a big one. If you want to send your own email, get used to telling people to check their spam lists and&#x2F;or add your email account.
评论 #32720016 未加载
IronWolveover 2 years ago
Not seeing anyone talking about email lists, now you need to buy a mailchimp type service, but many mailchimp type companies ban political customers if your not on their team.<p>Setup a private listserv or mailman use to be easy, but now you need to have a smtp provider in front, or you will quickly get blacklisted. Even then, get too big, and you will trigger some email email providers.
brhsagainover 2 years ago
The competition argument is getting weaker and weaker, IMO. The point of competition, in theory, is to facilitate a kind of darwinian process that iterates toward an optimal solution. We have basically found that: Gmail pretty much just works for 99% of people. I sympathize with the 1% it doesn’t work for, but appeals to competition are not the way forward.
sorulyover 2 years ago
The domestic ISP I use has all its IP ranges assigned to spamhaus&#x27;s Policy Block List. <a href="https:&#x2F;&#x2F;www.spamhaus.org&#x2F;pbl&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.spamhaus.org&#x2F;pbl&#x2F;</a> However, the ISP does operate its own SMTP proxy that&#x27;s free to use. So I can send and receive emails using home IP address.
johnklosover 2 years ago
This is sad, but it&#x27;s a gross and inaccurate oversimplification. Let&#x27;s look at the summary of &quot;What are we left with?&quot;:<p>&gt; You cannot set up a home email server.<p>This is true enough to not care about edge cases.<p>&gt; You cannot set it up on a VPS.<p>This is definitely <i>not</i> true.<p>&gt; You cannot set it up on your own datacenter.<p>This is absolutely, unambiguously untrue.<p>I get that there are many people out there who don&#x27;t want to administer an email server, or who administer one (or more) and are tired of trying to train users to DTRT and care about security. The truth is that if you have lots of users, it&#x27;s likely that one will get compromised, and their account will be used to send spam.<p>Is it the end of the world? Heck, no, unless you let it go on for days. &quot;It&#x27;s not if, it&#x27;s when. Say goodbye to your email. Game over. No recourse.&quot; That&#x27;s just plain not the case at all, unless, again, you don&#x27;t have monitors in place.<p>A super simple example: a script which counts the number of email sent by any given user in a certain timeframe is really not complicated. I&#x27;ve used something like this and it has caught a mail loop which wouldn&#x27;t end because the entity causing the looping was rewriting so much that typical anti-loop checks failed.<p>So a user gets compromised. If this is a real concern (say, for instance, you have a lot of Windows users), your script should send an alert to you when this user&#x27;s account has sent several hundred messages over the past hour. You disable the user&#x27;s account, you clean the mail queue, and you deal with the fallout. Sure, that may mean watching your logs for a few days for rejections and visiting other networks&#x27; delisting pages, but it happens.<p>So there&#x27;s the largest problem with running your own email server handled. Boom. Done. If you&#x27;ve hosted email for years yet can&#x27;t &#x2F; won&#x27;t do this little bit of work, then that&#x27;s you. The rest of us understand this.<p>What about deliverability in general? Isn&#x27;t that the largest problem, you ask? No. No, it isn&#x27;t at all. You can even run an email server on your home Internet connection, if your ISP allows incoming connections, the same way you can handle any other general deliverability issue: smarthosting.<p>If you want to claim that there are NO ISPs out there that can reliably send email outside of Yahoo &#x2F; Outlook &#x2F; Google &#x2F; Amazon, then you might say smarthosting isn&#x27;t a solution. However, you&#x27;d be flatly wrong, so wrong you shouldn&#x27;t be hosting email.<p>If your home network can&#x27;t send email (it almost certainly can&#x27;t), and your VPS can&#x27;t send email (it&#x27;d probably have issues), and your datacenter can&#x27;t send email (you&#x27;re clearly doing something wrong, but let&#x27;s pretend), then you can smarthost through an email provider that has a good reputation. Period.<p>Anyone who wants to argue that hosting your own server can&#x27;t be done today because of deliverability ignores this super obvious solution, which negates this entire article.<p>Let&#x27;s move past that and look at the suggestions this article makes:<p>Should we throw in the towel, proverbially speaking? Certainly not. I disagree with this emphatically.<p>&quot;This doesn&#x27;t only affect contrarian nerds.&quot; No, it doesn&#x27;t, but discouraging others isn&#x27;t the solution. Your lack of solutions isn&#x27;t a good reason for others to throw in the towel. But why are so many &quot;contrarian nerds&quot; so quick to tell others to NOT do something? Do you tell people to not paint or draw, because it&#x27;s too hard for you? Or to carve, or write fiction, because you&#x27;re not good at those things?<p>&quot;You can no longer set up postfix to manage transactional emails for your business. The emails just go to spam or disappear.&quot; Nope. You&#x27;re accepting that as normal and equal. It isn&#x27;t. This is the same basic idea as &quot;I can&#x27;t afford to not run Windows, because everyone else runs Windows&quot; - it&#x27;s a fundamental misunderstanding on your part that leads you to assume you&#x27;re the victim, and you&#x27;re powerless. If your email is being silently dropped, then you need to tell the recipients that they need to 1) complain to their provider, and &#x2F; or 2) find real, deterministic email services. I&#x27;ve told many people that I&#x27;m not responsible for overzealous spam filtering, and I provide proof that the email was delivered. It&#x27;s on them after that. &quot;But I can&#x27;t afford to do that!&quot; Then smarthost. This isn&#x27;t difficult.<p>&quot;One strike and you&#x27;re out. For the rest of your life.&quot; Nope. Demonstrably, nope, unless you&#x27;re letting spam flow from your servers for days at a time.<p>Your recommendations:<p>&quot;Let&#x27;s keep antispam measures.&quot; Sure, but consider the fact that they&#x27;re part of the problem. Spam filtering shouldn&#x27;t be arbitrary - for instance, I do ZERO content filtering, unless or until I can prove to myself that there are no false positives. Email with &quot;storage.googleapis.com&quot; URLs? 100% spam. Email from random addresses &#x2F; networks with Gmail Reply-To? Absolutely 100% spam. Email from servers with a HELO &#x2F; EHLO name that doesn&#x27;t exist? Rejected. But keywords? No. That&#x27;s stupid. I&#x27;ve seen, for instance, too many abuse email addresses that don&#x27;t accept spam complaints because of content-based, rather than behavior-based, spam filtering. The problem with Gmail is that they do too much content based filtering, with no rules and no logs that we can see.<p>&quot;Change blacklisting protocols so they are not permanent and use an exponential cooldown penalty.&quot; Fair.<p>&quot;Blacklists should not include whole IP blocks.&quot; I disagree. If your network neighbors are shitty, then you should 1) ask for your IPs to be SWIP&#x27;d to you, 2) find a better company that punishes spammers &#x2F; scammers, and&#x2F;or 3) smarthost.<p>&quot;Stop blackholing.&quot; Yep. But, &quot;No need to bounce every email&quot; - 100% disagree. If you&#x27;re sending so many messages that you&#x27;re overwhelmed by returns, then you&#x27;re doing something horribly wrong. Every email needs a bounce. This is how email works.<p>&quot;There should be a recourse for legitimate servers.&quot; 100% agree. I think someone who has the time and resources should take all the large providers to court to compel them to have methods for correcting interoperability. If Google, for instance, wants to be like a utility, then they should be forced to act like one and they should have real ways to interoperate. As it is right now, it it not possible to reach an actual human at Google about anything via email. Every single message goes nowhere. They shouldn&#x27;t be allowed to operate like that, or if they want to be arbitrary, they should lose the right to be called RFC compliant email and the use of Gmail accounts shouldn&#x27;t be usable for anything public. That&#x27;s another whole battle, though - why should a company get to call themselves an email provider when they don&#x27;t provide reliable, repeatable service? Sigh.<p>&quot;Email discrimination is not only unethical; it&#x27;s a risk for the industry.&quot; Agreed. I think there&#x27;s already legislation proposed, if not already passed, making certain types of communication unblockable. It&#x27;s shitty legislation, but it&#x27;s a first step at a precedent we all need - we need to be able to dictate to large corporations the parameters of what they can do and can&#x27;t do if they want to be considered email.
fnordpigletover 2 years ago
What the author doesn’t mention is he uses his email to discuss his penis enlargement company with his friend, a Nigerian prince.
oskarcover 2 years ago
OP mentioned on Twitter that he chose iCloud Mail as the provider. How do You handle issues with losing incoming mails? Apple very often rejects mails from financial companies or ones that contain particular words and they won&#x27;t report that to You. That&#x27;s the only issue that keeps me from moving from own server.
sinuhe69over 2 years ago
So what do the companies with Exchange and Lotus do today? Do they still host their email-servers themselves, or already gave up and moved to big-providers? I can hardly imagine companies will leave their emails on Google or Microsoft for them to scan and abuse. But I&#x27;m so many years out of corporate environment.
评论 #32727012 未加载
phendrenad2over 2 years ago
A bit crazy to call this unethical. By that logic McDonalds is unethical for not building a restaurant in the middle of the amazon rainforest. Hey, I want my chicken tenders! Well tough cookies, friend, if there&#x27;s no economical way to support a customer, said customer shall not be supported. Nothing personal. Nothing unethical.
recroadover 2 years ago
Couldn’t agree more. I had to leave Zoho even though I didn’t want to. Google just blocked emails to my Gmail customers and left me with no choice.<p>Write about it here <a href="https:&#x2F;&#x2F;bitbytebit.substack.com&#x2F;p&#x2F;customer-hacquisition" rel="nofollow">https:&#x2F;&#x2F;bitbytebit.substack.com&#x2F;p&#x2F;customer-hacquisition</a>
zoobabover 2 years ago
Email is a protocol from the seventies (unmixed, unencrypted by default), not surprised if it leads to centralisation.
Ferret7446over 2 years ago
Maybe the approach is all wrong? Maybe we should be educating users to scan their spam folder regularly because spam filters will never be perfect. Then it will not be as big an issue if self-hosted email gets marked as spam, and the users of providers like Gmail can complain and push for filter improvements.
rubyfanover 2 years ago
We have lost the old internet where you could have a first class host and interoperate with others. I just shared photos with my family and it was super easy… except my sister who uses Android. Everything is like this now. Big Tech is playing gate keeper and the days of rapid innovation are gone.
TekMolover 2 years ago
It would be possible to solve the spam problem once and for all with a crypto currency:<p><pre><code> if (Sender is whitelisted by receiver): All emails arrive in the inbox else: Sender has to send $1 for their email to arrive in the inbox The $1 will be returned if the receiver replies</code></pre>
评论 #32716336 未加载
评论 #32716185 未加载
评论 #32716175 未加载
preisschildover 2 years ago
Been self-hosting my email since 2018 on my homeserver. Luckily my ISP&#x27;s static IP block is not blacklisted by any public list. Only had one instance so far where I couldn&#x27;t register to a website because they were only allowing 10 or so domains from big providers in your address.
verisimiover 2 years ago
&gt; The industry must self-establish clear rules which are harsh on spammers but give everybody a fair chance.<p>The author is dreaming, sadly. Why would the big email providers (corporations) change rules or do anything, when the failing system drives more people (such as the author) into their arms?
gigatexalover 2 years ago
Funny seeing this on the top of HN when this is also on the top of HN: <a href="https:&#x2F;&#x2F;jan.wildeboer.net&#x2F;2022&#x2F;08&#x2F;Email-0-The-Journey-2022&#x2F;" rel="nofollow">https:&#x2F;&#x2F;jan.wildeboer.net&#x2F;2022&#x2F;08&#x2F;Email-0-The-Journey-2022&#x2F;</a>
emiliosicover 2 years ago
Couple of suggestions: Oracle&#x27;s OCI has a free offering. One could use that as a mail relay. Also SpamHero has been a pleasure to work with with very reasonable pricing to filter most of the junk that comes in, re-delivery service and outbound relay
fay59over 2 years ago
How does one verify that their server has never ever sent spam, for instance through a security breach?
jitbitover 2 years ago
&gt; You can no longer set up postfix to manage transactional emails for your business<p>Well, actually you can. But it&#x27;s <i>tough</i> : <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=20553028" rel="nofollow">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=20553028</a>
schappimover 2 years ago
Looks like the op decided to go w&#x2F; iCloud for the cfenollosa.com domain[1].<p>[1] <a href="https:&#x2F;&#x2F;files.littlebird.com.au&#x2F;Shared-Image-2022-09-05-07-21-06-gRvkOt.png" rel="nofollow">https:&#x2F;&#x2F;files.littlebird.com.au&#x2F;Shared-Image-2022-09-05-07-2...</a>
wholyshitover 2 years ago
Do not throw your towel.<p>I also manage since over 20 years my own mail server. Had a few problem but less than expected.<p>I love the flexibility and low costs besides the time which is needed to understand what is going. But this was a good invest if I look back.<p>Keep your mailservers running
RockingGoodNiteover 2 years ago
I&#x27;ve hosted for several decades as well and intend to continue to exercise my right to do so. Whenever one of these monthly or bi-monthly doom and gloom woe is me posts shows up on HN; I wonder if there are any other motivations behind them.
aehardingover 2 years ago
I have self-hosted my personal email account for years without issues. At some point early on I started relying on AWS for sending emails, but that can be easily switched out or removed at any time (and its free for my small volumes of sent emails).
andaiover 2 years ago
&gt;You cannot set it up on your own datacenter.<p>There are still new email providers appearing every few years right? What special incantations are they performing to be allowed in the club? Do they buy large IP ranges? Do they pay protection money to Google et al?
评论 #32716986 未加载
kaushikcover 2 years ago
As someone who was actually looking into utilising my own mail server for building my technical knowledge and understanding, I am dissuaded a bit that my efforts would end in a host of hinderances caused by some auto moderators and filters.
rkagererover 2 years ago
For those who are still self-hosting, what tools &amp; services do you use and find useful?
jacooperover 2 years ago
I know the pain and the annoyances of hosting Email.<p>But still, I won&#x27;t switch to big providers, I use Proton Mail personally, and Postale.io for many projects.<p>There is also mailbox.org and many others, you have a choice to not use the big providers, it totally possible.
mikeceover 2 years ago
“ This concept may sound familiar to you. It&#x27;s called a racket.”<p>Wouldn’t RICO statutes apply then?
评论 #32716794 未加载
annoyingnoobover 2 years ago
I use a third-party spam filter service, for both inbound and outbound. My MX records point to the service provider. I appreciate hiding behind them so to speak and I only open the firewall to the service provider.
noncomlover 2 years ago
Forget about self hosting. Even a custom domain is a pain sometimes.<p>According to a lot of web apps, my email is not valid and can’t use it.<p>Also I have been told by a customer support person that my email is not right as it has to end with gmail.com
评论 #32716411 未加载
WhyNotHugoover 2 years ago
My dad used to self-host email for his company. It worked fine for a long time -- until MS started silently discarding his emails.<p>A lot of his clients (very large companies) use MS for email, and his emails to them got silently discarded (not rejected as spam, not showing up in spam folder, simply discarded while responding that the email had been accepted). Notably, the invoices he was sending didn&#x27;t reach the intended inbox, so he eventually had to move on to use another provider for email.<p>I&#x27;ve heard this story dozens (if not hundreds) of times over the last couple of decades. It gets worse and worse, since huge corporations only whitelist other huge corporations, and can choose to blacklist the rest. The oligopoly has won.
dsr_over 2 years ago
I can&#x27;t send mail to mit.edu addresses. It gets rejected with a message that says I should talk to Microsoft.<p>I frequently end up in GMail&#x27;s spam folders. No idea why.<p>I see no more than one piece of &#x27;spam&#x27; a week; everything else is caught by a combination of a 15 minute greylist, the zen spamhaus BL, and SpamAssassin evaluating things. There are a bunch of spammers who send from accounts with valid SPF and DKIM, by the way.<p>Spam is a reasonably solved problem, but SPF and DKIM aren&#x27;t much help.<p>(I get lots and lots of business spam, where the sender clearly believes that they have a right to try to sell me crap. The difference is that if I respond to business spam, someone will answer, trying to sell me crap.)
评论 #32716211 未加载
评论 #32716839 未加载
agentultraover 2 years ago
Sorry to hear you go!<p>I still self host my email. I ended up on a blacklist last year probably because some IP in my VPS block got marked. It sucked for about a week. But it came back eventually.
zzo38computerover 2 years ago
I run my own email server for receiving, but use the ISP&#x27;s server for sending (and setting up Exim on Ubuntu provides such an option at installation time). I have no problem.
singularity2001over 2 years ago
Despite my friends repeatedly marking my email as &quot;not spam&quot; google keeps classifying them as spam. Still hoping that one day European anti trust laws will fix that.
tomxorover 2 years ago
&gt; There should be a recourse for legitimate servers<p>... one of the &quot;big three&quot; being google, this will never happen, there is no recourse in anything, even when you pay them for it.
amaccuishover 2 years ago
The worst is Telekom in DE. They required you to host a website with your address, contact e-mail and phone number. If you don&#x27;t, your e-mail is just blocked.
bullenover 2 years ago
Everyone that can should host their own HTTP&#x2F;1.1, DNS and SMTP at home on a battery backed Raspberry 1, 2 or Zero if they have an external IP.<p>Preferably with their own implementations, I have implemented all 3.<p>To host anything beyond those protocols and&#x2F;or on more powerful hardware is often counter productive.<p>The problem is getting the ports opened, you need to fight for that right even if it makes spam worse in the short term.<p>Fight for external IP, ports and static IP in that order.<p>Edit: Reposting as separate comment because very important!<p>Edit2: How I wish downvoting required an argument. 500 karma is too low a barrier.
hot_grilover 2 years ago
If some group wants to get serious about self-hosting email, first they need to define a new subset of the email standard for them all to conform to. Unencrypted C2S, unauthenticated senders, and outdated protocols like POP shouldn&#x27;t be included. Make it simple to self-host.<p>XMPP has similar flaws except even worse. Too many different feature sets floating around, too many weird&#x2F;insecure defaults. It also lost the federation game.<p>Think of HTTPS, a success story of self-hosting. The weird cases are just out of the question. You basically can&#x27;t use encryption without signing, or old versions of TLS.
2Gkashmiriover 2 years ago
how many of posters here have used mailinabox ? or something similar? how was your experience?<p>i am almost 2 years into it now and beyond the first months hiccups, it just works
评论 #32718086 未加载
rdevsrexover 2 years ago
I was with the author up until the end. Why not have have regulation that makes the big company&#x27;s spend money on processing? The can surely afford it.
评论 #32720937 未加载
civilizedover 2 years ago
How about each email recipient has an Absolute Whitelist and messages from addresses or domains on this list are always delivered come hell or high water?
Chalbrothover 2 years ago
I think the author of the article makes a few mistakes in his diagnostic.<p>You should never use a service where you cannot report a problem or where the administrators are out of reach. Of course it includes the &quot;big techs&quot; but they&#x27;re not alone.<p>The underlying issue is that most of them delegate their filtering decisions to third parties. And many of them rely on the same centralized IP and domain blacklists.<p>Because of how the filtering is done, the End User generally never discovers that any filtering is happening. Only the sender may be notified by his mail relay of the delivery failure.<p>Of course, the blacklisters are not going to put the IP addresses of the big Email Vendors into their lists, if they did, millions of people would be notified of delivery failures with the risk of them discovering who is responsible.<p>&quot;&quot;&quot; Unfortunately, the computing power required to filter millions of emails per minute is huge. That&#x27;s why the email industry has chosen a shortcut to reduce that cost. &quot;&quot;&quot;<p>Even 20 years ago the computing power wasn&#x27;t a problem. He probably has this impression because he&#x27;s been using SpamAssassin. The real reason for why they are taking the &quot;shortcut&quot; is carelessness toward their service and users.<p>The excuse of saying that you should block messages before delivering them because it takes disk space is also heavily promoted by the blacklisters. Indeed, if the message was simply delivered to a Spam folder with the actual reason for which it has been classified as such, users could discover who is responsible for the filtering.<p>The good news is that there is some success in getting the big email services to remove centralized blacklists.<p>Another problem is that too many administrators of smaller services are not even aware of their reliance on blacklists. Sometimes this is because they have used an easy installation script for convenience, or because they&#x27;ve copy&#x2F;pasted a configuration. And of course, there are those who do not understand the ethical implications of doing such a thing or are just foolish.<p>&quot;&quot;&quot; So, starting today, the MX records of my personal domain no longer point to the IP of my personal server. They now point to one of the Big Email Providers. &quot;&quot;&quot;<p>This doesn&#x27;t make any sense. The MX records are for inbound, not outbound, he could have used a different relay for sending mails yet still use his own relay for receiving (perhaps he doesn&#x27;t know that?). Instead, he switches to a provider that is known for contributing to the problem. This is... disturbing.
jgsaauover 2 years ago
G&#x27;Day Guys I have gone and had a another look at EFF and the issue for me is they have a &#x27;Donate&#x27; in the menu. I&#x27;m a OG coder and have been giving away my efforts for decades, I believe that $$$ is the root of all evil, so I don&#x27;t have any spare cash. What about a BC list of IPV4 that is a referral WL, I&#x27;m not gr8 at branding and don&#x27;t believe in marketing, so the best I can come up with is &#x27;BEN - Blockchain Email Net&#x27; ???
DarkmSparksover 2 years ago
I pretty much stopped using email altogether once I realised this is what was happening. Maybe 10 years ago now.<p>Email was really useful if you wanted to send a message or notification to multiple people at the same time, but that got abused so much literally everyone disabled it, at which point email was no longer useful.<p>People can still send me emails (e.g. for plane tickets), but the chances of me replying to one are nearly zero. Now I send maybe 4 or 5 emails a year and only to people who wont use literally anything else.
EGregover 2 years ago
Here’s an idea<p>Make a new protocol for this decade, that isn’t email.<p>HTTP is supported nearly everywhere SMTP is. Just build something over that, and this time around make sure to avoid SPAM bullshit.<p>People shouldn’t be able to just message you based on your address. They receive a capability to email you. People can be empowered to give out your capabilities. If a particular such branch leads to spam, you simply cut off that branch and boom, no new user can reach you with that capability anymore. Hashes of Public keys can identify users.
评论 #32722420 未加载
评论 #32721490 未加载
newbieuserover 2 years ago
There are companies that claim to offer decentralization by hosting them on their own servers. I think we&#x27;ve already lost.
ironmagmaover 2 years ago
Alright blockchain nerds, now is your time to shine. An actual problem that can be attacked through distributed consensus.
评论 #32717951 未加载
eruciover 2 years ago
I threw in the towel a few years ago, after 15 years running my own server on top of dan bernstein&#x27;s qmail.
iamgopalover 2 years ago
We need kubernetes level of distributed messaging system to beat email. What’s most popular next option?
评论 #32716557 未加载
jbreckmckyeover 2 years ago
Is email itself broken? What could replace it, that isn&#x27;t a &quot;platform&quot; like WhatsApp?
jms703over 2 years ago
Email is broken. Fix that first so that hosting it isn’t such a terrible chore.
评论 #32720156 未加载
ameliusover 2 years ago
Why can&#x27;t we have an open source mail hosting solution that self-updates?
评论 #32717977 未加载
6510over 2 years ago
Who is any middle man to decide for me what is spam? Send in the regulators!
mrtransientover 2 years ago
How to charge people for sending me an email? With hashcash or something?
soheilover 2 years ago
Hey [0] built a very successful email business in only a couple of years with <i>no</i> deliverability issues. There are hundreds of thousands of happy Hey users who continue to pay for email. So much for anticompetitiveness. There may be a difference between a guy with a server and a real business serving thousands of customers.<p>[0] hey.com
nathiasover 2 years ago
we shold come up with a more universal approach to tackle spam
rkagererover 2 years ago
<i>Nowadays, if you want to build services on top of email, you have to pay an email sending API which has been blessed by others in the industry ...<p>This concept may sound familiar to you. It&#x27;s called a racket.</i>
fsckboyover 2 years ago
seems to me that email transport is by now a fairly robust and universal delivery mechanism at least just above the IP layer, and it&#x27;s utility decline creates the perfect opportunity to piggyback a new system on top of the existing infrastructure:<p>high concept: encrypted email with cryptographic postage stamps paid directly to the recipient.<p>Want me to read your email, pay the postage, and the same vice versa. Who cares what gmail is doing, I don&#x27;t want them collecting my postage anyway.<p>this would simultaneously bootstrap a universal micropayment currency
david927over 2 years ago
Seems like we need to write a law (draft a bill).
评论 #32720106 未加载
sk55over 2 years ago
We need new protocols. Blockchain protocols can somewhat solve the spam problem by charging to send. Receiving addresses can also whitelist or charge to receive.
rekrsivover 2 years ago
Why are we still using email?<p>No, I&#x27;m serious, why?
评论 #32722454 未加载
评论 #32717705 未加载
aorthover 2 years ago
Another compromise between self hosting and using &quot;big tech&quot; email providers is to use smaller email providers. I have been using <a href="https:&#x2F;&#x2F;kolabnow.com&#x2F;" rel="nofollow">https:&#x2F;&#x2F;kolabnow.com&#x2F;</a> for a five years or so and am a happy customer. Of course it&#x27;s more expensive, has less bells and whistles, etc, but I&#x27;m glad I don&#x27;t have to participate in the surveillance capitalism machine of big email providers.
phase5over 2 years ago
how about trying a distributed censorship resistant version like skiff.com?
tamsaraasover 2 years ago
Sad, but true...
AndrewUnmutedover 2 years ago
This was a great read. Thanks for posting it here!<p>I found this line to be especially intriguing:<p>&gt; Hellbanning everybody except for other big email providers is lazy and conveniently dishonest. It uses spam as a scapegoat to nerf deliverability and stifle competition.<p>The big tech firms criticized in this article are guilty of these sorts of transgressions in other arenas, as well. It&#x27;s always been my contention that the &quot;hellbanning&quot; of user-generated content by big media and big tech alike comes from the same motivations. YouTube and CBS alike want to make niche content difficult to consume in order to stifle any competition that might get vaulted up as a result of that niche audience finding the new distribution endpoints. This comes with the added bonus of reducing cost of goods sold, by reducing the firehose of new content to process. Or, as the article puts it:<p>&gt; Unfortunately, the computing power required to filter millions of emails per minute is huge. That&#x27;s why the email industry has chosen a shortcut to reduce that cost. The shortcut is to avoid processing some email altogether. Selected email does not either get bounced nor go to spam. That would need processing, which costs money.<p>I would be very curious to learn if there are any proposed explanation as to why this phenomenon is so commonly spread throughout the big tech space. Do we get the same kind of behavior out of other enormous multi-national firms like oil producers, ocean freight companies, defense contractors, and chemical suppliers?
indigodaddyover 2 years ago
bashblog!
Morizeroover 2 years ago
Totally agree with the tone &amp; premise, but<p>&gt; At some point your IP range is bound to be banned, either by one asshole IP neighbor sending spam, *one of your users being pwned*,<p>feels like a hint that<p>&gt; My current email server IP has been managed by me and used exclusively for personal email with zero spam, zero, for the last ten years.<p>Might not be entirely accurate.