A bit of a follow up to this; after a bit of thought, I am considering reaching out to Weird Gloop. I do not feel I am able to give The Infosphere the care that it deserves. And with Futurama back on Hulu, we are naturally seeing an uptick in activity. We have a very restrictive sign up in place, because I don't have time to moderate it anymore. It keeps the spam down, yes, but also new users away.
Note: The reason I'm writing I'm _considering_ reaching out and not just straight up reaching out is because the domain itself has a different owner than me, and I want to make sure they are also approving of this decision.
What kind of costs are associated with something like this, and what sort of visitors are you getting? I'm wondering what kind of infrastructure you need.
Importantly, I have since set up Cloudflare before the website to help. I am just using their free tier, but looking at their analytics, they say we got about 350k HTTP(S) requests in the last 24 hours.
Had it not been for Cloudflare, I am not sure my server could have handled that. Before I did that, I set up Varnish as a cache provider for users who are not logged in. That is effectively the second line of defence now.
The server itself is a dedicated server at Hetzner. I use the server for a bunch of other things, that see nowhere near the same activity as the Infosphere, and I also use it for my personal screen+irssi setup. But all in all, the server costs me about 50 euros a month.
Though, again, Cloudflare is basically the single most important reason it's not costing me more, and why I have not needed to hand it over.
Ah OK, that's basically exactly the setup I'd use as well. Surprising that the server alone couldn't handle the traffic, as the sibling says, 4 rps isn't that much when you cache (cache hits are basically free).
I imagine 90% of the traffic (or more) is anonymous users, which can be cached, doesn't Varnish handle that without breaking a sweat?
4 requests per second is absolutely something even a cheap VPS should be able to handle, even if you double that for peak load. You just need to put caching in front of everything dynamic.
Disappointing for people just carelessly giving Buttflare the keys to the kingdom and effectively excluding alternative Browser users without considering other options.
An off-hand reference to "350k/day" shouldn't be naively translated to "4 per second"
350k/ day likely means sometimes it's 3.5 million, all smashed into a 30 minute period of time, because some nitwit linked to my site.
And then, I get paged about "my site being down" and I have to stop hanging out with my friends or family and fiddle around with things I don't want to fuzz with. Or maybe it just breaks and doesn't self heal and it is offline for a week until I notice it and fix it, and by then people all think the site's gone.
Anyhow, sure, maybe people not wanting to devote their lives to devops fanfic is something that can "just be solved with this simple trick cloudflare hates" but maybe not.
It's been a long time since I switched to Cloudflare. Looking through my email archive, it was December 2015. I uncovered an old discussion[0] about the switch, but it only seems to highlight that the server is slow.
But I think it speaks to my lack of skill in this area. I have no actual professional training in system administration, and entirely autodidactic in this area. Though it sounds like Weird Gloop can also provide guidance in these matters rather than simply taking on the hosting. I won't deny that at times I have felt defeated, and that may truly have been my reasoning for switching to Cloudflare.
Though this post and response so far have given me hope.
Note: The reason I'm writing I'm _considering_ reaching out and not just straight up reaching out is because the domain itself has a different owner than me, and I want to make sure they are also approving of this decision.