24 Nodes, 96 cores, 192GB RAM, around 6TB of object storage (24 x 256GB NVME's). 3 storage zones. All powered by
@mikrotik_com
3x RB5009. And, its fast as a greased goose.
We've added router mounting and a snazzy heat-resistant black coating. Also tidied the cables 'a bit' better. Also trimmed for the predicted 3 zones per shelf form factor. All credit to
@BobMason89
@mcrmonkey
Dev team was whinging about lack of decent storage for k8s. So this is a garagehq cluster presenting a s3 compatible api. I may have gotten carried away.
@fesshole
Yeah, that'll teach him. Why dont a couple of the biggers lads and gals actually have a word one night, rather than sitting back and doing nothing eh?
Of you've ever wondered if you can build an S3 object store on a bunch of raspberry pi 5's. Yes you can. In addition, it will with correct tuning run like Mr Bolt and completely swamp it's 1gbps nics. 100% arm baby. Incl the router.
@nyxgeek
@mikrotik_com
Are you talking crypto lingo? If so, your talking to the man who didn't buy BTC at £30 because, and I quote:
It's all Bullshit
Now I stand by that quote 💯 % morally, fiscally however I am dead inside.
Loving the hate for Sleaford Mods. They are really touching nerves of champagne socialists. Good. That's the point. The pain you feel, its called shame. Listen to it.
@davidbelle_
@davidschneider
This graphs shows shipping time, the deliveries being made aren't slow, they just aren't happening. Maybe copy and pasting graphs isn't your forte sir.
@UK_Daniel_Card
Without their ddos mitigation? Not alot at alllllll. Also heavily dependent on what ports are open and whether I can craft anything particularly nasty for that service.
To everyone wanting to know the power draw on the Pi cluster of doom. We finished the telemetry polling of the Mikrotik today, so could finally poll some stats.
@slotkinjr
@anothercohen
Mate, my dad died of ALS too. This is still funny no matter how you cut it. If my dad was still about, he probably would've sent it to me. The world isn't there to cater to your sensibilities alone. Don't like it, scroll. It's really not hard.
@AileenD0ver
These mk's will be backing off 2 x FortiGate 1800F firewalls in HA and loadbalancing the zones. We run our own eVPN core network so, if we need Layer 2 across geo, we got it without involving spanning tree.
@lmdbkraft
@mikrotik_com
Each zone/metal plate came in around £1500. Effectively you need 3 to keep everything resilient. Considering our normal base level HV servers cost in excess of £10,000, this is quite the bargin.
Baaaaaaaad take. I refuse to run servers for fun. Never have. They are a tool. Discounting people who want to leave work at work because they're not proper geeks isn't it.
We are looking for a “datacenter engineer” local to Los Angeles or willing to move.
Must:
- have home server(s) you currently cluster/fuck with for fun
- write rust like a m’fer
- understand how machines are clustered from first principles, we sure as hell aren’t putting open
Sorry, not used to this many people caring what me and my team do. Shout out to
@BobMason89
the only one left on here. We will do a write up somewhere, but to be blunt. This project has currently only burned 50% of its assigned budget. So we ain't done yet.
There's soon going to be a clear distinction in network engineers. Those who stayed at the old travelodge near telehouse, and those that never got ill off that all you can eat breakfast. Amazing civils going on to move it.
@networkservice
I need to shave around 17mm from the depth, at which point it'll fit sideways in a rack, with around 3 per shelf I'm thinking. That and 3d print more cable management clips.
@Pumpkin03822395
@mikrotik_com
It's currently outperforming 14k hypervisors. But that's for the task at hand, an s3 compatible object store. I am in no way suggesting this setup is a replacement for my beefy shiny 1tb of eec ram, 144 core hvs of doom.
@lucamauri
It's an aws s3 object store in all pretense. I hate cloud. So my business is pretty much 100% dedicated hosting. So if my devs want something that behaves like s3, we build it. This is actually at the smaller end of things.
@TheSenMat
If this works, and that's a big if, this scale is a fraction of that we'll run. My business collects obscene amounts of data in both binary and text form. NETAPP would come running with a checkbook. This will scale for days and actually run better as it scales.
I love my industry clique. Within 30mins of asking for help I had 3 offered of equipment lend, one from a competitor. It's up and running now, but thanks guys. You are the best!
Either get rid of the bar (what sodding century is this anyway), or demand breathalyser tests prior to votes. If you can't drive a car you shouldn't be deciding the future of the country.
@PerthPom
@carlheaton
@Nominet
@publicbenefituk
I have no intention of engaging with a farcical process whilst the current board pay themselves royally from member fees. They've got to go. It's always been the case. I'm sure Simon knows a waste of time when he sees it.
So just about finished with London dc kit out.... Then drama.... Zayo are outside splicing.... Ooh let's light it... Then zayo van is robbed... OK maybe not then. I love you e14!
Pi Cluster safely transferred to
@BobMason89
for further fettling. After a chat with
@Pineboards
we've decided to halt on v2 until the release of their combined PoE and M2 HAT. After a chat with 'corporate', we're also going to do some kind of blog/whitepaper/video on the setup.
@beerzBaqlova
@mikrotik_com
We manage over 2000
@mikrotik_com
device nationally. Like most vendors, there's features it's safer to leave disabled, but with good change control processes these boxes are damn good value.
Paraphrased Support Ticket I saw today. Dear ISP, all websites apart from this one are working. Can you fix the website for me....... No, I really can't, even if I wanted to..... Which I don't. And this ladies and gents is why I don't work the support desk.
@danielh164
@mikrotik_com
Distributed s3 object store dude. These things only get better the larger they are. More spindles, higher io. Also next steps are thing like opensearch and elk.
@digininja
@mikrotik_com
Nginx runs on first node in each zone and load balances s3 compatible requests back to 7 other garage hq nodes. Each zone is then further load balanced by a fortigate fw. In production.
Posting this here as to not embarrass certain family members.
Convo with step daughter in car earlier today.
Me: you've been accidentally calling me dad alot lately.
Phoebe: it's not an accident.
@Dull42Mike
It's OK 99% of people didn't reply because they had common sense and assumed this was the case. That said he's better with a pump truck than me. I put a hole in my bosses wall when I had a go.
@djmk
This generation aren't ravers. The obvious one is looking at freshers at uni. Its just not the same party drinking culture that previous generations had.
Just to offer an alternative view of Bolton this weekend. My Muslim neighbours had a party and bbq. They sent extra food over the back fence. Fun was had by all. The end. Don't let a minority define the narrative folks.
Members update post EGM: Our actions include rapid outreach to ensure we hear from all members and stakeholders to shape Nominet's future, leadership adjustments to ensure stability, and continuing discussions on board composition:
"Your chicken is really poorly and will probably die in the next few week" - vet
4 months later
"hey human, mind if I try to lay an egg on your leg and sit on the couch?" - Marjorie the chicken
Worst housemate ever.
Wow. There sure are alot of medically exempt people not wearing masks on the train. Strange the demographic is those who've not had the vaccine.
In unrelated news I'm never going on public transport again.
@NBCNewsTHINK
@GrimKim
Way to be tone deaf
@GrimKim
@NBCNews
I tell you what is disappointing. Journalist looking for any cheap shot to right an opinion no one asked for. BTW this is definitely cheap.
OK plan, turn Parliament and 10 downing Street into museums. They'll rake it in. Build a new Parliament in Slough (we don't want them up north). No 2nd homes. Each mp gets a flat in a block built to social housing standards of the time. Watch how good councils flats get. Boom
@LozzaFox
That's not medical apartheid. Medical apartheid was something very very different... Are you suggesting that there's festivals medically experimenting on ethnic minorities? I mean, that's what your words mean. If so, then I fully support Ashcroft.... Down with this sort of thing.
This dirty gurty of an amp was my first proper amp. Bought back in 95 I'd guess. She hasnt sounded in years but the lads
@BoothsMusic
got her sorted and it sounds sweeter than ever. New valves, pots and a transformer repair.