A couple years back, O'Reilly published the book "Software Engineering at Google." It's good, I read it.
Now, you can read it online, entirely free. Do yourself a favor, and at least flip through it!
Here's a peek at the specific tech that powers Pokémon GO. It includes 5000
@googlecloud
Spanner nodes, 5-10TB of daily data in BigQuery and BigTable, GKE, Pub/Sub, and more.
We often hear that people leave managers, not jobs. But how many people *take* jobs because of the chance to work with someone? I've known a few folks who have followed leaders elsewhere. I like seeing that.
Now THAT'S a cloud migration.
Sabre closed 17 data centers, moved 40k servers, 400k CPUs, 50 PB of storage, integrated a dozen analytics platforms into
@googlecloud
BigQuery, and added 50k containers to GKE.
It can be done!
Yup,
@Google
Bard does a pretty great job at coding tasks now.
Code generation, code explanation (try pointing to a repo!), fixing code bugs, and even giving a source citation where applicable.
I even got COBOL back:
There have been some terrific new tech books on the market recently, and this "Patterns of Distributed Systems" one from
@unmeshjoshi
looks like another one.
Review the patterns here:
Surprise! I joined Google Cloud in a leadership role for outbound product mgmt of app modernization products (e.g. Anthos).
Eager to help make the products and message resonate. We'll make
@GCPcloud
the right choice for forward-looking enterprises.
More:
Ok, so
@google
Bard is now opened up to more folks ().
I just asked it the most controversial question I could think of: "Is a hot dog a sandwich?" Well done, Bard. Well done.
This new paper on "Defining, Measuring, and Managing Technical Debt" is awesome.
After some thorough analysis of Google engineering pain points over years, these leaders arrived at 10 categories of technical debt. Read this!
This is my last day at Pivotal/VMware.
I worked with a once-in-a-lifetime group of people that motivated me to give my all, every day. We did meaningful things together, and created real friendships along the way.
Tuesday, I'll share what's next. Today, I toast the team. 🍻
At this point, saying "don't do multi-cloud" and "don't use Kubernetes" is like only teaching abstinence in sex-ed class. A few may listen, you might be right, but it doesn't matter because it's not reality.
Everyone's doing multi-cloud and k8s. Help people do it safely.
For some reason, I got promoted to L9, received a new title ("Chief Evangelist at
@googlecloud
"), and welcomed our terrific doc writers into DevRel.
It proves that an excellent team can make almost ANYONE look competent! Thanks to
@gabe_monroy
and many others for their support.
I don't think about which data center I'm using when I upload a pic to Google Photos. Or when I perform a search. Or use Gmail.
Why should the public cloud be so different? Here's a 🧵with 10
@googlecloud
services that are unique because of their global backplane …
Real developers code in ... Google Docs? We just added a new function to inject formatted code into your docs, or format existing code that's already in there. Supports a handful of popular languages so far.
Just tried it out ...
Google Photos has more than 1 billion users and 4 trillion (trillion!) photos. What possible database can support such absurd usage?
@googlecloud
Spanner.
Here's a deeper look at what they needed, and how they use it.
When the most influential tech company in the world standardizes on something, you take notice.
@NetflixOSS
is all in on
@springboot
because it meets their reliability, scalability, and security requirements while aligning with their company direction.
For some reason, I decided to write the same REST API in Go, C#, Node.js, and Spring Boot, and then measure the container size and startup latency in
@googlecloud
Run.
The results will SHOCK YOU (not really).
Some bets don't pay off, others do.
Ten years ago, we saw the upcoming need for a new type of chip, and TPUs were born. Now? They offer us (and our customers) a unique advantage.
Learn the history via this really nice post on the
@googlecloud
blog:
PayPal uses a LOT of
@apachekafka
. 85 clusters, 1.5k brokers, 20k topics, and 99.99% availability, even when peaking at 1.3 trillion messages per day.
Here's how they're scaling and operating Kafka ...
Spanner powers Google services like Gmail and YouTube. It's a remarkable database.
This deep-dive post looks at two core concepts that are fundamental to how
@googlecloud
Spanner works: Strict Serializability and External Consistency.
"Today, we are pleased to announce Google Cloud Deploy, a managed, opinionated continuous delivery service that makes continuous delivery to GKE easier, faster, and more reliable." < declarative, access controls, approvals and rollbacks. More coming!
You're not going to watch every talk at
#GoogleCloudNext
. I know it. You know it. Not a big deal, I won't either.
But there are a handful you might want to bookmark to learn what's new, or what the other clouds will be talking about in a year or two. A 🧵 of your best bets ...
What does
@apachekafka
look like at "Netflix-scale"? Try 1 trillion daily messages, 4,000 brokers, 50 clusters, across 3
@awscloud
regions. In this
@InfoQ
talk,
@allenxwang
explains how they tackle scaling challenges ...
We're not a cloud provider that wants to create every possible service you can imagine. We'd rather build some exceptional services, and partner with others to offer their best-of-breed options.
Here's a look at our focused set of database options:
Try out
@googlecloud
Vertex AI without even logging in.
We just turned on the ability to use Vertex AI Studio to write prompts and interact with Gemini 1.5 Flash/Pro for free, no signing in. Wow.
Just click this link and get to work:
If you only read one online article today, make it
@martinfowler
's rewritten piece about continuous integration.
It's stuffed with guidance for those proposing and implementing CI at their companies.
Job update!
In addition to leading an outbound product mgmt team, I also now have the pleasure of leading Developer Relations at
@googlecloud
.
It's a treat to work with such a fantastic set of advocates, engineers, and platform builders.
Let's have some fun. Advice welcome!
Async, event-driven systems are awesome, but tracing requests through such an architecture? No joke.
The Slack engineering team explains how they trace notifications through their distributed systems.
Redis is one of those technologies that doesn't get a lot of glory, but devs seem to love it (), and it's everywhere.
I like this super deep dive by
@myusuf3
into how Redis works
So a bit of a professional update.
I wish my
@pivotal
and
@VMware
colleagues the best as they move forward. They'll need it, as you're stuck with me for a while.
I've accepted an offer to stay aboard. Can't wait to learn from
@PGelsinger
,
@ray_ofarrell
,
@pfazzone
and team!
If you ONLY care about using the simplest Kubernetes in a given cloud, use the native managed option (GKE, EKS, AKS, etc).
If you're expanding outward from your anchor cloud, you care about more.
We just shipped a new multicloud Anthos. Here's a 🧵 of how it works. Buckle up.
You know, without fail, each time I've published a book, something inside became out of date within the first month. This time? My job title!
Just bumped up to VP of Product Marketing at
@pivotal
. We've got the hardest working group of VPs I've ever seen, so I gotta up my game!
Sigh, I've missed this. The best part of
#GoogleCloudNext
has been the chance to meet up with so many excellent folks, face to face.
Hanging with customers and partners is sweet, but I've *most* enjoyed meeting Googlers (like
@stephr_wong
) in-person for the first time.
Netflix has nearly 3,000 Java apps and another 1500 internal Java libraries. And their big users of
@springboot
.
This presentation/transcript looks at Java at Netflix and their future plans.
If you're writing
@golang
AND using serverless functions, it sounds like life is going great for you.
We just GA-ed support for Go 1.18/1.19, in
@googlecloud
Functions, so your day just got better.
2 million free calls every month, so give it a whirl ().
You're looking for more than "hello world" examples of a modern services (serverless) architecture. Me too.
We recently shipped Emblem, a sample 2-tier web app that uses
@googlecloud
Cloud Run, Secret Manager, Pub/Sub, and more. Install and explore!
I realize that VMs are table-stakes in the cloud, but I'm still delighted by new experiences that make things easier.
We just added a
@googlecloud
Console view that shows you relevant CVEs and installed packages within your VM. Unique in cloud, I think!
Yes, there are lots of services in each public cloud. But you're not expected to use them all! I sure don't.
Focus your attention on what your app architecture needs, and read/watch this content from
@pvergadia
to make your journey easier:
Bit by bit, Google itself is depending more on
@googlecloud
services.
In this post, the Corp Engineering team talks about how they are using Anthos and its service mesh for internal systems.
Virtually every software system has a workflow engine. The only question is whether you build your own, or drop one in. Today,
@GCPcloud
shipped Cloud Workflows.
Declarative definitions, a rich syntax, and no operational effort? Let's take a look in this 🧵thread 🧵
I’ve been thinking about the cool ways
@GCPcloud
reinvented public cloud. We took many first-generation cloud concepts, and made them better for you.
It's 🧵 time!
Cloud platforms generally have outstanding uptime, but things do still go wrong.
This is a terrific new
@googlecloud
guide about architecting disaster recovery for infrastructure outages. It's a great asset for responsible planning.
Our new managed continuous service delivery,
@googlecloud
Deploy, just became generally available.
I'm supposed to be working on something else, but I want to check it out. Let's procrastinate on real-work together, shall we?
Quick 🧵 as I deploy a
#dotnet
app to GKE.
Oh, look at that.The PostgreSQL interface for
@googlecloud
Spanner is in public preview, and folks can take it for a spin. Use a familiar dialect for the best database in the cloud.
Docs:
It's possible that
@Google
AI Studio is the best AI tool you haven't used yet.
@DynamicWebPaige
got me hyped about it this morning.
It's free to use, model tuning is free, experiment with multi-modal scenarios, get API keys, and more. Here are 7 killer features. A 🧵 ...
Look, we know that most tech keynotes hit peak energy about ten minutes in, and go from there.
Honestly, the last 10 minutes of the
#GoogleCloudNext
dev keynote with me and
@forrestbrazeal
is wackier than the first 10, and that's saying something. Don't miss it!
I should answer a few emails before this next meeting OH WAIT WHAT IS THIS THING THAT
@pvergadia
JUST SHARED?
A
@googlecloud
architecture diagramming tool? And you can pull in a pre-built reference architecture? This, I like.
Infrastructure-as-Code isn't enough. There are challenges to an imperative model for building infrastructure.
Configuration as Data, based on the Kubernetes Resource Model, looks like the future.
@kelseyhightower
and
@markbalch
make a very strong case:
FLASH QUIZ!
Which opinions did
@QuinnyPig
share in my chat with him about
#multicloud
?
- You won't run the same workload everywhere
- Do multicloud for a legit reason
- Buy your underpants from one place
- Learn from others who have gone multicloud
All of them. And more …
Come on, this is silly great. You can now open up the
@googlecloud
Shell from *WITHIN THE DOCs*.
Get an inline, tools-loaded shell (and editor) when you're browsing the docs, and try out anything you want in the sandbox or against your real account.
#GoogleAlloyDB
. Let’s talk about why it’s a BIG deal for developers and DBAs, and why it might be the best way to do PostgreSQL in the cloud.
And how about a quick look at what the provisioning experience looks like? Quick 🧵 with a bunch of links at the end …
#GoogleIO
Multi-Region Applications with Google Cloud Run & CockroachDB < good walkthrough from the
@CockroachDB
gang. You could put Cloud Run instances in all 33
@googlecloud
regions (and only pay when a request comes in!) and use a multi-region DB underneath.
How should you back up a Kubernetes cluster? You know, all that cluster and application state? You *could* use a pile of scripts for each component. Not great.
Today, we're previewing Backup for GKE on
@googlecloud
. It's sophisticated, yet easy to use.
Use the cloud to create Kubernetes clusters on-premises? What kind of wizardry is this?
We just GA-ed the feature that spins up Anthos clusters in vSphere via the
@googlecloud
Console. Getting closer to building, managing, connecting clusters anywhere.
My first day in our brand new
@pivotal
Seattle office. Tallest building in the city. We've got some great views, tons of natural light, and rooms named after salmon. Y'all should come by and visit!
This is some solid swag!
@kelseyhightower
visited Australia a couple weeks before me, and the local team made "build your own Kelsey" paper dolls. I will never be cool enough to warrant this.
Built a multi-cluster
@GCPcloud
Anthos demo today for a customer. For fun, I attached an existing Azure AKS cluster to the environment so that I could show off centralized config management.
A quick thread ...
Just finished a call with
@starbuxman
and I'm clearly not very sharp today.
Josh: Happy Summer. It's my 2nd fav season!
Me: What's your first?
Josh: What do *you* think it is?
Me: You like wearing shorts, so not winter.
Josh: [pauses] Spring.
Me: Dammit.
Shoveling a VM into a container? Bad. ☹️
Vacuuming an app out of a VM and leaving behind its bloated carcass? Good. 😀
I just tried out the latest
@GCPcloud
Migrate for Anthos, and thought I'd share the experience, and when you'd use it.
A 🧵 ...
Ok, this new
@GCPcloud
Shell Editor is bananas (B-A-N-A-N-A-S!).
You can go read the blog post (), but I wanted to quickly try it out. So, here's a 🧵 of me creating a
@springboot
app and deploying it, all from within the GCP Console and the cloud editor.
"Please have your slides completed and uploaded to the conference website 2 weeks before the event starts."
You're hilarious. How about no.
"Please try to finish your slides before you start speaking at your session."
I'm down with that.
#cfsummit
"Server-side Kotlin is becoming quite common at Google at this point, it seems, with over 8.5 million lines of Kotlin code in Google’s internal codebase to date. That number, the company said, is now doubling every year."
TIL that I never need to hand-craft a Kubernetes YAML file again. Thanks
@vicnastea
!
Didn't realize
@GoogleCloudTech
Code has built-in snippets for creating common resources (pod, service, configmap, etc). Plus diffing and dry-run of YAML.
I saw that a cloud database served up over 100m requests per second during a recent "prime" event. Amazing!
Then I read this post about
@googlecloud
Bigtable handling 6 *billion* req/sec at peak, and am blow away. Good for YouTube, and your use case too.
Been nervously watching my inbox this morning, and just got notice from Microsoft that I've been awarded MVP status (for
@Azure
) for the 11th straight year.
#mvpbuzz
You know how even the most obscure YouTube video plays in seconds? That's because our storage system is amazing.
You can tap into that yourself with
@googlecloud
Storage. Encrypted at rest by default, regionally redundant, fast retrieval of cold storage.
I’ve got a complete, remastered
@cloudfoundry
on a single-node minikube cluster.
In a k8s-native setting? This no-VM edition combines CNCF tech like Kubernetes,
@IstioMesh
,
@EnvoyProxy
,
@buildpacks_io
and
@fluentd
.
Turn any k8s into an app platform in 10 minutes. Beta in days!
I can barely keep up with
@GCPcloud
Run updates. Now? Up to 8GB per container, and the ability to restrict ingress (e.g. everyone, only internal traffic).
It's a Festivus MIRACLE.
"This approach enables Twitter employees to run over 10 million queries a month on almost an exabyte of data in BigQuery [and] ...
Increase[d] the throughput of ingestion by 100% to load data much faster."
Blah, blah "serverless on servers is dumb." All I know is, I wrote a
#nodejs
function, deployed it to
#knative
via
@projectriff
(so no mucking with containers AT ALL), and had a routable, scale-to-zero service. On my laptop. All in a couple minutes.
This morning I wrote up a blog post showing off the new
@Azure
Spring Cloud.
This first-party managed service uses Cloud Native Buildpacks to build containers, and offers a managed service registry and config store.
#springone
Just got the email that I was granted the Microsoft MVP Award for the 12th straight time.
I seem to be a non-traditional MVP (my job, and my tendency to play with non-Microsoft stuff), which makes me all the more appreciative of the award.
Great start to the day.
#MVPBuzz
Psst. You. Yes, you. We just quietly opened up a repo for a new project that lets you easily run
@cloudfoundry
on your desktop. WITH a fully-functional BOSH Director included. It's early days, but pretty neat tech ...
Each day, you folks follow 360 million Bitly links, and create another 6-7 million more.
Their core self-managed backend MySQL database held 40 billion active links.
To scale, they switched to
@googlecloud
Bigtable. Here's why, and how:
Great Google earnings report. Happy to see
@googlecloud
growing 47% and investing big time in the business.
Yes, we lost $5B, but to be fair, most of that was my signing bonus. Should be off the books in 2021.
Wow.
@springboot
usage isn't slowly increasing. It's exploding. Over the past 30 days, 38.5% more projects created at than the MONTH (not year!) before. Well over 850,000 projects now. Neato.
How well are public clouds keeping their "cloud shell" language tools up to date? Just checked ...
-.NET-
GCP: 6.0.21
AWS: n/a
Azure: 3.1.403
-Java-
GCP: 11.0.14
AWS: n/a
Azure: 11.0.9
-Go-
GCP: 1.17.2
AWS: n/a
Azure: 1.13.7
-Python-
GCP: 3.9.2
AWS: 2.7.18
Azure: 3.7.3