Starting 2024 with an official launch๐ฅ
For the past month+ I've been working on
@chatwithcloud
, a way to chat with your AWS.
How can it help you?
๐ ๏ธ Troubleshooting - understand why things aren't working
๐ธ Cost Analysis - why am I spending so much on AWS?
๐ Security Analysis
Hanging out with engineers outside of Twitter bubble is fascinating:
- theyโre not paying for GPT-4, some think itโs useless
- still havenโt played with GPT APIs/OSS LLMs
- their companies disallow Copilot making them x0.1 engineers
- theyโre still completely unaware of SST
Playing with
@LangChainAI
more. Built my personal, voice-powered assistant accessed through Telegram with Google access.
Speech-to-text using OpenAI's Whisper. Text-to-speech using . Will it be able to book tickets for me?
Starting a new side-business in 2020 with the right tools feels like child's play.
@AWSAmplify
gives me an infinitely scalable backend, data mgmt, and auth for ~free,
@vercel
and Next.js solves 99% of my frontend problems, charging ๐ฐ using
@stripe
is bliss.
Y'all think I'm joking with Fargate/Serverless but it's working _for me_ very well. I've been mostly on containers for 6mos and here's the list of problems that are simply GONE:
- Cold starts/latency
- Duration limits
- Local testing
- Bundling & constant fight to minimise
Okay,
@dynobase
was born about two years ago.
Now it's _almost_ self-driving +$120k/yr product used by thousands of developers, from NGOs to Fortune 500 companies.
Time for an annual reflection ๐
Been playing with LLMs + Infra for ~2 hours now and my mind is completely blown ๐คฏ
I've plugged GPT to my AWS account using Langchain and now I can ask questions about my cloud setup:
I'm not saying it's the same thing, but there's something beautifully poetic about the fact that the cost of a notebook ($15) is less than a single month's rent for Basecamp ($399). Much of the cloud is like this.
I'm not saying it's the same thing, but there's something beautifully poetic about the fact that the cost of a 24TB hard drive ($439) is less than a single month's rent for 24TB of storage on AWS S3 ($552). Much of the cloud is like this.
Step Functions Distributed Maps are awesome ๐ซ
Combined with DynamoDB Parallel scans, they enable blazingly fast, whole-table data migrations and transformations.
Here's a CDK-based PoC of a migrations framework I have in mind and will be working on ๐
hot take(?): DynamoDB's simple API and inability to create enormously complex data models (and layers) is an amazing forcing function keeping your whole project small and simple.
Ending my vacation with a small launch
โจ Web-based DynamoDB Single-table Models Viewerโจ
View and share your single-table designs with a community or team effortlessly. Get feedback, cooperatively create access patterns, iterate, and improve.
When I was starting my journey with
@dynamodb
, I was overwhelmed by its syntax.
๐ Here's small tool which might help you constructing queries, especially the complex ones -
Access patterns are crucial part of single-table modelling, they should be the lens through which you're looking at your data.
Upcoming version of
@dynobase
will make that clear.
Since the start of
@dynobase
, which is 6 months ago, I've:
- Found a co-founder, then together:
- Redesigned and rewrote app from scratch
- Changed business model from freemium to paid only
- Hired 2 juniors
- Commited +50k lines of code
- Made 5 figures ๐ฐ
You can do that too!
Am I the only person annoyed by the fact that search in Amazon console is almost useless?
Decided to do something with it - create a personalised, self-hosted, serverless resource search. imho AWS needs proper CMD+K desperately.
Would you use it?
As
@dynobase
hit another milestone, ๐ธ $10,000 per month in this case, I'm often asked:
When Dynobase will become my main & full-time job?
I think never. Why? ๐งต
Llama 3 is damn good.
We PoCed replacing GPT-4 with Instruct 8B version in one of our internal processes. Results?
- accuracy dropped ~5% (from 98%)
- But x30 cheaper
- And x12 faster
๐คฏ
๐ Finally managed to deploy Lambda
@Edge
-based
#serverless
GraphQL "server" with globally replicated DynamoDB table. Infra under 100 lines of code thanks to CDK!
Edge Lambdas are routing to the closest available DDB replica with fallback to us-east-1.
My typical workday:
10% - coding
10% - keeping up to date with latest JS dramas
10% - project-related communication/coordination
50% - reauthenticating against Okta because my 3 seconds long session just expired
If your Jest tests are slow, consider replacing `tsc` with `swc` or `esbuild`. In extreme cases, your unit tests might get x20 perf improvement ๐
It pays massive dividends at scale and in time - faster CI, PR checks, feedback loops & shorter time-to-prod.
Free business idea:
1. Find AWS service that devs spend the most time in the web console
2. npx create-electron-app && npm i graphql-compose-aws cloudscape-design/components --save
3. Wire a bunch of components to gql queries
4. Provide multi-role & multi-region capability
5. $$$
If
@Dynobase
made your life easier, but you're still hating CloudWatch, you definitely need to take a look at this beauty ๐
Proud of my teammates! ๐
@awazels
No, Groq is an LPU, alternative to a GPU, thatโs much faster at doing inferences. Right now available only via cloud offering. The client is
@Bolt__AI
Looks like I have entirely rewritten Dynobase's licensing service to Rust ๐ฆ
It's not only x3 faster than the TS version - it also feels much safer, it's fully instrumented, integration tested, and I had a blast during the process.
Next up: Let's do some traffic mirroring!
If you've been following me lately, you might start to notice a pattern. Introducing...
โจ Dynobase AIโจ
Natural language in โ data structure aware code in a language of your choice out.
You can start testing it *right now*, link below ๐
Timing to tweet this is probably terrible because of re:Invent but ๐คทโโ๏ธ
Your Single-table Models โ DynamoDB Toolbox codegen is coming to
@dynobase
!
Stay tuned.
With the introduction of AWS Resources Explorer, it doesn't make too much sense to try to monetise
@_cloudtempo
anymore.
Instead, I was thinking about making whole project OSS - from the secret indexing sauce, extension, landing, payment processing and others.
Good idea?
CDK Pipelines are one of the biggest improvements in the infra world lately.
Just deployed one that:
- Builds API, Cfn Custom Resource and CDK Construct wrapping that resource
- Deploys API to 3 AWS Accs
- Deploys Custom Resource to other ~20 AWS accs
- Publishes construct to GH
โจ Integrated nicely into the console
๐ Blazing fast
๐ Cross-region indexing
๐น Contextual menus (e.g. show Lambda's traces, logs, etc.)
๐ช Smart region switching
So far, works with Lambda, DDB, S3, Cloudwatch, and CFN. What else should I add? IAM? EC2?
Am I the only person annoyed by the fact that search in Amazon console is almost useless?
Decided to do something with it - create a personalised, self-hosted, serverless resource search. imho AWS needs proper CMD+K desperately.
Would you use it?
This is the first 4-figure week at
@dynobase
๐ฅณ
Half a year ago, it was just a vague idea with no audience.
Today itโs well-established product helping hundreds of developers around the world.
Thanks
@dvassallo
@alexbdebrie
@naval
for motivation, help and inspiration.
0:04:45 -
@houlihan_rick
"Amazon had a project recently to migrate all of our relational workloads to NoSQL technologies..." in
I think I'll start using this as a reference for all ppl who think that NoSQL is a terrible choice for relational data.
The more I work on
@dynobase
, the more similarities between gym and a startup I see:
- Starting is always the hardest
- Once you start doing it, becomes easier & more enjoyable
- Showing up consistently > intense, but erratic
- Pays off with compounding interest
Even though I'm not a big fan of Offline
@dynamodb
, I know that it's immensely helpful, especially in the dev & testing phase.
I've tried all the setup and usage methods, run through most common problems so you don't have to. Now go ship.
There are bunch of best practices around Lambda/
#AWS
SDK but they are all in the form of blog posts or tribal knowledge.
At
@StediInc
, in the spirit of "automate everything, we decided to "codify" them as eslint rules.
Contributions welcome.
About one year ago, on August 10th 2019, I committed first lines of code for
@dynobase
.
First 6 months generated $234
The next 6 months generated $32106
Traffic metrics below ๐
The biggest surprise after operating
@dynobase
for 2 years and making almost $200k of profit:
- Commits to the actual product: 1,138
- Emails & support messages sent (actually written, not automated): 1,948
๐คฏ
Sooo Aurora Serverless V2 is not having Data API? HTTP API gateway is still not having Rest API features? And donโt let me start about Cognito.
Whatโs happening there?
Just shipped my new 1day OSS side-project ๐
Yet another
#IoT
weather station ๐ but this time
#Serverless
and without backend code ๐
Using:
๐ฅ
@awscloud
IOT, AppSync, DynamoDB
โก๏ธ
@goserverless
Framework
๐ฅ
@FormidableLabs
Victory Charts and Urql
๐
Two months ago, I failed the last part of the recruitment process for a Staff Eng role at one of the popular cloud startups.
That's fortunate because today I'm proud to introduce that I'm taking even more awesome role - the "Serverless Engineer" at ๐ฅณ
One of the best parts of working at
@stedi
is that I can steal great ideas from smarter coworkers and use them at my sidegig.
This week: unauthenticated product experience.
Try
@dynobase
's read-only Single-table designer without even logging in:
Claude AI pro tip
Use Projects to store your schema.prisma / SQL structure dump and have AI perfectly know your data model so it can create diagrams and one-shot perfect data manipulation code for you.
Finally convinced myself to go through pain of integrating
@dynobase
with AWS Marketplace.
I figured out how the Marketplace + monthly subscriptions flow looks like so you don't have to:
It's official.
@_cloudtempo
is now live on Chrome Web Store & Edge Add-Ons.
๐ Blazing fast
โจ Integrated nicely into the console
๐ Cross-region searching
๐น Contextual menus (e.g. show Lambda's traces, logs, etc)
๐ช Smart region switching
Get it here:
AWS Application Composer is a huge step in visually designing AWS architectures. It allows you to quickly prototype your
#serverless
applications and deploy them using AWS Sam. Check this out!