WarpStream Profile Banner
WarpStream Profile
WarpStream

@warpstream_labs

876
Followers
36
Following
30
Media
100
Statuses

A Kafka-compatible data streaming platform built on top of object storage: no inter-zone costs, no disks to manage, and infinitely scalable within your VPC.

Chicago, IL
Joined April 2023
Don't wanna be here? Send us removal request.
@warpstream_labs
WarpStream
3 months
WarpStream has been included in @Redpoint โ€™s InfraRed 2024 list of the 100 fastest growing private infrastructure companies!
Tweet media one
1
4
31
@warpstream_labs
WarpStream
3 months
In our latest blog post, we describe how WarpStreamโ€™s multi-region infrastructure presents as a single pane of glass in the web console while still being resilient to regional failures.
3
10
25
@warpstream_labs
WarpStream
4 months
Introducing WarpStream Managed Data Pipelines. Like managed connectors, but in your VPC. Embeds the Benthos you know and love, but with WarpStream's signature data plane / control plane split.
Tweet media one
0
7
20
@warpstream_labs
WarpStream
5 months
WarpStream's BYOC control plane and Serverless clusters are now available in multiple new regions! You can now configure your WarpStream BYOC cluster to use us-east-1, us-west-2, eu-central-1, or ap-southeast-1 in AWS. We also added ap-southeast-1 for Serverless clusters.
1
2
19
@warpstream_labs
WarpStream
5 months
Auto-scaling "Kafka" with WarpStream ๐Ÿ˜Ž
Tweet media one
0
5
18
@warpstream_labs
WarpStream
4 months
With MSK, it's easy to get started, but hard to scale. Read about how Pixel Federation migrated to WarpStream to flex their clusters across multiple cloud accounts and reduce their Kafka spend by 83%!
0
4
17
@warpstream_labs
WarpStream
3 months
Check out our latest blog post to learn about how the @awscloud S3 Express One Zone storage class can reduce WarpStream latency by 4x, while still keeping costs and operations burden under control! We're very excited to have this one featured on the AWS
0
6
16
@warpstream_labs
WarpStream
2 months
In addition to @warpstream_labs being SOC 2 Type I certified, we are now SOC 2 Type II certified. This reinforces our best-in-class security practices and production readiness. Learn more and request our report via our Trust Center ๐Ÿ‘‰ .
Tweet media one
0
4
15
@warpstream_labs
WarpStream
11 months
Happy Friday! We just released support for Apache Kafka's idempotent producer functionality. Just upgrade to Agent version >= 515 and start producing ๐Ÿ˜Ž
0
0
10
@warpstream_labs
WarpStream
1 month
Wouldn't it be great if you could run Kafka in your own environment, eliminate inter-zone networking fees, never have data leave your environment and not have to worry about cross-account permissions? You can with @warpstream_labs Bring Your Own Cloud.
0
1
9
@warpstream_labs
WarpStream
21 days
Learn how to get a @warpstream_labs cluster running on @flydotio backed by @TigrisData S3-compatible object storage in this video and via this template โžก๏ธ
0
1
9
@warpstream_labs
WarpStream
2 months
. @warpstream_labs is now available on the @googlecloud Marketplace! You can now purchase @warpstream_labs through the marketplace, and pay with your @googlecloud billing account. Thank you to our partners at Clazar for making this process quick and easy.
Tweet media one
0
3
9
@warpstream_labs
WarpStream
1 month
Learn why cloud disks are so expensive for Kafka (hint: replication plays a big part) and how moving to object storage (used by @warpstream_labs ) can reduce costs ๐Ÿ‘‰
Tweet media one
0
3
8
@warpstream_labs
WarpStream
1 month
Interested in learning more about @warpstream_labs zero disk architecture and how it makes Kafka cheaper and simpler? Check out @richardartoul 's complete Kafka Summit London talk.
0
1
8
@warpstream_labs
WarpStream
3 months
WarpStream's BYOC deployment model is different from the BYOC models that you might be familiar with. Check out our latest blog post to learn what makes WarpStream BYOC secure by default.
0
4
7
@warpstream_labs
WarpStream
18 days
The phases of cloud infrastructure: 1๏ธโƒฃ Software given away. Add-ons sold. 2๏ธโƒฃ Cloud migration. Costs went up instead of down. 3๏ธโƒฃ Lift and shift BYOC with lots of fees. Learn how @warpstream_labs was developed as cloud first to solve these issues ๐Ÿ‘‰
Tweet media one
1
0
7
@warpstream_labs
WarpStream
10 months
Never thought of using Flink for logs before!
@gortron
Gordon Murray
10 months
I would love a logging solution that didn't cost an arm and a leg and allowed me to store logs indefinitely. Using WarpStream, Flink and Iceberg might be the combination to do it. I wrote a post on combining these tools for cost effective logging
Tweet media one
1
0
13
0
1
6
@warpstream_labs
WarpStream
28 days
. @wrussell1999 of @kestra_io shows how to connect a @warpstream_labs Kafka topic to @kestra_io and trigger events based on changes or values within a stream. Learn more โžก๏ธ
0
3
7
@warpstream_labs
WarpStream
16 days
. @warpstream_labs Zero Disk Architecture offers a benefits like: ๐Ÿ“Š Auto-scaling based w/no custom tooling. ๐Ÿ’ช Workload isolation via Agent groups. ๐Ÿค Easy data integration via Managed Data Pipelines. ๐Ÿ”’ Zero-access BYOC deployment. Learn more ๐Ÿ‘‰
Tweet media one
0
0
5
@warpstream_labs
WarpStream
2 months
Join @warpstream_labs @caleb_grillo on July 18 at 6:30 PT as he presents to Big Data Bellevue about how @warpstream_labs stateless architecture backed by object storage lowers Kafka costs + operational overhead. Hybrid event; attend in person or online.
0
4
5
@warpstream_labs
WarpStream
29 days
๐Ÿ’ธ It's a bold claim we're making: that we can reduce Kafka costs by as much as 10x (by removing inter-AZ networking fees and using object storage). See how our benchmarks show how we do that. ๐Ÿ“Š
1
2
5
@warpstream_labs
WarpStream
1 month
๐Ÿฆ† Check out how you can use Kwack to easily read Kafka topics from @warpstream_labs and then persist that data to @duckdb , as well as export to Parquet ๐Ÿ‘‰
0
2
4
@warpstream_labs
WarpStream
1 month
How fast can you put together real-time security monitoring ? @RisingWaveLabs shows you how using: โš™๏ธ @warpstream_labs as the Kafka-compatible streaming backbone for logs. ๐Ÿ›ข๏ธ @RisingWaveLabs as the streaming database. ๐Ÿ“Š @grafana as the dashboard.
0
1
4
@warpstream_labs
WarpStream
25 days
Learn more about @warpstream_labs data streaming architecture and transparent, usage-based pricing in this conversation between @richardartoul and @useOrb 's @kshithappens โžก๏ธ
Tweet media one
0
1
4
@warpstream_labs
WarpStream
14 days
Learn how you can use Bento, an open source stream processing framework, to send @warpstream_labs topic data to @paradedb , a search- and analytics-optimized version of Postgres ๐Ÿ‘‰
0
1
4
@warpstream_labs
WarpStream
4 months
๐Ÿค”
@richardartoul
Richard Artoul
4 months
Tiered storage for Kafka is a classic tarpit idea. It makes all the sense in the world, but it doesn't work in practice. Check out our latest blog post to learn why.
2
10
82
0
2
3
@warpstream_labs
WarpStream
1 month
Tiered storage for Kafka does not actually address these two issues: ๐Ÿคฌ Complexity and operational burden. ๐Ÿ’ฐ Costs (specifically, inter-zone networking fees). In fact, it makes them worse. Learn why ๐Ÿ‘‰
Tweet media one
1
0
3
@warpstream_labs
WarpStream
11 months
Thanks to @timeplusdata for having us on "Streaming Caffeine" to discuss WarpStream at #Current23 . We covered the history of WarpStream, how WarpStream reduces both costs AND ops pain, and our future "serverless" tier to spin up a cluster in milliseconds.
0
1
3
@warpstream_labs
WarpStream
22 days
. @pixelfederation 's mobile games have millions of users, so you can imagine how many events and topics they have. By swapping MSK for @warpstream_labs , they reduced their costs and ditched complex VPC peering in favor of simpler agent groups โžก๏ธ
Tweet media one
0
0
3
@warpstream_labs
WarpStream
17 days
Python stream processing (via @Quix_io ) and @warpstream_labs ? Yes, please. See how simple it is to build this pipeline: Activity logs (Quix) โžก๏ธ Topic (WarpStream) โžก๏ธ Aggregate results (Quix) โžก๏ธ Topic (WarpStream) โžก๏ธ Write data to @duckdb โžก๏ธ Query the data
0
1
2
@warpstream_labs
WarpStream
24 days
See how easy it is to create topics in @warpstream_labs and stream the data to @ArroyoSystems for querying and data pipelines. Go here for our full integration guide ๐Ÿ‘‰
0
2
2
@warpstream_labs
WarpStream
10 days
. @warpstream_labs Agents can connect to any Kafka-compatible Schema Registry and validate that records conform to the provided schema โžก๏ธ
Tweet media one
0
0
2
@warpstream_labs
WarpStream
15 days
Cloud-native architecture brings benefits to streaming platforms. @sap1ens shares an overview and notes that "after 7+ years of running and interacting with all these platforms, I can genuinely say thatย  @warpstream_labs is the easiest platform to run." โžก๏ธ
0
0
2
@warpstream_labs
WarpStream
1 month
Check out these top 5 uses cases for Kafka from @NikkiSiapno and @ChrisStaud at @LevelUpCoding_ . What are others you would add to the list?
0
0
2
@warpstream_labs
WarpStream
1 month
. @warpstream_labs stateless architecture drastically lowers Kafka costs and keeps operations simple. As noted in this @AWS_Storage blog, for those that need 4x lower end-to-end latency (from producer to consumer), you can leverage S3 Express One Zone ๐Ÿ‘‰
Tweet media one
0
0
1
@warpstream_labs
WarpStream
9 days
Got 30 seconds? All it takes is two commands to run the @warpstream_labs demo โคต๏ธ 1๏ธโƒฃ curl | sh 2๏ธโƒฃ warpstream demo
0
0
1
@warpstream_labs
WarpStream
5 months
And if you want us to add support for additional regions for either the BYOC control plane or Serverless clusters, contact us:
0
0
1
@warpstream_labs
WarpStream
1 month
If you're dealing with A LOT of Kafka data like @agoda , you may run into issues with load balancing and over-provisioning. When you move from a stateful to stateless architecture like @warpstream_labs , you don't have to worry about over-provisioning ๐Ÿ˜
0
0
1
@warpstream_labs
WarpStream
8 days
Measuring consumer group lag using offsets isn't always the best approach. Time lag makes it much easier to monitor and troubleshoot consumer groups. Time lag measurement is built directly into @warpstream_labs โ€“ no third-party tooling is needed ๐Ÿ‘‰
0
0
1
@warpstream_labs
WarpStream
5 months
To learn more about how to configure a WarpStream BYOC cluster to use one of the new control plane regions, check out the docs:
1
0
1
@warpstream_labs
WarpStream
11 days
File this under "it just works." You can connect a @warpstream_labs topic to @timeplusdata , a stream processing platform, is less than a minute. Then you can visualize the data, run queries, create a materialized view and more. Learn more โžก๏ธ
0
0
1