Samuel Williams @ioquatix Twitter profile

Pinned Tweet

Samuel Williams

@ioquatix

5 years

Here is an interview I did recently where we talk about Ruby scalability.

Jeremy Jung

@jertype

5 years

Want to learn how to build scalable applications safely? Check out my conversation with Ruby core team member @ioquatix ! We talk about how languages handle concurrency and parallelism, the dangers of threads, writing asynchronous code, and more.

0

10

42

2

7

45

Last Seen Profiles

@kORucqn1

@Mike_Catling

@jlecola

@playitcool03

@rumina_zone

@VedaDonna69518

@kisekinopi

@bokeplokalmalam

@aldameral

@v83H4RBy0Xl3O

@BinorRaja

@cukienaknikmati

@panghormisme

@VictoriousFest

@KayleaKeev16708

@eyilmaz__

@HeithKeary36067

@stw_pdg

@TweetAurora

@BKabrina83878

@TakeBackCTRLVAL

@MAdrianne65705

@sukemal_xd

@kucingluchui

@kookiebunnie97

@CecilleD7199

@I_H_W_T

@hazelsopretty

@BinorRaja

@Suzi_Q_music

@itsgoldouthere

@excell305

@kings_mik

@ayuunieee

@onefiinix

@roikamiskiya

Samuel Williams

@ioquatix

5 months

Arrived.

7

12

237

Samuel Williams

@ioquatix

8 months

I compared a "Hello World" Elixir/Cowboy vs Rack/Falcon. Honestly, I'm surprised it's as good as it is. It shows just how far Ruby+Async has come, and this is in comparison to a system that has dedicated it's entire existence to high throughput I/O and parallelism.

14

35

198

Samuel Williams

@ioquatix

3 years

Async 2.0.0 was released. Now, roll on Ruby 3.1.0 :)

4

19

184

Samuel Williams

@ioquatix

6 months

Today I'm releasing XRB () a simple template engine for Ruby (and Rails). It's 10-20x faster than ERB, and has a simpler syntax, supporting #{interpolations} and <?r processing_instructions ?> only.

GitHub - socketry/xrb

Contribute to socketry/xrb development by creating an account on GitHub.

github.com

6

35

178

Samuel Williams

@ioquatix

5 years

If you have not tried I highly recommend it. The search is really fantastic and the layout of the documentation is really use friendly.

5

67

170

Samuel Williams

@ioquatix

4 months

Flappy Bird, implemented on the server side, within a Rails application, running on either Falcon or Puma:

1

23

161

Samuel Williams

@ioquatix

5 years

100k WebSocket connections on macOS using HTTP/2 multiplexing. Next stop, 1 million.

2

30

134

Samuel Williams

@ioquatix

4 months

Hello World! in 6 lines of Ruby. I know, it's a little bit longer than required, but it's running over HTTP/2 :)

5

9

135

Samuel Williams

@ioquatix

5 months

#RubyKaigi day 4: Travelling to #Motobu

2

4

128

Samuel Williams

@ioquatix

1 year

With the efforts of many great engineers, Rails head is now compatible with Rack 3. is closed as completed.

Allow `rack >= 3` in Rails. by ioquatix · Pull Request #46594 · rails/rails

Allow Rack 3 to be used in Rails. Blocked By: use Karma as the test runner for the UJS tests #46206

github.com

2

14

117

Samuel Williams

@ioquatix

6 months

Folks, unfortunately my team has been made redundant (company shutting down). I am now looking for the next step in my journey, and if possible, that includes helping my team of extremely talented engineers too. Feel free to DM me.

11

62

114

Samuel Williams

@ioquatix

4 years

Hinoki's age detection program. She is 7. We wrote it together. She wanted to share it.

6

114

Samuel Williams

@ioquatix

3 years

Hanging out with @tenderlove in Seattle was a huge highlight of my week!

3

109

Samuel Williams

@ioquatix

10 months

Working on a more flexible implementation of ActionCable with @palkan_tula :

5

10

96

Samuel Williams

@ioquatix

3 months

Folks, I had a great time with y’all in Japan. Now it’s time to go home. See you again next year!

3

2

95

Samuel Williams

@ioquatix

7 months

Today, my cat, 21+ years old, passed away. She loved sitting with me while I was programming. Neko nyan, you will be missed.

23

0

90

Samuel Williams

@ioquatix

10 months

Ruby 3.3 was released. Notably, it includes minor fixes to Fiber #storage , IO::Buffer and small optimizations to coroutines. More importantly, Ruby 3.0 will soon be EOL, at which point we will be able to make significant forward progress and drop async-io in favour of native IO.

1

7

90

Samuel Williams

@ioquatix

2 years

Ruby's autoload code is scary. There are real race conditions probably going back as far as autoload has existed.

Fix various autoload race conditions. by ioquatix · Pull Request #5898 · ruby/ruby

This PR attempts to address two race conditions outlined in https://bugs.ruby-lang.org/issues/18782. It's possible to race on adding and then deleting items in autoload_featuremap. When th...

github.com

5

8

86

Samuel Williams

@ioquatix

2 years

Rack 3.0.0.beta1 was released today, thanks @tenderlove for cutting a release! Looking forward to trying this out!

2

13

85

Samuel Williams

@ioquatix

4 years

Light weight concurrency for Ruby merged into master for experimentation.

Thread scheduler for light weight concurrency. · ruby/ruby@0e3b0fc

github.com

1

21

80

Samuel Williams

@ioquatix

4 months

Rack v3.1.0 is released.

rack/CHANGELOG.md at main · rack/rack

A modular Ruby web server interface. Contribute to rack/rack development by creating an account on GitHub.

github.com

1

12

78

Samuel Williams

@ioquatix

3 years

With Matz' approval, zero-copy IO::Buffer for Ruby was merged.

`IO::Buffer` for scheduler interface. by ioquatix · Pull Request #4621 · ruby/ruby

There are several places where we cannot avoid using (void*, size_t) for read and write operation. While using fake strings seemed to work, I was told we cannot expose it to Ruby code. Therefore, t...

github.com

4

7

78

Samuel Williams

@ioquatix

4 months

Rack has an updated logo:

1

5

72

Samuel Williams

@ioquatix

3 years

was finally merged. This is a great step forward for bi-directional streaming in Rack applications. While this doesn't introduce any functionality we didn't already have by rack.hijack, this makes it non-optional and explicit.

Support callable body for explicit streaming support. by ioquatix · Pull Request #1745 · rack/rack

Allow a rack response body to explicitly opt into streaming by implementing #call instead of #each. This interface is desirable for a number of reasons. However, this PR should be considered an exp...

github.com

2

8

70

Samuel Williams

@ioquatix

6 months

Falcon + Ollama + Live + Rails. About ~80 lines of application code.

2

7

71

Samuel Williams

@ioquatix

4 months

When I first started writing this specific documentation nothing worked: Puma and Rails didn't support streaming responses. However, today I can write this documentation and it works out of the box with Rails 7.1+ and Puma 6+. And of course, Falcon too.

3

8

71

Samuel Williams

@ioquatix

5 months

Bye bye Okinawa 👋

0

70

Samuel Williams

@ioquatix

4 years

The redis gem has just been released with support for non-blocking I/O :)

Release 4.2.3 · redis/redis-rb@5cc7342

github.com

1

9

70

Samuel Williams

@ioquatix

3 years

Rails.logger has a mutex. Puma has 16 threads. Thread N logs a huge message and blocks while holding the mutex. Thread N+x logs a message. Entire server blocked on single request. Don't hold a mutex while doing IO.

5

6

69

Samuel Williams

@ioquatix

10 months

Merry Christmas and Happy Holidays :)

2

8

65

Samuel Williams

@ioquatix

10 months

Gone fishing 🎣

1

66

Samuel Williams

@ioquatix

2 years

This is possibly the best use of GitHub discussions I have ever seen:

Help understanding Falcon/Rails/ActiveRecord Limitations and Future · socketry falcon · Discussion...

QUESTIONS: Is Rails on Falcon a viable production solution? What are the gotchas with using Falcon and Rails (specifically with ActiveRecord) What is the future for Falcon? DETAILS: A recent articl...

github.com

2

3

65

Samuel Williams

@ioquatix

4 years

Console now dims rows which are not from your own application:

3

7

64

Samuel Williams

@ioquatix

5 years

I am very excited to announce I am the recipient of the Ruby Association grant for 2019. Thanks so much for this opportunity!

Ruby Association

@rubyassociation

5 years

2019年度Rubyアソシエーション開発助成金公募結果発表

0

8

12

8

11

62

Samuel Williams

@ioquatix

3 years

Good news, everyone. is now passing including all external tests. This is the ground work for Async 2.0 which takes full advantage of the Ruby 3 scheduler interface, along with a new event gem with direct support for kqueue, epoll and io_uring.

Take advantage of Ruby 3 scheduler. by ioquatix · Pull Request #111 · socketry/async

Description Take direct advantage of the Ruby 3 scheduler interface. While we will try to maintain compatibility as much as possible, there might be some internal scheduler changes which impact the...

github.com

2

5

62

Samuel Williams

@ioquatix

6 months

After 3 years, from idea, to implementation in CRuby.

Fiber local inheritance by ioquatix · Pull Request #3 · socketry/fiber-local

Use Fiber storage variables for better scope handling. Types of Changes New feature. Contribution I added tests for my changes. I tested my changes locally. I agree to the Developer'...

github.com

0

3

59

Samuel Williams

@ioquatix

2 years

The latest async-websocket benchmark: 100,000 connections in 90 seconds. 4 seconds faster than previously recorded. That's about 1ms to establish a connection (multiple back and forth packets). I'm pretty happy with that - it could be better, but this is all pure Ruby.

3

1

56

Samuel Williams

@ioquatix

3 years

Exciting!!! How many fibers can we run?

2

1

57

Samuel Williams

@ioquatix

2 years

0

54

Samuel Williams

@ioquatix

2 years

I migrated a small test suite of 15 tests from RSpec to Sus and added 7 more tests. RSpec: 337ms Sus: 92ms

2

54

Samuel Williams

@ioquatix

4 years

I am pleased to share that Async has just hit 1 million downloads, 20% of them happening in the past 6 months.

2

3

54

Samuel Williams

@ioquatix

2 years

Thanks everyone for the great #RubyKaigi now it’s time to go home.

2

0

53

Samuel Williams

@ioquatix

3 years

I was a finalist in the New Zealand open source awards. But it was cancelled because of COVID :( I wanted to hang out with other open sourcerers.

2

5

52

Samuel Williams

@ioquatix

4 years

Is Ruby 3, three times faster? I say yes. if RUBY_VERSION >= "3" sleep 1 else sleep 3 end

4

1

51

Samuel Williams

@ioquatix

5 years

First PR to Linux kernel. Life goal achieved.

3

5

49

Samuel Williams

@ioquatix

6 months

I started hacking at about 10AM and it is now about 10PM. I now have `async-http` test suite passing with native IO instead of `async-io`. I found that Ruby's IO has a few tricky gotchas which are extremely hard to debug...

2

50

Samuel Williams

@ioquatix

5 years

Just released rack 2.2.1 which fixes a minor bug in 2.2.0 which was released yesterday. @tenderlove has managed releases up until now. I have to admit, it's a bit stressful to release a gem which has ~2000 of installs per hour.

1

5

49

Samuel Williams

@ioquatix

2 years

Real time test feedback. The output position needs a bit more feedback, but it's basically working in real time as you edit the code. Sus being super fast, you barely notice it.

2

5

48

Samuel Williams

@ioquatix

3 years

Observer effect (computer science): Observing the execution of a program with a debugger causes it to execute correctly.

5

4

49

Samuel Williams

@ioquatix

3 years

A fast, efficient memory mapped buffer for the next generation of Ruby I/O and the fiber scheduler, coming (hopefully if everyone can agree) in Ruby 3.1!

3

1

47

Samuel Williams

@ioquatix

1 year

Puma... now with more fiber.

Introduce support for fiber-per-request. by ioquatix · Pull Request #3101 · puma/puma

This enables the correct scope of Fiber.storage per request. Fiber[] and Fiber[]= are recently introduced features in Ruby 3.2. They are designed to provide per-operation or per-request state handl...

github.com

4

11

48

Samuel Williams

@ioquatix

2 years

Ruby IO #timeout = is merged, for safer network IO.

Add IO#timeout attribute and use it for blocking IO operations. by ioquatix · Pull Request #5653 ·...

https://bugs.ruby-lang.org/issues/18630

github.com

1

7

47

Samuel Williams

@ioquatix

3 years

Rack 3 should be done soon. However, the documentation could use some work. Many hands make light work, so please come and join in!

1

3

47

Samuel Williams

@ioquatix

2 years

5x faster test execution with sus-parallel. Now I just need to write a RSpec wrapper.

1

5

47

Samuel Williams

@ioquatix

3 years

Rack 3.0 will focus on the core Rack specification. Some details, like Rack::Session, are being moved to separate gems:

GitHub - rack/rack-session

Contribute to rack/rack-session development by creating an account on GitHub.

github.com

1

4

44

Samuel Williams

@ioquatix

3 months

I feel so privileged to come back to an old project and think "Yeah, I did my best at the time, but I've got new insights into how it could be even better".

1

46

Samuel Williams

@ioquatix

4 years

So this ain't quite Phoenix LiveView yet, but the concept is the same and appears to be hitting 60FPS pretty easily:

7

3

45

Samuel Williams

@ioquatix

3 years

I'm disappointed by this new computer... my last MacBook Pro kept my legs very warm, but this one doesn't get warm at all. I even compiled with all 10 cores, how can Apple do this to me!? The compile was too fast to generate any significant heat...

3

44

Samuel Williams

@ioquatix

6 months

This is an awesome talk about Asynchronous Ruby - I'm extremely impressed by the quality of the presentation! well done @matheusrich

Matheus Richard

@matheusrich

6 months

Now that the videos are out, you can watch my talk about async Rails! The Fast Lane: Asynchronous Rails

5

6

70

3

4

45

Samuel Williams

@ioquatix

1 year

I wrote some details about how to host a Rails 7.1 application in Falcon: - I'll add some more application level examples, including WebSockets and streaming soon.

GitHub - socketry/falcon-rails-example

Contribute to socketry/falcon-rails-example development by creating an account on GitHub.

github.com

1

9

45

Samuel Williams

@ioquatix

8 months

This is a great talk from @techsutra - great visual comparison of Puma & Falcon:

Look Ma, No Sidekiq: A peek into async future - Manu Janardhanan...

We usually turn to Sidekiq for tackling long-running tasks. However, using the async gem with Falcon lets us execute IO-bound tasks directly with clean, simp...

www.youtube.com

2

6

44

Samuel Williams

@ioquatix

4 years

Fiber Scheduler is supported in the latest Async release. I'm so excited!

成瀬

@nalsh

4 years

Ruby 3.0.0 is released It achieves Ruby 3x3 and introduces * RBS * TypeProf * Ractor (experimental) * Fiber Scheduler * REPL (irb) speed up (copy&paste becomes much faster) and more!

6

353

570

2

44

Samuel Williams

@ioquatix

2 years

Why our text editors default to 80 characters line wrapping by default.

3

44

Samuel Williams

@ioquatix

10 months

One of the ergonic features of Ruby 3.3. that I'm proud of is `Module #set_temporary_name `. It significantly improves the readability of anonymous classes/modules:

4

44

Samuel Williams

@ioquatix

2 years

has a new logo thanks to @LaugesenMalene ... and more to come ...

GitHub - rack/rack: A modular Ruby web server interface.

A modular Ruby web server interface. Contribute to rack/rack development by creating an account on GitHub.

github.com

1

43

Samuel Williams

@ioquatix

10 months

Happy new year from New Zealand :)

1

44

Samuel Williams

@ioquatix

4 years

After 2 years, Ruby OpenSSL 2.2.0 has been released. Massive ups to all those who contributed, what a huge effort.

1

8

44

Samuel Williams

@ioquatix

8 months

is an extremely light weight proof of concept job server built on Redis. It functions similarly to Sidekiq, but is built on async which I think makes the code simpler to understand.

GitHub - socketry/async-job

Contribute to socketry/async-job development by creating an account on GitHub.

github.com

0

7

43

Samuel Williams

@ioquatix

3 years

IRB can now work correctly inside asynchronous context, it uses io_read/io_write hooks and IO::Buffer for internal communication with selector. It also works with File reading/writing, etc. The underlying selector was based on kqueue in the demo.

5

7

40

Samuel Williams

@ioquatix

2 years

😂I just spent two hours unsuccessfully solving a problem I solved *3 years ago* and even released a package for it... 😭🥳

1

42

Samuel Williams

@ioquatix

5 years

100k + 1 simultaneous WebSockets with a single #Falcon process running on #Ruby . Consumed 4GB of memory. @_ko1 @yukihiro_matz what do you think?

7

12

41

Samuel Williams

@ioquatix

5 years

A single falcon instance hosting 100,000 active connections, 2.91GiB / 100k = amortised 32KiB per connection.

1

8

41

Samuel Williams

@ioquatix

2 years

#KakigoriFriends #RubyFriends @KuokkanenSampo @a_matsuda @oceanicpanda

1

5

41

Samuel Williams

@ioquatix

3 years

Game of Life implemented in pure ruby:

1

4

40

Samuel Williams

@ioquatix

5 years

is now running on Falcon.

0

4

41

Samuel Williams

@ioquatix

2 years

Okay, this is fun:

2

0

40

Samuel Williams

@ioquatix

8 months

It's alive!

GitHub - socketry/async-job-rails-example

Contribute to socketry/async-job-rails-example development by creating an account on GitHub.

github.com

0

7

40

Samuel Williams

@ioquatix

2 years

Okay, autoload should be 100% compatible with the fiber scheduler in Ruby 3.2 which is good news, now time to work on

Make write atomic. by ioquatix · Pull Request #5419 · ruby/ruby

https://bugs.ruby-lang.org/issues/18465 Right now, IO#write including everything that calls it including IO#puts, has a poorly specified behaviour w.r.t. other fibers/threads that call IO#write at ...

github.com

0

2

40

Samuel Williams

@ioquatix

3 years

Introducing "Ruby", who will help us communicate the excitement and importance of an asynchronous future for Ruby (the language). @LaugesenMalene is the artist and she was supported by myself and @RubyNewZealand . This is just the beginning.

3

5

39

Samuel Williams

@ioquatix

2 years

I had a cold and probably too much coffee before giving this talk but it turned out pretty well 😝

"Asynchronous Rails" - Samuel Williams (RubyConf AU 2023)

(Samuel Williams) The fiber scheduler presents new opportunities for building scalable and concurrent Ruby programs. However, Rails has traditionally been a ...

www.youtube.com

2

9

38

Samuel Williams

@ioquatix

3 years

Async::HTTP will soon have support for distributed tracing, with backends including @datadoghq & @ScoutAPM (via OpenTelemetry).

0

2

37

Samuel Williams

@ioquatix

4 years

I'm working on a new gem for concurrent access to MySQL and Postgres... I have to say, @antirez the Redis interface is SO WELL DESIGNED compared to these legacy interfaces from libmysqlclient and libpq. I wish we had such a well designed and straight forward interface.

0

1

37

Samuel Williams

@ioquatix

10 months

It’s time to make pizza.

3

0

37

Samuel Williams

@ioquatix

4 years

I've just completed the first set of commits to support non-blocking fiber aware Mutex: thanks to @eregontp for his help with the initial conversion to make Mutex fiber aware.

1

6

38

Samuel Williams

@ioquatix

7 months

I hope my #RubyFriends in Taiwan are okay, thinking of you all and hope you are safe.

0

1

37

Samuel Williams

@ioquatix

4 years

Asynchronous #PostgreSQL and #MariaDB from the ground up using the latest non-blocking APIs from each respective platform, blended seamlessly into Async. Identical specs passing for both, but underlying drivers are a bit different. Using FFI.

2

3

36

Samuel Williams

@ioquatix

2 years

Preliminary results from my copy-on-write hash implementation for Ruby (only affects large hash atm):

1

37

Samuel Williams

@ioquatix

6 months

Async::Ollama with real time streaming.

4

1

37

Samuel Williams

@ioquatix

4 months

The slides for my RubyKaigi 2024 Keynote are now available:

2

9

36

Samuel Williams

@ioquatix

11 months

When I created the Fiber Scheduler interface, it was deliberately missing an implementation. The goal was to plant the seeds of concurrency in Ruby and allow them to bloom without constraint. is a good example of that.

2

1

36

Samuel Williams

@ioquatix

6 months

Okay, I released a thing:

GitHub - ioquatix/wtf

Contribute to ioquatix/wtf development by creating an account on GitHub.

github.com

2

1

36

Samuel Williams

@ioquatix

4 months

I hope we can adopt something like in Rails, it will make routing websockets connections easier.

Add route helper for websockets. by ioquatix · Pull Request #52169 · rails/rails

Motivation / Background Rails currently does not have a nice route helper for HTTP/1 and HTTP/2 WebSockets. HTTP/1 uses GET with the upgrade header, while HTTP/2+ uses CONNECT with the :protocol ps...

github.com

1

2

35

Samuel Williams

@ioquatix

4 months

An excellent report on my talk at #RubyKaigi

RubyKaigi 2024 - Leveraging Falcon and Rails for Real-Time Interactivity (Day2) - Techouse Develo...

本記事では、Rubykaigi 2024 2日目のSamuel Williams(@ioquatix) さんによるセッション、「Leveraging Falcon and Rails for Real-Time Interactivity」について紹介させていただきます。 2日目のキーノートはリアルタイム通信についての…

developers.techouse.com

0

5

36

Samuel Williams

@ioquatix

2 years

I'm pretty hopeful that Rails 7.1 will support Rack 3!

Allow `rack >= 3` in Rails. by ioquatix · Pull Request #46594 · rails/rails

Allow Rack 3 to be used in Rails. Blocked By: use Karma as the test runner for the UJS tests #46206

github.com

0

3

36

Samuel Williams

@ioquatix

3 years

My daughter requested it. It's a fun piece of maths.

0

34

Samuel Williams

@ioquatix

4 years

Okay, this has been several years coming: This provides a well-defined interface for streaming requests and responses in rack:

1

3

34

Samuel Williams

@ioquatix

4 years

Support for leading arguments with ... is now merged: def foo(bar, ...) baz(...) end is now a thing.

Add leading arguments support to arguments forwarding by jeremyevans · Pull Request #3190 ·...

The idFWD_KWREST sections may be wrong. However, the existing idFWD_KWREST sections for ... without leading arguments are already broken. Implements [Feature #16378]

github.com

1

9

35

Samuel Williams

@ioquatix

2 years

Maybe I should write an article "Samuel Invests in Research for Ruby at Scale" 😂

1

35

Samuel Williams

@ioquatix

5 years

Here is my final report for the 2019 Ruby Association Grant: - we have shown that the concept is sound, now we must build consensus for the final implementation for Ruby 3!

Ruby Concurrency Final Report

www.codeotaku.com

3

12

34