Been quietly working away at something for the past few months and am excited to finally share!
@AlpacaML
is a next-generation design platform powered by generative models. There is a major paradigm shift underway in terms of the way in which creative work is done... (1/4)
Hiring for a research engineer at
@alpacaml
— someone who loves training models, getting their hands dirty, making stuff work. Come work at the frontier of creative technology, reach out via DM or email at hiring
@alpacaml
.com
After two wonderful years with
@MSFTResearch
, I'm happy to announce that I will be moving just down the street to
@Mila_Quebec
, where I will continue my research as a graduate student under the supervision of the excellent
@lcharlin
.
1/ So very excited about this. After several months in a closed beta and countless conversations with artists, creators, and studios, we're one step closer to making good on the dream of what I think AI-native software should look like —
1/ Introducing Alpaca’s public beta (goodbye waitlist!) for
@Photoshop
. So many exciting new features to share with this update! More below. Try it for free here:
We are currently hiring in ML and engineering at
@alpacaml
! Come join a brilliant team building the next generation of creative tools.
We are actively seeking a diverse applicant pool and encourage applicants of all backgrounds to apply!
O-1 was just approved!!
@neilsonks
and I will be moving to SF in Feb - excited to reconnect w old friends and get to know some new ones.
Additionally, am greatly looking forward to getting back to working in-person with
@wbuchw
- more on this to come soon 🦙
We've interviewed hundreds of artists about their experience working with AI and the most common piece of feedback we hear is "I simply cannot get AI tools to faithfully render the idea or image that I have inside my head".
Let's jump into a few of my favourite Chroma examples
Introducing Chroma, our new web-based tool that brings you state-of-the-art control over color and composition.
Chroma is built for artists of any kind, helping you explore, experiment, and bring your boldest ideas to life.
Try it here:
Excited to share that our
@strelkaschool
project, Site of the Synthetic, is now live on the web. Featuring a number of ideas developed over the past few months, in response to the question — how can intelligence be articulated as a medium of design? 1/7
An experimental design language framing the design of intelligent systems as a composition of elements –– operators, constraints, and operations. The properties of the system emerge through the interplay of its elements. 1/5
Introducing Chroma, our new web-based tool that brings you state-of-the-art control over color and composition.
Chroma is built for artists of any kind, helping you explore, experiment, and bring your boldest ideas to life.
Try it here:
Really excited about this one! Finally, a way to continuously iterate on and refine your artwork with the precision/control of a brush workflow + the speed/polish of AI.
We put a lot of work into the Generation Mask tool, bringing you new models, fast inference, and strong image
Combining
@StabilityAI
#StableDiffusion
generative powers + Human guidance and graphic skills* with tools like
@Photoshop
in a coherent workflow.
* Of which I've got about 0 as can be seen below.
occasionally wonder which particular choices in life led to me nodding in silent agreement with self-deprecating takes from anime pfp accounts on the tl
Last hiring post for the year —
@alpacaml
is looking for a creative specialist to lead our in-house creative efforts. If you love visual storytelling, experimenting with process, and making beautiful things, we'd love to talk! Digital drawing and painting skills are a prereq
Every NYE I put together a page of favourite passages from my reading list that year. 2021 was one of my most interesting years in books - looking forward to continuing down the rabbit-hole in 2022!
Importantly, there is some immensely exciting technical work in front of us & we are hiring! 🎉 We are looking for machine learning engineers, full-stack devs designers to work with us. Competitive salaries, full benefits, and remote optional. (3/4)
...and there are new tools & new workflows to be designed around that shift. Designing for real-time iteration and humans in the loop will be a core principle. Interfaces & interaction spaces as well as a major push to leverage machine learning in fresh & interesting ways. (2/4)
If you are at MIT on March 3rd, 2023, join us for the
@MITSloan_AIClub
's first GenAI Summit:
Follow us for speaker announcements, live updates, ticket giveaways, and more!
Happy to be back working with some old colleagues from Microsoft/MSR, notably
@wbuchw
, to build in what is shaping up to be an incredibly rich and fast-moving space. DMs are open to chat + more exciting news in the pipeline to share soon. (4/4)
We're looking to bring someone on to
@alpacaml
to work on marketing, community, and growth. Great fit for someone excited to be creative and (very) hands-on with all aspects of an early-stage startup.
Job posting here:
Happy to be back at
#NeurIPS2022
this year! Shoot me a DM or just say hi if you're interested in talking about generative models, diffusion, design, or (especially) job opportunities at
@alpacaml
! 🦙
Calling all digital artists, game devs, illustrators, and animators interested in working with AI — we are building tools for you! Get in touch, we’d love to hear how we can help
This is still very much a thing, especially on the ML side. If you have worked with diffusion, GANs, or other generative models, shoot me an email or a DM with a quick one-liner about you and let's chat!
We are currently hiring in ML and engineering at
@alpacaml
! Come join a brilliant team building the next generation of creative tools.
We are actively seeking a diverse applicant pool and encourage applicants of all backgrounds to apply!
Feeling immensely grateful to everyone who contributed letters of support for my petition (you know who you are!) and to the wonderful team at
@plymouth
(
@lisawehden
,
@minney_cat
) for helping us through the process!
Hiring for a research engineer at
@alpacaml
— someone who loves training models, getting their hands dirty, making stuff work. Come work at the frontier of creative technology, reach out via DM or email at hiring
@alpacaml
.com
The idea was always to construct a design language of of flexible, modular primitives through which the development and deployment of intelligent systems can be made legible, permitting analysis and engineering beyond the technical. 5/5
An enormous thank you to all of my colleagues at Microsoft (it has truly been a pleasure!) and a hello to all at Mila and Strelka! I'm excited for new acquaintances, new collaborations, and the work to come (perhaps I'll even tweet about it once in a while).
Most draw-based AI tools are not built to handle iterativity - every new brush stroke re-renders your image entirely, destroying whatever results you had on-screen beforehand.
This project blends perspectives from contemporary machine learning research — the development and deployment of models, the large-scale mobilization of data, the peculiarities of the solution spaces carved out by deep networks... 3/7
The prototype of colorful-concepts is out now
Playfully combine concepts into new ideas on a spatial canvas! Drag words around to modify their strength and enter anything in the label fields.
2/ ...Dynamic, interactive, explorative, with multiple points of entry into and multiple points of departure from both AI-driven and intentional human workflows.
6/ Additionally, I'm also very happy with the emphasis on non natural-language interfaces. Natural language interfaces have been an incredible technological innovation for this space, but art and design have always been fundamentally tactile inasmuch as they are conceptual.
LLM Interfaces
Every week I'll be adding an AI language interface here with an emphasis on interactivity and playfulness
1. Pulling apart sentences to elaborate, pinching a paragraph to summarize it.
This work will also be released as a long-form essay later this month (stay tuned). In the mean time, enjoy this first glimpse of what is both an exercise and a stab at a serious work — I think it’s important and worthwhile for anyone doing work in and around ML to... 5/7
For inputs with transparent backgrounds, Chroma will act as an inpainting model (!!!) and fill in your transparency according to prompt info, while remaining true to your input.
Starting with a few detailed inputs, we can use the Pro and Controlled parameter presets to keep outputs close to the original image while still keeping a bit of wiggle room to play with style and detailing.
Operations are the active form which determine the dynamics of information exchange –– how are operators arranged in relation to each other and under which conditions? How can these relations be articulated and understood? 4/5
We were delightfully surprised to find that Chroma also works well with even simple kids drawings!
Moving towards the Creative and Wild parameter presets opens up freedom for the model to more loosely interpret the drawing, but the general idea is still very much there.
The draw + mask based approach gives you way more flexibility and control, plus the free-flow/organic feeling of the brush keeps you locked into your happy flow-state as you work on the canvas.
On the other hand, most mask-based tools (Generative Fill, etc) rely exclusively on text-prompt dice rolls to replace whatever it is you're looking to change.
Join us today in Discord at noon ET for our first community event with artist Sebastian Lüdke!
With over 17 years of experience in film, game, and VR production, Sebastian combines deep industry experience with new and innovative technical workflows.
Probably my slowest year for reading - it was a busy one, but besides that Gravity's Rainbow and Ulysses each took me much longer than expected (I still have about 170 pages left in Ulysses).
...with the body of ideas emerging from and tangential to
@bratton
’s The Terraforming — planetary sensing and modelling, design and self-composition, the artificial and the synthetic, and the interplay between terraforming and anthropoforming in the post-anthropocene. 4/7
...at some point spend the time interrogating and reflecting on the broader trajectory of this field — what it is, how we see it, and what it *could* be, especially as it begins to move into a state of maturity and ubiquity. 6/7
Other thoughts - Joyce was far funnier here than I anticipated; Land's 'Art as Insurrection' was the most fun I've had with an essay in some time; Calvino's Six Memos (a reread) will never cease to delight; I wish I'd read Miyazawa as a child.
@lukestevens
So many different, interesting ways to manipulate pixels!
+Fwiw I think that if folks building in text gen can shift the collective imagination beyond autocomplete then there maybe be hope for it yet
7/ Generally speaking, I hope this all lands well with the artists out there — Alpaca was built to help artists do *more* of what they love and to broaden the possibility space of exploration and iteration for visual creative work.
Furthermore, can we develop a genuinely interesting projective imaginary and equally rigorous design language for this endeavour? How does the way we currently frame and narrativize the development of artificial intelligence stand in the way of these ends? 2/7