Simon Willison’s Weblog Subscribe #smallhead 23rd October 2023 Embeddings are a really neat trick that often come wrapped in a pile of intimidating jargon. If you can make it through that jargon, they unlock powerful and exciting techniques that can be applied to all sorts of interesting problems. I gave a talk about embeddings at PyBay 2023 . This article represents an improved version of that talk, which should stand alone even without watching the video. If you’re not yet familiar with embeddings I hope to give you everything you need to get started applying them to real-world problems. In this article: The 38 minute video version What are embeddings? Related content using embeddings Exploring how these things work with Word2Vec Calculating embeddings using my LLM tool Vibes-based search Embeddings for code using Symbex Embedding text and images together using CLIP...

~?~

~?~

Simon Willison’s Weblog #smallhead Last week, Microsoft announced the new AI-powered Bing : a search interface that incorporates a language model powered chatbot that can run searches for you and summarize the results, plus do all of the other fun things that engines like GPT-3 and ChatGPT have been demonstrating over the past few months: the ability to generate poetry, and jokes, and do creative writing, and so much more. This week, people have started gaining access to it via the waiting list. It’s increasingly looking like this may be one of the most hilariously inappropriate applications of AI that we’ve seen yet. If you haven’t been paying attention, here’s what’s transpired so far. The demo was full of errors It started gaslighting people It suffered an existential crisis The prompt leaked And then it started threatening people The demo that introduced AI Bing to th...

~?~

~?~