NotesThousands of Dubliners showed up for the city's much-anticipated Halloween parade on Thursday evening. They lined the streets from Parnell Street to Christchurch Cathedral, waiting for the promised three-hour parade that would "[transform] Dublin into a lively tapestry of costumes, artistic performances, and cultural festivities." A likely story. There was no parade, and never was one. Unfurl
NotesOasis takes in user keyboard input and generates real-time gameplay, including physics, game rules, and graphics. You can move around, jump, pick up items, break blocks, and more. There is no game engine; just a foundation model.Unfurl
NotesA more effective abstraction is conceptualizing vector embeddings not as independent tables or data types but as a specialized index on the embedded data. This is not to say that vector embeddings are literally indexes in the traditional sense, like those in PostgreSQL or MySQL, which retrieve entire data rows from indexed tables. Instead, vector embeddings function as an indexing mechanism that retrieves the most relevant parts of the data based on its embeddings.FeedUnfurl
NotesI released LLM 0.17 last night, the latest version of my combined CLI tool and Python library for interacting with hundreds of different Large Language Models such as GPT-4o, Llama, Claude and Gemini.FeedUnfurl
Notes Embeddings aren't exactly new, but they have become much more widely accessible in the last couple years. What embeddings offer to technical writers is the ability to discover connections between texts at previously impossible scales.FeedUnfurl
NotesGenerative AI is like if capitalism reinvented the fae. It’ll trick you into accepting its agreement and then it’ll steal your face and start speaking with your voice.EmbedUnfurl
NotesIlya Sutskever shared a list of 30 papers with John Carmack and said, “If you really learn all of these, you’ll know 90% of what matters today”FeedUnfurl
NotesThis is how we’re headed for another AI winter, just as we saw with the fall of data science, crypto, and the modern data stack. And that’s actually a good thing. The promoters will hop onto the next trendy buzzword, while the real producers will keep moving forward, building a more capable future for AI.FeedUnfurl
NotesHey everyone! Today I wanted to talk about the state of the internet, how artists and everyone is affected by AI slop and social media, and why I think everyone should have a personal website these days! Let's bring back the old school internet in new, fun, and creative ways! ^_^EmbedUnfurl
Notessqlite-lembed is a SQLite extension for generating text embeddings, meant to work alongside sqlite-vec. With a single embeddings model file provided in the .gguf format, you can generate embeddings using regular SQL functions, and store them directly inside your SQLite database. No extra server, process, or configuration needed!Unfurl
NotesThe most common use-case for vectors in databases is for K-nearest-neighbors (KNN) queries. You'll have a table of vectors, and you'll want to find the K closestUnfurl
NotesYou can use SQLite's builtin full-text search (FTS5) extension and semantic search with sqlite-vec to create "hybrid search" in your applications. You can combine results using different methods like keyword-first, re-ranking by "semantics", and reciprocal rank fusion. Best of all, since it's all in SQLite, experiments and prototypes are cheap and easy, no 3rd party services required!Unfurl
NotesThis tutorial covers the origins and uses of the BART model for text summarization tasks, and concludes with a brief demo for using BART with Paperspace Notebooks.Unfurl
NotesWe have entered an era of LLM democratization. By showing that smaller models can be highly effective, enabling easy experimentation, diversifying control, and providing incentives that are not profit motivated, open-source initiatives are moving us into a more dynamic and inclusive AI landscape. This doesn’t mean that some of these models won’t be biased, or wrong, or used to generate disinformation or abuse. But it does mean that controlling this technology is going to take an entirely different approach than regulating the large players.FeedEmbedUnfurl
NotesBut in calling these programs “artificial intelligence” we grant them a claim to authorship that is simply untrue. Each of those tokens used by programs like ChatGPT—the “language” in their “large language model”—represents a tiny, tiny piece of material that someone else created. And those authors are not credited for it, paid for it or asked permission for its use. In a sense, these machine-learning bots are actually the most advanced form of a chop shop: They steal material from creators (that is, they use it without permission), cut that material into parts so small that no one can trace them and then repurpose them to form new products.Unfurl
NotesIt’s possible that, in the future, we will build an A.I. that is capable of writing good prose based on nothing but its own experience of the world. The day we achieve that will be momentous indeed—but that day lies far beyond our prediction horizon. In the meantime, it’s reasonable to ask, What use is there in having something that rephrases the Web?FeedUnfurl
NotesSooner or later, every single conversation I have will be recorded and transcribed and I’ll be able to look back at it later – details from a phone call with the bank, in the hardware store asking a question, someone mentions a book at the pub, an idea in a workshop. Ignoring the societal consequences for a sec lol ahem… how should the app to manage all that chatter work?FeedUnfurl
NotesI'm training RNNs all the time and I've witnessed their power and robustness many times, and yet their magical outputs still find ways of amusing me. This post is about sharing some of that magic with you.FeedUnfurl
NotesDouglas Hofstadter, the Pulitzer Prize–winning author of Gödel, Escher, Bach, thinks we've lost sight of what artificial intelligence really means. His stubborn quest to replicate the human mind. FeedUnfurl
NotesWhat if the private pursuit of profit was—for a long time—proximate to improving the lot of humans but not identical to it? What if capitalism has gone feral, and started making moves that are obviously insane, but also inevitable? Unfurl
NotesZen19 is beating extremely strong amateurs, but it hasn't beaten professionals in games with no handicap yet. That said, now that we know that Zen19 is using Monte Carlo strategies, the reason why it seems to be getting stronger as it's fed more CPU time is revealed: these strategies are the most obviously parallelizable algorithms out there, and for all we know this exact version of Zen19 could end up becoming World Champion if a few more orders of magnitude of CPU time were made available to it.
Which would feel like a shame, because I was really looking forward to seeing us figure out how brains work. FeedEmbedUnfurl
NotesNow maybe you can see how science could have a successor: thalience would use objective truth as an artistic medium and merge subjectivity and objectivity in a creative activity whose purpose is the re-sanctification of the natural world. To believe in an uplifting and satisfying vision of your place in the universe, and to know that this vision is true (or as true as anything can be) would be sublime. Thalience would be an activity worthy of post-scientific humanity, or our own biological or post-biological successors.Unfurl
Notes"The setup is this: Seven AI players. Randomized start locations. Using the Broodwar expansion. The last “player” is the human observer, who controls no units but who can see the entire map. The script in question runs on the map “The Hunters”, although it could easily be exported to other maps. There are two Protoss players, two Zerg players, and three Terran Players. The computer players are all set to “insane” level difficulty, informed that all other players are their enemy, and told to go at it. Mayhem ensues."FeedEmbedUnfurl
Notes"Chalcedony wasn't built for crying. She didn't have it in her, not unless her tears were cold tapered glass droplets annealed by the inferno heat that had crippled her."Unfurl
Notes"These kinds of bots -- attention filters, perhaps, or focus assistants -- are likely to become important parts of how we handle our daily lives."Unfurl
Notes"This AI must manage the internal resources for the tank (health fuel), find the enemy tank, map out the world, and destroy the enemy tank."Unfurl
Notes"Computers have great difficulty with the Game of Go. The field of Artificial Intelligencehas conquered chess, but still has difficulties with Go. This blog will contain information about advancing the state of the art Go AI"Unfurl
Thousands Turn Out For Nonexistent Halloween Parade Promoted By AI Listing | Defector
Oasis
Vector Databases Are the Wrong Abstraction
You can now run prompts against images, audio and video in your terminal using LLM
The A.I. Bubble is Bursting with Ed Zitron - YouTube
Embeddings are underrated
Aman's AI Journal • Primers • Ilya Sutskever's Top 30
AI Winter Is Coming
Introducing sqlite-lembed: A SQLite extension for generating text embeddings locally | Alex Garcia's Blog
KNN queries | sqlite-vec
Hybrid full-text search and vector search with SQLite | Alex Garcia's Blog
The case for handcrafted software in a mass-produced world • The Register
Using Llamafiles for Embeddings in Local RAG Applications
BART Model for Text Summarization
Overview — Ray 2.34.0
Open-Source LLMs - Schneier on Security
ChatGPT is not ‘artificial intelligence.’ It’s theft. | America Magazine
AI-enhanced development makes me more ambitious with my projects
ChatGPT Is a Blurry JPEG of the Web | The New Yorker
Transcribing all our conversations 24/7 will be weird and also useful maybe (Interconnected)
Self-Driving Cars Have a Secret Weapon: Remote Control | WIRED
Spotify’s Discover Weekly: How machine learning finds your new music
The Unreasonable Effectiveness of Recurrent Neural Networks
The Man Who Would Teach Machines to Think - James Somers - The Atlantic
Computers are very good at the game of Go
Thalience — KarlSchroeder.com
Eliza (elizabot.js)
Twenty Sided » Blog Archive » Starcraft: Bot Fight
Image evolution