Mechanistic Interpretability and How LLMs Understand

A discussion on the philosophy of deep learning, mechanistic interpretability and the epistemology of LLMs. Dr Matthieu Queloz is a Privatdozent at the University of Bern. He is the author of two books: The Practical Origins of Ideas and The Ethics of Conceptualization, both published open access with Oxford University Press. He was recently awarded a two-million-dollar grant to lead a research project on concepts, understanding, and reasoning in Large Language Models. You can find more of Dr Queloz's work at https://www.matthieuqueloz.com/ Pierre Beckmann is an AI researcher working in Philosophy of AI and Philosophically-motivated AI. He is currently a PhD student in the Neuro-Symbolic AI group of Idiap and EPFL. Pierre also keeps close ties to the Institute for Philosophy of Bern, where I worked as a research assistant. You can find more of Pierre's work at https://bepierre.github.io/ RSam Podcast #88 --------------------------------------- Please consider financially supporting my work (ONLY if you have the means). Patreon: https://patreon.com/trsam?utm_medium=unknown&utm_source=join_link&utm_campaign=creatorshare_creator&utm_content=copyLink Substack: https://rsampod.substack.com PayPal: https://paypal.me/rsampod?country.x=AU&locale.x=en_AU --------------------------------------- {Podcast} Substack: https://rsampod.substack.com/podcast Spotify: https://open.spotify.com/show/4ryEqjut4r6SMtfxLdM1Le SFP: https://podcasters.spotify.com/pod/show/rahul-samaranayake {Website} https://rahulsam.me/ {Social Media} https://substack.com/@trsam/ https://www.instagram.com/name_is_rahul/ https://x.com/trsam97 https://www.linkedin.com/in/rahul-samaranayake-981a9315b/ {References & Resources} https://cliff-salad-4e8.notion.site/Pierre-Beckmann-Matthieu-Queloz-Mechanistic-Interpretability-and-How-LLMs-Understand-29496d43c59b801a94fceaf644b1c4ec?source=copy_link {Music Used} "Supapao - Can't Fall In Love" is under a Free To Use YouTube license https://soundcloud.com/supapao Music powered by BreakingCopyright: https://youtu.be/VZkFJAb_gx4?si=J6AwKLAmikAzoqHj Chill Lofi Hiphop - 'Breath' by l33 is under a Free To Use YouTube license SoundCloud: https://soundcloud.com/nocopyrightlofi/no-copyright-chill-lofi-hiphop-breath-by-l33 --------------------------------------- If the ideas I discuss in this channel evoke your interest, consider visiting https://theunhappyman.substack.com/ --------------------------------------- Copyright Disclaimer under section 107 of the Copyright Act 1976, allowance is made for “fair use” for purposes such as criticism, comment, news reporting, teaching, scholarship, education and research. Fair use is a use permitted by copyright statutes that might otherwise be infringing. If you are or represent the copyright owner of materials used in this video and have a problem with the use of the related material, please email me at trahulsam@gmail.com, and we can sort it out. Thank you.