185: InstructorEx for LLMs

Dive into the world of structured LLM prompting with our latest guest who shares insights on their innovative project, InstructorEx. We'll explore how this tool is pushing the boundaries of large language models to return structured data, particularly JSON, and the benefits it offers when integrated into existing systems. The conversation takes a deep dive into the challenges and solutions of forcing LLMs to output data in desirable formats using Elixir technology, like Ecto schemas, and what it means to treat an LLM like a digital human, even applying it to tasks like spam detection in emails. Discover the intriguing concept of using a local database as a cache for LLM results. If you're curious about the intersection of structured data, Python experience transition to Elixir, and the future of LLM integration, this is an episode not to miss. Tune in for these engaging topics and more!
Show Notes online - http://podcast.thinkingelixir.com/185 (http://podcast.thinkingelixir.com/185)
Elixir Community News
- https://twitter.com/spawnfest/status/1743987039345782978 (https://twitter.com/spawnfest/status/1743987039345782978?utm_source=thinkingelixir&utm_medium=shownotes) – Announcement and prize awarding of the SpawnFest winners.
- https://spawnfest.org/2023.html (https://spawnfest.org/2023.html?utm_source=thinkingelixir&utm_medium=shownotes) – Official SpawnFest 2023 webpage with details on the projects and winners.
- https://github.com/spawnfest/heimdall (https://github.com/spawnfest/heimdall?utm_source=thinkingelixir&utm_medium=shownotes) – 1st Place Overall at SpawnFest, Heimdall is a web app for secure and easy sharing of sensitive data.
- https://github.com/spawnfest/fluffytrain (https://github.com/spawnfest/fluffytrain?utm_source=thinkingelixir&utm_medium=shownotes) – 2nd Place Overall at SpawnFest, Fluffytrain is a web app for generating working Elixir code using OpenAI GPT-4.
- https://github.com/spawnfest/tabtab (https://github.com/spawnfest/tabtab?utm_source=thinkingelixir&utm_medium=shownotes) – 3rd Place Overall at SpawnFest, tabtab is an autocompletion generator plugin for Erlang's rebar3.
- https://github.com/spawnfest/arizona (https://github.com/spawnfest/arizona?utm_source=thinkingelixir&utm_medium=shownotes) – Arizona, an Erlang Web Framework, was one of the highlighted projects at SpawnFest.
- https://github.com/spawnfest/latch (https://github.com/spawnfest/latch?utm_source=thinkingelixir&utm_medium=shownotes) – Latch, a tool for viewing OpenTelemetry data in real-time was a highlighted project at SpawnFest.
- https://github.com/spawnfest/youcan (https://github.com/spawnfest/youcan?utm_source=thinkingelixir&utm_medium=shownotes) – Youcan, an Elixir library for using UCANs in app authorization flows, featured at SpawnFest.
- https://ucan.xyz/ (https://ucan.xyz/?utm_source=thinkingelixir&utm_medium=shownotes) – UCAN.xyz, related to the Youcan Elixir library for user-controlled authorization networks.
- https://github.com/spawnfest/lorax (https://github.com/spawnfest/lorax?utm_source=thinkingelixir&utm_medium=shownotes) – Lorax, a Livebook app implementing LoRA for fine-tuning language models, was highlighted at SpawnFest.
- https://github.com/spawnfest/karel_dreams (https://github.com/spawnfest/karel_dreams?utm_source=thinkingelixir&utm_medium=shownotes) – SpawnFest's highlighted project Karel_dreams, a Livebook app for controlling a robot with AI or script.
- https://twitter.com/josevalim/status/1744395345872683471 (https://twitter.com/josevalim/status/1744395345872683471?utm_source=thinkingelixir&utm_medium=shownotes) – José Valim celebrates Elixir's 13th anniversary and announces Elixir as a gradually typed language.
- https://twitter.com/bcardarella/status/1743370338254139712 (https://twitter.com/bcardarella/status/1743370338254139712?utm_source=thinkingelixir&utm_medium=shownotes) – Announcement of LiveView Native v0.2.0-rc.1 release and upcoming changes.
- https://twitter.com/germsvel/status/1744686958196973787 (https://twitter.com/germsvel/status/1744686958196973787?utm_source=thinkingelixir&utm_medium=shownotes) – German Valesco shares a tip about LiveView helpers for creating pipe-friendly functions in Elixir.
- https://codebeamamerica.com/ (https://codebeamamerica.com/?utm_source=thinkingelixir&utm_medium=shownotes) – CodeBeam America conference information, happening on March 7-8, 2024 in San Francisco and virtually.
- https://twitter.com/sasajuric/status/1744649232793886963 (https://twitter.com/sasajuric/status/1744649232793886963?utm_source=thinkingelixir&utm_medium=shownotes) – Tweet about CodeBeam America conference.
Do you have some Elixir news to share? Tell us at @ThinkingElixir (https://twitter.com/ThinkingElixir) or email at [email protected] (mailto:[email protected])
Discussion Resources
- https://github.com/thmsmlr/instructor_ex (https://github.com/thmsmlr/instructor_ex?utm_source=thinkingelixir&utm_medium=shownotes)
- https://twitter.com/thmsmlr/status/1736645576324784375 (https://twitter.com/thmsmlr/status/1736645576324784375?utm_source=thinkingelixir&utm_medium=shownotes)
- https://www.stitchfix.com/ (https://www.stitchfix.com/?utm_source=thinkingelixir&utm_medium=shownotes)
- https://docs.pydantic.dev/latest/ (https://docs.pydantic.dev/latest/?utm_source=thinkingelixir&utm_medium=shownotes)
- https://github.com/boudra/jaxon (https://github.com/boudra/jaxon?utm_source=thinkingelixir&utm_medium=shownotes)
- https://github.com/ggerganov/llama.cpp (https://github.com/ggerganov/llama.cpp?utm_source=thinkingelixir&utm_medium=shownotes)
- https://fly.io/phoenix-files/using-llama-cpp-with-elixir-and-rustler/ (https://fly.io/phoenix-files/using-llama-cpp-with-elixir-and-rustler/?utm_source=thinkingelixir&utm_medium=shownotes)
- https://hadoop.apache.org/ (https://hadoop.apache.org/?utm_source=thinkingelixir&utm_medium=shownotes)
- https://pig.apache.org/ (https://pig.apache.org/?utm_source=thinkingelixir&utm_medium=shownotes)
- https://www.r-project.org/ (https://www.r-project.org/?utm_source=thinkingelixir&utm_medium=shownotes)
- https://fly.io/blog/rethinking-serverless-with-flame/ (https://fly.io/blog/rethinking-serverless-with-flame/?utm_source=thinkingelixir&utm_medium=shownotes)
- BNF Grammar enforcement for JSON output
- https://www.linkedin.com/company/modal-labs/ (https://www.linkedin.com/company/modal-labs/?utm_source=thinkingelixir&utm_medium=shownotes)
- https://airflow.apache.org/ (https://airflow.apache.org/?utm_source=thinkingelixir&utm_medium=shownotes)
Guest Information
- https://twitter.com/thmsmlr (https://twitter.com/thmsmlr?utm_source=thinkingelixir&utm_medium=shownotes) – on Twitter
- https://github.com/thmsmlr/ (https://github.com/thmsmlr/?utm_source=thinkingelixir&utm_medium=shownotes) – on Github
- https://thmsmlr.com/ (https://thmsmlr.com/?utm_source=thinkingelixir&utm_medium=shownotes) – Blog
Find us online
- Message the show - @ThinkingElixir (https://twitter.com/ThinkingElixir)
- Message the show on Fediverse - @[email protected] (https://genserver.social/ThinkingElixir)
- Email the show - [email protected] (mailto:[email protected])
- Mark Ericksen - @brainlid (https://twitter.com/brainlid)
- Mark Ericksen on Fediverse - @[email protected] (https://genserver.social/brainlid)
- David Bernheisel - @bernheisel (https://twitter.com/bernheisel)
- David Bernheisel on Fediverse - @[email protected] (https://genserver.social/dbern)
- Cade Ward - @cadebward (https://twitter.com/cadebward)
- Cade Ward on Fediverse - @[email protected] (https://genserver.social/cadebward)

Dive into the world of structured LLM prompting with our latest guest who shares insights on their innovative project, InstructorEx. We'll explore how this tool is pushing the boundaries of large language models to return structured data, particularly JSON, and the benefits it offers when integrated into existing systems. The conversation takes a deep dive into the challenges and solutions of forcing LLMs to output data in desirable formats using Elixir technology, like Ecto schemas, and what it means to treat an LLM like a digital human, even applying it to tasks like spam detection in emails. Discover the intriguing concept of using a local database as a cache for LLM results. If you're curious about the intersection of structured data, Python experience transition to Elixir, and the future of LLM integration, this is an episode not to miss. Tune in for these engaging topics and more!

Show Notes online - http://podcast.thinkingelixir.com/185

Elixir Community News

https://twitter.com/spawnfest/status/1743987039345782978 – Announcement and prize awarding of the SpawnFest winners.
https://spawnfest.org/2023.html – Official SpawnFest 2023 webpage with details on the projects and winners.
https://github.com/spawnfest/heimdall – 1st Place Overall at SpawnFest, Heimdall is a web app for secure and easy sharing of sensitive data.
https://github.com/spawnfest/fluffytrain – 2nd Place Overall at SpawnFest, Fluffytrain is a web app for generating working Elixir code using OpenAI GPT-4.
https://github.com/spawnfest/tabtab – 3rd Place Overall at SpawnFest, tabtab is an autocompletion generator plugin for Erlang's rebar3.
https://github.com/spawnfest/arizona – Arizona, an Erlang Web Framework, was one of the highlighted projects at SpawnFest.
https://github.com/spawnfest/latch – Latch, a tool for viewing OpenTelemetry data in real-time was a highlighted project at SpawnFest.
https://github.com/spawnfest/youcan – Youcan, an Elixir library for using UCANs in app authorization flows, featured at SpawnFest.
https://ucan.xyz/ – UCAN.xyz, related to the Youcan Elixir library for user-controlled authorization networks.
https://github.com/spawnfest/lorax – Lorax, a Livebook app implementing LoRA for fine-tuning language models, was highlighted at SpawnFest.
https://github.com/spawnfest/karel_dreams – SpawnFest's highlighted project Karel_dreams, a Livebook app for controlling a robot with AI or script.
https://twitter.com/josevalim/status/1744395345872683471 – José Valim celebrates Elixir's 13th anniversary and announces Elixir as a gradually typed language.
https://twitter.com/bcardarella/status/1743370338254139712 – Announcement of LiveView Native v0.2.0-rc.1 release and upcoming changes.
https://twitter.com/germsvel/status/1744686958196973787 – German Valesco shares a tip about LiveView helpers for creating pipe-friendly functions in Elixir.
https://codebeamamerica.com/ – CodeBeam America conference information, happening on March 7-8, 2024 in San Francisco and virtually.
https://twitter.com/sasajuric/status/1744649232793886963 – Tweet about CodeBeam America conference.

Do you have some Elixir news to share? Tell us at @ThinkingElixir or email at [email protected]

Discussion Resources

https://github.com/thmsmlr/instructor_ex
https://twitter.com/thmsmlr/status/1736645576324784375
https://www.stitchfix.com/
https://docs.pydantic.dev/latest/
https://github.com/boudra/jaxon
https://github.com/ggerganov/llama.cpp
https://fly.io/phoenix-files/using-llama-cpp-with-elixir-and-rustler/
https://hadoop.apache.org/
https://pig.apache.org/
https://www.r-project.org/
https://fly.io/blog/rethinking-serverless-with-flame/
BNF Grammar enforcement for JSON output
https://www.linkedin.com/company/modal-labs/
https://airflow.apache.org/

Guest Information

https://twitter.com/thmsmlr – on Twitter
https://github.com/thmsmlr/ – on Github
https://thmsmlr.com/ – Blog

Find us online

Message the show - @ThinkingElixir
Message the show on Fediverse - @[email protected]
Email the show - [email protected]
Mark Ericksen - @brainlid
Mark Ericksen on Fediverse - @[email protected]
David Bernheisel - @bernheisel
David Bernheisel on Fediverse - @[email protected]
Cade Ward - @cadebward
Cade Ward on Fediverse - @[email protected]

Sponsored By: