Ask Noah Show 367

This week Noah and Steve discuss picking out a vHost and considerations for deploying it into production.
-- During The Show --
02:00
Types of AI
Amount of compute required is astronomical
Foundational model vs tweaking
05:55 Kid Friendly distro? - Chris
Endless OS (https://www.endlessos.org/)
What age to give kids a computer
Why give a kid a computer
Why Endless OS
OpenDNS Filtering
14:13 Serial Connection To Proxmox VMs - Michael
Client Setting
Host Setting
Enable the serial console
Proxmox Wiki (https://pve.proxmox.com/wiki/Serial_Terminal)
17:15 pfSense blocking active connections - Bradly
Stateful firewalls don't break active connections/sessions
21:00 News Wire
EXT4 Corruption Bug - LWN (https://lwn.net/Articles/954285/)
Gnome 45.2 - Gnome (https://discourse.gnome.org/t/gnome-45-2-released/18358)
Libreoffice 7.6.4 - Libreoffice (https://www.libreoffice.org/download/release-notes/)
Jellyfin Android TV App - Jellyfin (https://jellyfin.org/posts/androidtv-v0.16.0/)
Jellyfin Roku App - Jellyfin (https://jellyfin.org/posts/roku-200)
Debian 12.4 - Debian (https://www.debian.org/News/2023/20231210)
Alpine Linux 3.19 - Alpine Linux (https://wiki.alpinelinux.org/wiki/Release_Notes_for_Alpine_3.19.0)
Linux 6.8 Dropping Old Graphics Drivers - Phoronix (https://www.phoronix.com/news/Linux-6.8-No-More-UMS-ioctls)
NSA & ESF Recommended Practices - NSA (https://www.nsa.gov/Press-Room/Press-Releases-Statements/Press-Release-View/Article/3613105/nsa-and-esf-partners-release-recommended-practices-for-managing-open-source-sof/)
OpenZeppelin Vulnerability - Bleeping Computer (https://www.bleepingcomputer.com/news/security/multiple-nft-collections-at-risk-by-flaw-in-open-source-library/)
Bluetooth Authentication Bypass - Silicon Angle (https://siliconangle.com/2023/12/07/critical-bluetooth-security-flaw-discovered-google-apple-linux-devices/)
Krasue RAT - The Hacker News (https://thehackernews.com/2023/12/new-stealthy-krasue-linux-trojan.html)
Automatic LLM AI Jail Break - Robust Intelligence (https://www.robustintelligence.com/blog-posts/using-ai-to-automatically-jailbreak-gpt-4-and-other-llms-in-under-a-minute)
EU AI Act - Reuters (https://www.reuters.com/technology/eus-ai-act-could-exclude-open-source-models-regulation-2023-12-07/)
Purple Llama - Info World (https://www.infoworld.com/article/3711284/meta-releases-open-source-tools-for-ai-safety.html)
Apple Open Sources AI Tools - The Stack (https://www.thestack.technology/apple-quietly-open-sources-key-ai-tools/)
Systemd 255 - The Verge (https://www.theverge.com/2023/12/7/23992512/linux-blue-screen-of-death-bsod-systemd-update) - Phoronix (https://www.phoronix.com/news/systemd-255)
24:00 Beeper Mini
First impression, really cool but will only work till Apple notices
Android users clearly want modern features
3 days after release, it all came to a halt
Apple's FUD statement
Beeper mini enabled security for non Apple users
Apple's response reduces security and privacy
Apple's response protects the iMessage lock-in effect
Issue with other "encrypted apps"
Focus of Beeper
Beeper cloud uses its own cloud server
Give beeper mini a review
Beeper blog post (https://blog.beeper.com/p/beeper-mini-is-back)
37:45 vHost Hardware
What is a vHost
What does Steve consider
network
drives
RAM
CPU
Lots of compute nodes vs a few large nodes
Stage 1 - is it viable
$1k-50k quotes
Started with 2 vdevs with 3 drives
Stay under 85%
Stage 2 Scale up
DELL EMC POWEREDGE R7425
8 BAY LFF SERVER
2x AMD EPYC 7451
H330 3 PCI RISER RPS
DELL PowerEdge R6525
1U Server
2 x AMD EPYC 7542 2.9Ghz CPU
256 GB No HDD
Can save a lot buying used
Local vs Central storage
Data centralized
qcow2 on vHost
2 vdevs
2 disks per vdev
Dell EMC KTN-STL3 drive shelf
15 disks in 2U
Requires LSI SAS9200-8e
NetApp DS4246
24 disks in 4U
Requires LSI SAS9200-8e
QSFP SFF-8436 Mini SAS SFF-8088 Cable
Don't store Nextcloud data on OS qcow2 disk
There will always be a single point of failure
Change ZFS settings based on data being stored
Easiest way to get a vHost up and running
KVM vs "appliance OS"
Bridging vs MAC vTap
RAM is likely your biggest constraint
Ubuntu libvirt doc (https://ubuntu.com/server/docs/virtualization-libvirt)
-- The Extra Credit Section --
For links to the articles and material referenced in this week's episode check out this week's page from our podcast dashboard!
This Episode's Podcast Dashboard (http://podcast.asknoahshow.com/367)
Phone Systems for Ask Noah provided by Voxtelesys (http://www.voxtelesys.com/asknoah)
Join us in our dedicated chatroom #GeekLab:linuxdelta.com on Matrix (https://element.linuxdelta.com/#/room/#geeklab:linuxdelta.com)
-- Stay In Touch --
Find all the resources for this show on the Ask Noah Dashboard
Ask Noah Dashboard (http://www.asknoahshow.com)
Need more help than a radio show can offer? Altispeed provides commercial IT services and they’re excited to offer you a great deal for listening to the Ask Noah Show. Call today and ask about the discount for listeners of the Ask Noah Show!
Altispeed Technologies (http://www.altispeed.com/)
Contact Noah
live [at] asknoahshow.com
-- Twitter --
Noah - Kernellinux (https://twitter.com/kernellinux)
Ask Noah Show (https://twitter.com/asknoahshow)
Altispeed Technologies (https://twitter.com/altispeed)
Special Guest: JT Pennington.

This week Noah and Steve discuss picking out a vHost and considerations for deploying it into production.

-- During The Show --

02:00

Types of AI
Amount of compute required is astronomical
Foundational model vs tweaking

05:55 Kid Friendly distro? - Chris

Endless OS
What age to give kids a computer
Why give a kid a computer
Why Endless OS
OpenDNS Filtering

14:13 Serial Connection To Proxmox VMs - Michael

Client Setting
Host Setting
Enable the serial console
Proxmox Wiki

17:15 pfSense blocking active connections - Bradly

Stateful firewalls don't break active connections/sessions

21:00 News Wire

EXT4 Corruption Bug - LWN

Gnome 45.2 - Gnome

Libreoffice 7.6.4 - Libreoffice

Jellyfin Android TV App - Jellyfin

Jellyfin Roku App - Jellyfin

Debian 12.4 - Debian

Alpine Linux 3.19 - Alpine Linux

Linux 6.8 Dropping Old Graphics Drivers - Phoronix

NSA & ESF Recommended Practices - NSA

OpenZeppelin Vulnerability - Bleeping Computer

Bluetooth Authentication Bypass - Silicon Angle

Krasue RAT - The Hacker News

Automatic LLM AI Jail Break - Robust Intelligence

EU AI Act - Reuters

Purple Llama - Info World

Apple Open Sources AI Tools - The Stack

Systemd 255 - The Verge - Phoronix

24:00 Beeper Mini

First impression, really cool but will only work till Apple notices
Android users clearly want modern features
3 days after release, it all came to a halt
Apple's FUD statement
Beeper mini enabled security for non Apple users
Apple's response reduces security and privacy
Apple's response protects the iMessage lock-in effect
Issue with other "encrypted apps"
Focus of Beeper
Beeper cloud uses its own cloud server
Give beeper mini a review
Beeper blog post

37:45 vHost Hardware

What is a vHost
What does Steve consider

network
drives
RAM
CPU

Lots of compute nodes vs a few large nodes
Stage 1 - is it viable

$1k-50k quotes
Started with 2 vdevs with 3 drives

Stay under 85%
Stage 2 Scale up
DELL EMC POWEREDGE R7425

8 BAY LFF SERVER
2x AMD EPYC 7451
H330 3 PCI RISER RPS

DELL PowerEdge R6525

1U Server
2 x AMD EPYC 7542 2.9Ghz CPU
256 GB No HDD

Can save a lot buying used
Local vs Central storage
Data centralized
qcow2 on vHost

2 vdevs
2 disks per vdev

Dell EMC KTN-STL3 drive shelf

15 disks in 2U
Requires LSI SAS9200-8e

NetApp DS4246

24 disks in 4U
Requires LSI SAS9200-8e
QSFP SFF-8436 Mini SAS SFF-8088 Cable

Don't store Nextcloud data on OS qcow2 disk
There will always be a single point of failure
Change ZFS settings based on data being stored
Easiest way to get a vHost up and running
KVM vs "appliance OS"
Bridging vs MAC vTap
RAM is likely your biggest constraint
Ubuntu libvirt doc

-- The Extra Credit Section --

For links to the articles and material referenced in this week's episode check out this week's page from our podcast dashboard!

This Episode's Podcast Dashboard

Phone Systems for Ask Noah provided by Voxtelesys

Join us in our dedicated chatroom #GeekLab:linuxdelta.com on Matrix

-- Stay In Touch --

Find all the resources for this show on the Ask Noah Dashboard

Ask Noah Dashboard

Need more help than a radio show can offer? Altispeed provides commercial IT services and they’re excited to offer you a great deal for listening to the Ask Noah Show. Call today and ask about the discount for listeners of the Ask Noah Show!

Altispeed Technologies

Contact Noah

live [at] asknoahshow.com

-- Twitter --

Noah - Kernellinux
Ask Noah Show
Altispeed Technologies

Special Guest: JT Pennington.

Support Ask Noah Show