[ML News] Meta's OPT 175B language model | DALL-E Mega is training | TorToiSe TTS fakes my voice

#mlnews #dalle #gpt3

An inside look of what's happening in the ML world!

Sponsor: Weights & Biases

https://wandb.me/yannic

OUTLINE:

0:00 - Intro

0:20 - Sponsor: Weights & Biases

1:40 - Meta AI releases OPT-175B

4:55 - CoCa: New CLIP-Competitor

8:15 - DALL-E Mega is training

10:05 - TorToiSe TTS is amazing!

11:50 - Investigating Vision Transformers

12:50 - Hugging Face Deep RL class launched

13:40 - Helpful Things

17:00 - John Deere's driverless tractors

References:

Meta AI releases OPT-175B

https://ai.facebook.com/blog/democratizing-access-to-large-scale-language-models-with-opt-175b/

https://arxiv.org/abs/2205.01068

https://arxiv.org/pdf/2205.01068.pdf

https://github.com/facebookresearch/metaseq/tree/main/projects/OPT

https://github.com/facebookresearch/metaseq/blob/main/projects/OPT/chronicles/OPT175B_Logbook.pdf

https://github.com/facebookresearch/metaseq/tree/main/projects/OPT/chronicles

https://twitter.com/yoavgo/status/1522150063815987201

CoCa: New CLIP-Competitor

https://arxiv.org/abs/2205.01917

https://arxiv.org/pdf/2205.01917.pdf

DALL-E Mega is training

https://twitter.com/borisdayma

https://twitter.com/borisdayma/status/1521891895001112577

https://wandb.ai/dalle-mini/dalle-mini/reports/DALL-E-Mega--VmlldzoxODMxMDI2

TorToiSe TTS is amazing!

https://github.com/neonbjb/tortoise-tts

https://nonint.com/static/tortoise_v2_examples.html

https://colab.research.google.com/drive/1wVVqUPqwiDBUVeWWOUNglpGhU3hg_cbR

https://github.com/neonbjb

Investigating Vision Transformers

https://github.com/sayakpaul/probing-vits/?utm_source=pocket_mylist

https://twitter.com/RisingSayak/status/1515918406171914240?utm_source=pocket_mylist

https://keras.io/examples/vision/probing_vits/

https://github.com/sayakpaul/probing-vits/tree/main/notebooks?utm_source=pocket_mylist

Hugging Face Deep RL class launched

https://github.com/huggingface/deep-rl-class

Helpful Things

https://merantix-momentum.com/technology/squirrel/?utm_source=pocket_mylist

https://github.com/merantix-momentum/squirrel-core?utm_source=pocket_mylist

https://pyscript.net/?utm_source=pocket_mylist

https://github.com/google-research/big_vision

https://deepsportradar.github.io/challenge.html

https://github.com/DeepSportRadar/camera-calibration-challenge

https://twitter.com/alekseykorshuk/status/1515989357961920514?utm_source=pocket_mylist

https://github.com/AlekseyKorshuk/huggingnft

John Deere's driverless tractors

https://thenextweb.com/news/john-deere-slowly-becoming-one-worlds-most-important-ai-companies

https://tractorhacking.github.io/

Links:

Merch: https://ykilcher.com/merch

TabNine Code Completion (Referral): http://bit.ly/tabnine-yannick

YouTube: https://www.youtube.com/c/yannickilcher

Twitter: https://twitter.com/ykilcher

Discord: https://discord.gg/4H8xxDF

BitChute: https://www.bitchute.com/channel/yannic-kilcher

LinkedIn: https://www.linkedin.com/in/ykilcher

BiliBili: https://space.bilibili.com/2017636191

If you want to support me, the best thing to do is to share out the content :)