I used to think first-order methods (FOM) were mostly just warm-up materials. But after sitting through Professor Ye’s lightning-fast 3-hour tour of the topic… FOM are probably the best! I can’t do a full overview of FOMs here. Here are some takeaways from the lecture: a few highlights that are surprisingly insightful and fun so worth pausing over. We’ll skip zero-order methods. Sure, you can do bisection (aka binary search) if you assume strong structure on the objective function....

Jony Ive has really good taste. Now, will OpenAI also have good taste? (Basicallly, Jony Ive was in charge of Apple’s design—iPhone4S, Apple Watch, iPad, Macbook—the crazily trendy minimalistic silver look. He created and led this omnipresent minimalist fashion that influenced and infiltrated into EVERYTHING.) And now Jony Ive teams up with OpenAI. The news is all over the internet. Interestingly it somewhat looks like a planned marketing campaign. When I searched “Jony Ive San Altman” on Google, an ads pop up:...

OMG. USC, UCLA team up for the world’s first-in-human bladder transplant Keck Medicine of USC. https://news.keckmedicine.org/usc-ucla-team-up-for-the-worlds-first-in-human-bladder-transplant/ Dr Inderbri Gill from USC and Nima Nassiri from UCLA—jointly completed a bladder transplantation surgery to a patient who has been on dialysis for seven years. He lost the majority of his bladder during surgery to resect cancer over five years ago, leaving the remainder of his bladder too small and compromised to function appropriately....

My advisor calls it a classic first-world problem… But if a beautifully written article can uncork curiosity in wine lovers and get them swirling the issue of climate change around their minds — isn’t that progress, one pour at a time? Lara Williams from bloomberg has this excellent opinion article about climate change affecting Champagne quality: Is Champagne’s Bubble About to Burst? TL;DR: warming temperatures makes grapes to ripe ealier and aggregates more sugar....

Hedwig’s Theme is a leitmotif composed by John Williams for the film adaptation of Harry Potter and the Philosopher’s Stone. While not exclusively written for the character, it is better known for being the main theme of every Harry Potter film and is iconic for the wizarding world in general. (Harry Potter Wiki) John Williams with the Berliner Philharmoniker in 2022, recorded by Deutsche Grammonphon Check out the Hedwig’s theme below:...

(Recall previously when we wrote about the Sweetener philosophy): it’s kind of about bringing light to a situation or to someone’s life or somebody else brings light to your life, “sweetening the situation” —Ariana Grande Lately, I’ve been revisiting Harry Potter and the Prisoner of Azkaban. There’s one particular quote in the movie that resonates deeply: Albus Dumbledore Happiness can be found even in the darkest of times, if one only remembers to turn on the light...

I just detached from the whirlwind of a conference submission—a rush both exciting and just a bit traumatizing. Guess a dose of rest and nostalgia wouldn’t hurt. I was a very professional Harry Potter fan around age 14. A few years later then, I declared the whole wizarding world boring and moved on. But rewatching it now—especially Azkaban—I’ve come to appreciate the profound artistry hidden in plain sight. Turns out, I just didn’t notice before....

It’s graduation season. Here are some lovely pictures.

If you need to run a bunch of jobs like python main.py -config X, and You have too many configs: X = A, B, C. Say you wanna run python f.py --config A.json python f.py --config B.json python f.py --config C.json ... You don’t want to overload your computer (if you dispatch all python run jobs all at once it will break) You don’t want to bother with job schedulers (like slurm)...

Professor Yinyu Ye is currently giving a lecture series on Optimization Methods for Data Science, Machine Learning, and AI at the Shanghai Institute for Mathematical and Interdisciplinary Sciences (SIMIS). This week’s lecture—part two of the series—is focused on duality. Lecture videos and course materials are available here: https://www.simis.cn/optimization-methods-for-data-science-and-machine-learning-and-ai/ The class style is really “minimalistic examples for profound insights.” There’s a similar phrase often used in China: 大道至简 (The greatest truths are the simplest)....