The textbook Multi-armed Bandit Allocation Indices by John Gittins, Kevin Glazebrook, Richard Weber has a charming Chapter 6, titled “Restless bandits and Lagrangian relaxation”. But the authors skipped a step in the prove of how to go from the LP to Dual and to Whittle Index Policy. Prelims: An RMAB (Restless Multi-Armed Bandit) instance is defined through the tuple $$ \lang S, A, r_{i}, \mathcal P_{i} \rang_{i \in [N]} $$ where $S_i $ is the state space, $A_i = \lbrace 0, 1 \rbrace$ the action space, $r_{i}$ and $\mathcal P_{i}$ denote the reward and transition kernels arm $i$....

Happy weekend and winter solstice—if winter comes, will spring be far behind? Old CV is archived here.

Here’s a paper I read lately, Generative Social Choice Sara Fish, Paul Gölz, David Parkes, Ariel Procaccia, Gili Rusak, Itai Shapira, and Manual Wüthrich. link to one of the authors’ posted verison. Plus, link to ICML talk version. [Abstract] The mathematical study of voting, social choice theory, has traditionally only been applicable to choices among a few predetermined alternatives, but not to open-ended decisions such as collectively selecting a textual statement....

The funny news (five years ago), original by Metro’s Basit Mahmood: Chinese businessman Tan Youhui was looking for a hitman to take out a competitor, Wei Mou, and was willing to pay 2 million yuan (£218,000) to get the job done. The hitman that Mr Youhui hired decided to offer the job to another hitman for half the original price. The second hitman then subcontracted to another hitman, who then subcontracted to a fourth, who gave the job to a fifth....

Two things that are notoriously slippery to pin down: fairness and democracy. Fairness—what is it, really? To me, fairness is just another way of thinking about efficiency. To elaborate, we often define efficiency as the sum of everyone’s value or surplus. But maybe that’s too simplistic. What if fairness is just a more complex version of that same idea? Instead of a straightforward sum, fairness might be a more intricate mapping of each participant’s value into the final outcome....

The story starts with today’s law class. For the last topic of this semester, we dove into healthcare policies—And wow, the slides are a work of art: Yes, I’m flexing on my course materials. It is titled ‘A Glimpse into U.S. Society from Supreme Court Rulings’ Healthcare in the United States used to be (and might still be) a mess (but who’s doing good, anyway?) Going to the hospital is expensive, so most people don’t pay directly out of pocket and instead have it covered by private insurance or government programs....

December 15th is the unofficial standard for PhD applications starting next fall, but of course, academia loves its quirks. Columbia Business School goes for December 16th, Carnegie Mellon wraps up by December 11th, and some elite schools close as early as December 1st. Some schools seem more relaxed, with deadlines stretching into January. Let’s be honest—I guess no one’s reading applications until after winter break anyway. Fast forward to the next big date: April 15th....

Supply chains are the unsung heroes of every industry—arguably as important as market rules, if not more so. And when it comes to China’s most popular drink, lemonade, the role of supply chains becomes even more crucial. Today’s story is of how MiXue, one of China’s most successful beverage brands, conquered the market with its mastery of supply chain innovation. MiXue dominates the low-price milk tea market in China, earning it the title of ‘Starbucks of low prices....

One of my coauthor shared this immensely inspiring advice with me: write the paper first by Jason Eisner (2010). In short: If you’re planning to submit a conference paper, I’d like to strongly suggest that you spend the next few days just writing the paper (even if you haven’t yet planned or finished the experiments). The motivations is explained from the perspective of getting computer science papers ready for submission to conferences:...

NY Times have the story It’s Ariana Grande vs. Selena Gomez at the Oscars, at Least in Fans’ Minds By Esther Zuckerman, Dec. 10, 2024 link Pop music fans are notoriously ruthless — far more so than movie lovers. Their loyalty is unwavering to the point that they take aim at anyone who dares to criticize their beloved stars… It’s not as if pop stars have never competed for movie prizes....