lliiffee's comments

lliiffee | 9 years ago | on: Planet Money: Self Checkout [audio]

Note that the machines have many tolerances that can be set to trade-off theft vs. annoyance of the customer. (E.g. the product weight when placed in the bagging area.) The machines can we way less annoying when they are set to be more trusting.

I also generally found them to work better in Australia than in the US, though the technology seems to be the same. I guess it's because of these tolerances being set differently, but that's just speculation.

lliiffee | 9 years ago | on: “The Depressed Person” by David Foster Wallace (1998) [pdf]

It's a massive book, but it really is very entertaining as well. Give the first chapter a go, and if you're totally sucked in and laughing, you might be just glad that the book is as big as it is. If you aren't enjoying it on a page-by-page basis, it's probably almost impossible to power through. It's one of my favorite books, but it doesn't contain the meaning of life, or anything.

lliiffee | 9 years ago | on: How Google obliterated my 4 year old Chrome extension featuring 24k+ users

That's a good point, but it also seems strongly correlated with those that run ad/privacy blockers. (Even with such a blocker, perhaps the data collected is still valuable, though?) My instinct is that by selling an ad and tracking-free site, they would be indicating that the ads and tracking are a bad thing, as opposed to the party line that it's all "to deliver better services to you".

lliiffee | 11 years ago | on: Numerical Optimization: Understanding L-BFGS

What I mean is that, if just doing regular Newton, I'm not sure I've ever seen an example using the interface you show. I think that the vast majority of Newton's method implementations pass H rather than H^-1, and get the search direction via "solve_H_g(H,g)" rather than "solve_iH_g(iH,g)". It takes cubic time to compute H^-1 from H (after which you can compute (H^-1)g) and it takes cubic time to solve for x such that H*x=g, but the rather is said to be more stable, and so preferred.

I know this is irrelevant to the main part of the post, which is to explain LBFGS, I'm just genuinely interested if there are applications where its better to pass the inverse of H rather than H itself for some reason.

lliiffee | 11 years ago | on: Numerical Optimization: Understanding L-BFGS

Is it typical to interface to Newton's method via a function that computes the inverse Hessian? I've never seen that. Typically, people claim it is numerically unstable to explicitly invert the Hessian, and that it would be better for the interface to take the Hessian itself, and then call a subroutine to do a linear solve.

lliiffee | 12 years ago | on: Flappy Bird Typing Tutor

Doesn't seem to work in firefox? (The search bar keeps getting activated.) I think I have the "automatically search on typing" option selected though.

lliiffee | 12 years ago | on: Machine learning is easier than it looks

Great questions! I can answer a few of them.

- Yes, you can get stick in a local maximum. However, see the k-means++ algorithm for a clever initialization scheme that gets you within a good constant factor of the global maximum.

- The best way to pick K is to fit the algorithm with a range of K and see which K seems to give the best application performance.

- It is "your job" in creating the feature space to ensure that feature-space nearness corresponds to application-space nearness. This is not easy at all, and essentially the only reliable test if you've done a good job is if the final algorithm performs as you'd like it to.

I think that the post is really observing that, once you understand it, ML algorithms aren't really that complex. However, once you understand it, most things aren't that complex, and that doesn't make fully understanding them easy in the first place.

lliiffee | 12 years ago | on: New US $100 bill to debut Tuesday

I have to disagree. The potential downside for a flaw in the new bill could be rather catastrophic damage to the economy. The downside of a failure with the Mars rover is that the rover just doesn't work. Thus, it makes sense to be dramatically more conservative in designing a new currency.

lliiffee | 12 years ago | on: The fate of published peer-reviewed articles, submitted again (1982)

There are lots of things you might consider, that would be impossible with snail mail. For example, the reviewers might be able to send regular emails with questions to the authors, or the authors might be able to constantly update the paper in response to initial reviewer comments, there could be an anonymous "chat room" of some kind, etc. Not sure if any of these are good ideas, but I think it is a fair point that most journals simply use the internet as a "faster snail mail".

That said, I review for conferences that are taking advantage of the internet, with author response to reviewer comments, discussions among the reviewers, etc.

page 2