shirkey's comments

shirkey | 3 years ago | on: You probably shouldn't use OpenAI's embeddings

Please do and thanks in advance for any insights you can provide -- it would be great to understand any benchmarking improvement with ada-002 from your previous findings, and whether you tested the specific OpenAI text-search-*-{query,doc} models as a comparison for large document search.

shirkey | 10 years ago | on: Did Times Underplay Drone Program Leak?

"Ten thousand might be fine if it meant saving Afghanistan from Taliban rule, as long as that as low as coalition forces could keep civilian deaths."

The same thinking could then be applied to our "war or drugs" -- the killing of several thousand innocent Colombians could be easily justified in order to eradicate the cartels, albeit temporarily.

Do you find that a satisfactory trade-off as well?

shirkey | 11 years ago | on: The Economy Got Off to a Historically Bad Start in 2014

The data provided in my link shows 4-6% average, I was referring to the most recent spike in real inflation that is not showing up in the BLS data. At the lower end, you'd have 48% price growth compounded annually over that 10 year period, at the higher end is 79%, so not sure why you extrapolated that at 7% over ten years.

shirkey | 12 years ago | on: Open Football Data

Agreed -- looking at the player data[1], IMO the format type is unrecognizable:

  ## GK / Goalkeepers

  Kawashima|Eiji Kawashima,   20 Mar 1983
  Nishikawa|Shusaku Nishikawa,   18 Jun 1986
  Gonda|Shūichi Gonda,   3 Mar 1989

  ## DF / Defenders

  Inoha|Masahiko Inoha,   28 Aug 1985
  G. Sakai|Gōtoku Sakai,   14 Mar 1991
  Nagatomo|Yuto Nagatomo,   12 Sep 1986
  Uchida|Atsuto Uchida,   27 Mar 1988
  Konno|Yasuyuki Konno,   25 Jan 1983
  Kurihara|Yuzo Kurihara,   18 Sep 1983
  H. Sakai|Hiroki Sakai,   12 Apr 1990
  Yoshida|Maya Yoshida,   24 Aug 1988
  Masato Morishige,      21 May 1987   ## Japan F.C. Tokyo
Comments as a double-hash, key fields are either player last name or occasionally first initial-space-last name, then three different delimiters of pipe, then comma, then tab. Choosing either a consistently delimited format or a more verbose JSON/YAML structure with clear metadata would seem to be a better approach.

[1] https://github.com/openfootball/players/blob/master/asia/jp-...

shirkey | 12 years ago | on: I worked on the US drone program. The public should know what really goes on

If you think that the concern about DEA and SWAT can be easily dismissed, consider that SWAT teams regularly get involved in serving warrants for non-violent crimes -- in 1995, 3 out of 4 SWAT raids were based on drug warrants alone... and mistakes on those warrants can be made repeatedly:

"Perhaps no one was more victimized by the battlefield mentality that had set in at the NYPD than Walter and Rose Martin. The Brooklyn couple, both in their eighties, were wrongly raided more than fifty times between 2002 and 2010. The couple filed numerous complaints with the police department. They wrote letters to Mayor Michael Bloomberg and NYPD commissioner Ray Kelly. They were ignored. In 2007 they at least got someone at the NYPD to try to wipe their address out of the department’s computer system. But the raids continued. It wasn’t until the couple went to the media in 2010 that the city finally looked into the problem. Back in 2002, someone had used the Martins’ address as a dummy address to test the department’s new computer system. When the new system was implemented, no one removed their address. So anytime NYPD cops in certain precincts used the system for a warrant and forgot to remove the dummy address to put in the correct one, the police would end up at the Martins’ door."[1]

[1] http://www.amazon.com/Rise-Warrior-Cop-Militarization-Americ...

shirkey | 12 years ago | on: BBM Available for Android and iPhone

> Message can intelligently switch between Apple's own backend and SMS depending on data connection and presence information

I'm not familiar with the Apple implementation, but something similar was implemented by the Yahoo Messenger client app running on my Windows Mobile several years back, seamlessly switching from Internet data connection to SMS -- resulting in an SMS for every single outbound message and a bill of around $300 from AT&T for all those "OK" and "Sure" messages.

page 1