botro's comments

botro | 1 year ago | on: My finetuned models beat OpenAI's GPT-4

Thanks for sharing this, It's well written and informative. I noticed you used 'temperature=1' in the GPT test for the example in the post. Is this best practice for a task requiring structured output? Have you tested other temperature settings? My casual understanding was that a temperature of 0 is best for these types of workloads while higher temperatures would be more effective for more 'creative' workloads.

botro | 1 year ago | on: The Lunacy of Artemis

I think if we follow your logic exactly, and make mathematically optimal decisions in every instance, leaving no space for the human spirit - we're robots anyway and may as well go to space!

botro | 1 year ago | on: GPT-4o

>"Hello, how are you?"

>"I'm stateless!"

botro | 2 years ago | on: Vision Pro Teardown – Why those fake eyes look so weird

I think between high definition VR displays, the apple watch and Stable Diffusion we have the pieces to assemble 'The Entertainment'.

Imagine if rather than clip guided diffusion of images, the noise is guided to render by pupil dilation, heart rate, skin conductivity and any other signals that indicate excitement and pleasure for a specific indivual.

What you'd see is what your heart most desires as in Andrei Tarkovsky's Stalker.

botro | 2 years ago | on: Extracting Hacker News book recommendations with the ChatGPT API

The site is http://hnlikes.com/ and on the About page I describe how it was done.

Like I mentioned it only looks for books that are linked (or videos, arxiv papers, Wikipedia etc.). I then use the link to get information from the site itself.

I calculate scores for the given link weighted by a number of metrics.

I'm sorry if I gave the impression this was fancier than it actually is.

botro | 2 years ago | on: Extracting Hacker News book recommendations with the ChatGPT API

I made a version of this using boring tech (Postgres, Django, Python) by just counting the number of times a book link (not just books, youtube videos, arxiv papers etc) is posted in Hacker News comments. I also did a bunch of calculations around the poster of the link and replies to the posted link. The reality is that boring tech does not get attention and engagement.

botro | 2 years ago | on: There is no hard takeoff

You've found a 'Traith'. Someone asked ChatGPT a question, ChatGPT did not know the answer and hallucinated one. They post the answer to Reddit / HN / Twitter, google indexes the answer and when someone searches they find the GPT hallucination. In the next GPT training run it's incorporated into the weights.

It's an AI generated truth, a Traith.

Traith is also defined as "A fishing station or fishing ground, especially for herring" and some herring are red.

botro | 2 years ago | on: The first room-temperature ambient-pressure superconductor?

I think they also make mention of the other paper in the one being discussed, pages 12,13:

"The Additional experimental results and discussions on LK-99 will be published immediately in the next paper, including an interesting controllable levitation phenomenon and the coexistence of magnetism and superconductivity, theoretical calculation, etc."

botro | 2 years ago | on: US Congress doubles down on claims of illegal UFO retrieval programs

Would a US President have the necessary clearance to know of the existence of non-human superior technology spacecraft? A former US President is recorded on tape boasting about knowledge of US military plans to invade Iran.

I don't mean to make this political at all, just trying to reason on the basis of a personality and knowing that a president would boast about having knowledge of such trivial classified information - in comparison to the existence of non-human spacecraft; makes me believe that if he was briefed on it he likely would have boasted about it. (and so would I, just imagine what earth shaking news that is.)

page 2