chanchar's comments

chanchar | 1 year ago | on: What We Learned from a Year of Building with LLMs

> Just have the CoT as a field in the schema too.

Love the idea of adding CoT as a field in the expected structured output as it also makes it easier from a UX perspective to show/hide internal vs external outputs.

> Structuring your inputs with XML is very good. Even if you're trying to get JSON output, XML input seems to work better. (Haven't extensively tested this because eval is hard).

Would be neat to see LLM-specific adapters that can be used to swap out different formats within the prompt.

chanchar | 4 years ago | on: GraphQL at PayPal: An Adoption Story

I read this as user & profile are two separate resources. With a standard REST API, calls are tied to a specific resource.

> Nothing stops you building another layer of endpoints to service your frontend.

They could've added a new endpoint for that specific usecase but I'm assuming they've simplified their actual needs to this one example.

chanchar | 6 years ago | on: Fractional Shares

Here's hoping this prompts Schwab to do the same. They've already made a public statement saying it would be in the works.

chanchar | 6 years ago | on: Google I/O Developer Keynote [video]

I think they still have the advantage of improving the base models ahead of anyone else. The fitting part I assume is tailoring an existing model to a specific user on device. They can improve the base model and have the competitive advantage by being first to market with ever improved model.
page 1