nmitchko's comments

nmitchko | 5 months ago | on: Qwen3-Omni: Native Omni AI model for text, image and video

Next steps for AI in general:

  - additional modalities
  - Faster FPS (inferences per second)
  - Reaction time tuning (latency vs quality tradeoff) for visual and audio inputs/outputs
  - built-in planning modules in the architecture (think premotor frontal lobe)
  - time awareness during inference (towards an always inferring / always learning architecture)

nmitchko | 1 year ago | on: LLMD: A Large Language Model for Interpreting Longitudinal Medical Records

No other models that are public worth comparing to... Hippocratic advertises good benchmarks but that might be marketing fluff.

Have you checked out dataset building with nemotron? The nemotron synthetic data builder is quite powerful.

Moreso, check out model merging. It's possible if you merge some of your model against llama3.1 base it may perform much better.

Check out max labonne's work on hugging face

nmitchko | 1 year ago | on: Show HN: We built pitchpilot, an AI synthesizer to tailor presentations

We're excited to share pitchpilot with the HN community. Our beta users have found the embedded audio particularly useful for enterprise sharing. We're keen to keep improving, and our mission is to make communication easier.

In the roadmap is adding video export, digital twin presentations, and real-time presentations. We don't wrap a public LLM, so we don't share any data.

nmitchko | 1 year ago | on: Superfast Microsoft AI is first to predict air pollution for the whole world

Tin-foil hat time:

1. First, models will predict pollution. The outcomes will help shape urban policy. But these won't solve crime or stop people from driving.

2. Second, models will predict individual behavior and track person level emissions. The outcomes will force behavior changes, mostly freedom limiting.

3. Third, and finally, models will predict thoughts. The the thought of driving instead of walking might trigger a response.

It's a slippery slope and we need to draw a line between prediction and policy.

nmitchko | 1 year ago | on: Qwen1.5-110B

It truly feels like the space race in terms of building LLMs right now. Question is, who lands on the moon first?

nmitchko | 2 years ago | on: Debunking NIST's calculation of the Kyber-512 security level

Unfortunately, the NSA & NIST most likely is recommending a quantum-proof security that they've developed cryptanalysis against, either through high q-bit proprietary technology or specialized de-latticing algorithms .

The NSA is very good at math, so I'm be thoroughly surprised if this analysis was error by mistake rather than error through intent.

nmitchko | 2 years ago | on: A simple guide to fine-tuning Llama 2

For each step in the article:

1. You should really download the huggingface hosted model.

2. Why convert the model if meta already hosts it here: https://huggingface.co/meta-llama

3. This step completely glossed over the hardware requirements. Doesn't explain any of the instructions needed in the finetuning process.

4. "Now run the model". What? What about the model precision, hosting, standard open source tools, etc,etc...

nmitchko | 2 years ago | on: Estimated IQ distribution of children given IQ of parents

Interesting that we ignore the physical environment as a contributing factor in IQ, growth, and development. For example:

* Iodine supplementation during early life (a few weeks) increases IQ * Organophosphate exposure increases autism (also why people who live near airports have higher incidence of cancer) * Phalates and non-sticks reduce male reproductive organ size * Music lessons in children increases IQ. * L-arginine during childhood increases height and free growth hormone

https://link.springer.com/article/10.1007/s11154-022-09760-7 https://www.sciencedirect.com/science/article/abs/pii/S01602... https://www.researchgate.net/publication/237236129_The_Plane...

page 1