vicktorium's comments

vicktorium | 2 years ago | on: Based: Simple linear attention language models

The RWVK modal was mention which is not based on transformers but on NN. [1]

The context window is particularly interesting, i have interacted with the people over discord some time ago and the model seems good but not widely used yet.

People are noticing the limitations will not shift to pure hardware -> energy now.

the transformers allows heavy parallelization but it's too computationally-intensive even with quantitization.

people are simply trying to run from the transformer is seem.

[1] https://github.com/BlinkDL/RWKV-LM

vicktorium | 2 years ago | on: Handwriting but not typewriting leads to widespread brain connectivity

i sort of specialize in meta cognition(zettelkasten, spaced repetition, incremental reading, speed reading etc)

i believe the effects of writing by hand are so maginal you would re-gain it by not having to re-type your notes. putting them into spaced repetition etc.

just make everything digital and then OCR the rest.

vicktorium | 2 years ago | on: Missile Game

this anyone knows this exact game but for keyboard/keyboard-centric?

vicktorium | 2 years ago | on: Researchers Propose $2T Plan to Transform the Shipping Industry

ok so here is an idea that i have

why don't we build a 'line' in the pacific + indian ocean and carry containers by a small floater between countries in a 'corridor', yes they would be 'explored' to salty water but i think this is not as bad ...

we could then do 'gaps' between the containers as to let other ships cross the oceans

we could increase our capacity by 10x? and adding more is just adding another 'lane'

we would only have to worry about pirates but i think we can handle that

i'm open to VC $$$

vicktorium | 2 years ago | on: Wokwi – Simulate IoT Projects in the Browser

i use this to teach children electronics, it's amazing, the only thing which is not idea is mobile support

if you're building a similar tool for browser-simulation please, pleaaaaaaase:

do not require me to have an account to enter to simulate, this reduces friction 100000x

i work with children

trust me

vicktorium | 2 years ago | on: A supply chain attack on PyTorch

very interesting

i wonder about the over-dependence on third party packages and modules

imagine the author of 'is-odd' injects a trojan there

what are you gonna do?

C has this solved but 'vendoring' is not as fast as this approach

vicktorium | 2 years ago | on: Ask HN: Who is looking for a cofounder?

i'm working on a coordination/knowledge management platforms. basically github for everyone.

for now i'm still building the primitives like spaced repetition, calendar, reminders etc.

imagine if zettelkasten took advantaged of: hypertext, web components, URL state, incremental reading, spaced repetition.

transforming itself into a 'digital collective second superbrain'

/\_/\

( o.o )

> ^ <

contact me at: adm [at] noite.ink for more

vicktorium | 2 years ago | on: I cut GTA Online loading times by 70% (2021)

i read this article when it happened some time ago

this really makes me think:

if this obvious flaw exists ... imagine what other, more complicated and opaque mistakes exists and we're not aware of it ...

just food for thought

page 1