qazpot's comments

qazpot | 3 years ago | on: Flow-Based Programming, a way for AI and humans to develop together

I think you are taking a very major assumption that LLMs are deterministic infact they are exactly opposite. They are probabilistic systems.

- They do not transpile Rough English to Deterministic English. Infact they do not do any transpiling at all.

- LLMs learn the probabilities of words in the dataset for all contexts from that dataset (context is a ordered set of words). This is called training.

- Once training is done, LLMs can generate text given a prompt and the probabilities that it has learned. The analogy of LLMs being auto-complete on steroids is very apt.

- Whether the text generated by LLMs is factual or not is purely coincidental.

I would highly recommend watching and working though the code (if possible) of NanoGPT by Andrej Karpathy. https://www.youtube.com/watch?v=kCc8FmEb1nY

A lot of things which seem like magic about LLMs will get demystified.

Now one can argue that LLMs are showing human like reasoning/intelligence/sentience as an emergent behavior. This is hard to argue against because all these terms are extremely hard to define.

IMO, the only emergent behavior that LLMs are showing is the output they generate looks like it might have been generated by a human which should not be surprising given that LLMs like ChatGPT has trained on a large amount of human written text available on internet.

qazpot | 3 years ago | on: Anyone else witnessing a panic inside NLP orgs of big tech companies?

> won't take everyone's job, it will just open up new areas for new jobs.

This was true for Industrial Automation when machines automated physical work and humans could do knowledge work.

Now machines are on the verge of automating knowledge there would be no work left for humans.

qazpot | 3 years ago | on: How to Advance in Your Career as an IC

This article could have been two bullet points.

1. Read the book Staff Engineer: Leadership Beyond the Management Track by Will Larson and identify which archetype you are - Tech Lead, Solver, Architect, The Right Hand (Details are in the book)

2. Find an organization which has the career track for your chosen archetype, find a mentor who has gone through that path.

qazpot | 3 years ago | on: Natives in Tech asks Apache Software Foundation to change name

Just leaving this here

According to The Apache Software Foundation, its name was chosen "from respect for the various Native American nations collectively referred to as Apache, well-known for their superior skills in warfare strategy and their inexhaustible endurance".[15] This was in a context in which it seemed that the open internet -- based on free exchange of open source code -- appeared to be soon subjected to a kind of conquer by proprietary software vendor Microsoft; Apache co-creator Brian Behlendorf -- originator of the name -- saw his effort somewhat parallel that of Geronimo, Chief of the last of the free Apache peoples.[16][17] But it conceded that the name "also makes a cute pun on 'a patchy web server'—a server made from a series of patches".

qazpot | 3 years ago | on: Engineers should do customer support and success

IIRC wordpress does this for new hires. Everyone spends their first few months in Customer support, which is a nice middle path to the extreme you are suggesting.

This is also good for new hires as they get to a grounding on what matters (customer experience).

qazpot | 3 years ago | on: Sound

This is awesome, reminds me of some of Bret Victor's work.

qazpot | 3 years ago | on: My black body story (it's physics)

One of the many reason's I like Apostol's Calculus book is that it starts with integration first and then diffrentiation which is how the field developed historically.

qazpot | 3 years ago | on: Apple becomes first tech giant to explicitly ban caste discrimination

You can not have any arbitrary surname because each surname belong to a caste. So if you take a higher caste surname then you will have to pretend like you belong to higher caste.

Also there are other factors which can tell which caste you actually belong to.

Your birthplace. Your parent's birthplace. Which part of the city you were born in. The accent you speak your mother tongue in.

These are benign questions that your indian colleague might ask or notice.

I dont think the current form in which casteism is practiced in India is related to profession.

Right now in India, lower caste people are mostly free to pursue any profession (unless you go to rural areas).

Discrimination comes from the fact that higer caste people simply despise/hate/consider lower caste people impure or inferior.

qazpot | 3 years ago | on: Apple becomes first tech giant to explicitly ban caste discrimination

Casteism is much more worse.

You or your children or your grandchildren atleast have a chance on moving up in class in a capitalistic society like West.

In Casteist society you neither your descendants can ever leave your caste and will always face discrimination does not matter how much money you have.

qazpot | 3 years ago | on: Programming and Writing

Is there any word when programmers engage in some other activity and then realize and rationalize that the said activity has a lot common with programming.

qazpot | 3 years ago | on: The Webb Space Telescope’s profound data challenges

> Data gathered from its scientific instruments, once collected, is stored within the spacecraft’s 68-GB solid-state drive (3 percent is reserved for engineering and telemetry data)

Hope the SSD does not fail after 32768 or 40000 hours of operation.

page 2