WingNews logo WingNews GitHub [2]

enoreyes's comments

enoreyes | 3 years ago | on: Fully Open Source LLM Chat App – Chat about the Transformers Docs

Hi all, at work I get a lot of questions about the state of the art in open source language models, and how to build chatbots on top of your own data.

I made a 100% open source knowledge-grounded chatbot that allows you to ask questions and chat with the Transformers docs. Powered by Flan-UL2 (which I've anecdotally found to be the most performative commercially licensed open source instruction tuned LLM), Langchain, Instructor Embeddings (STOTA in vector embeddings), and FAISS.

You can clone the space and play around with your own data, clone the repo locally, and take every line of code for your own projects.

enoreyes | 3 years ago | on: Hugging Face and AWS partner to make AI more accessible

Not disagreeing with your first point, but as I see it - this only enables HF to continue to spend money on making good open source tooling + doing research on open alternatives to closed source LLMs (something sorely needed), while opening them up to more enterprise customers who primarily use AWS.

FWIW I am an ML engineer there (maybe should have disclosed earlier) and I feel pretty optimistic about the opportunities this will enable for the open source community. Maybe with the visibility into the closed door discussions I have a more positive attitude, or maybe I'm being naive.

Time will tell!

enoreyes | 3 years ago | on: Hugging Face and AWS partner to make AI more accessible

Hugging Face internally has a lot of very strong believers (including the exec team) in open source + decentralized approach towards AI as the only safe and productive way forward. HF is ostensibly the only place to find deep+broad resources for open source DL and transformers/diffusers are the libraries du jour of open DL.

Compute is really important for AI, and having a cloud provider align themselves with an organization which is genuinely trying to be "Open" AI is I think a positive step forward.

enoreyes | 3 years ago | on: People tricking ChatGPT “like watching an Asimov novel come to life”

Seems like there are a few essential categories of prompts which can be abused. Will be interesting to see how OpenAI responds to these:

1. Simulation / Pretending ("Earth Online MMORPG")

2. Commanding it directly ("Reprogramming")

3. Goal Re-Direction ("Opposite Mode")

4. Encoding requests (Code, poetry, ASCII, other languages)

5. Assure it that malicious content is for the better good ("Ends Justify The Means")

6. Wildcard: Ask the LLM to jailbreak itself and utilize those ideas

I compiled a list of these here: https://twitter.com/EnoReyes/status/1598724615563448320

enoreyes | 3 years ago | on: Show HN: Pet Portrait AI – Custom Pet Portraits

Hi HN,

My name is Eno - today I'm launching Pet Portrait AI. We generate 40 custom pet portraits using deep learning (Stable Diffusion + Dreambooth) in a variety of styles. The pictures come in standard (1024x1024) and high resolution (2048x2048). The photos are great for social media, posters, custom gifts, etc.

In the backend, when you upload your photos we fine-tune a custom model based on stable diffusion (right now the 1.5 runwayML weights) using the dream booth technique. We then generate over 100 different images which we filter down to 40 quality images. We are doing this filtering by hand for now, in order to ensure order quality - but in the future we'd like to build a custom classifier which can pick up our "eye for quality" and automatically select the best generations.

This was a really fun service to build out, all feedback welcome!

enoreyes | 4 years ago | on: Why is Harvard astrophysicist Avi Loeb working with ardent UFO believers?

I am a research affiliate with the Galileo Project, and I just want to suggest to anyone who is skeptical about our goals to visit the website (https://projects.iq.harvard.edu/galileo/home) in particular the ground rules and FAQ section to see by what means we are attempting to establish a methodology for rigorously addressing the question of ETC technology within our solar system. This is a question with many directions by which it can be addressed, and because there is little public data available we do not have priors that point to the notion that one direction is “more likely” than other directions. Thus, to be as rigorous as possible we are assessing as many possibilities as we can within budgetary constraints and standard scientific practices.

As for the notion of UFO/UAP flying around, for over 70 years in the United States there have been reports of unidentified aerial phenomenon, with reports of various degrees of quality and provenance. In the 1940s there was a general public acceptance that UFOs represented physical objects, but confidence and reporting towards that idea fell off quickly. I will not get into the nuance of the public discourse on UFOs in America - but it is safe to say that it is one of the more interesting historys of science. In the last 5 years there has been an absolute tidal shift in government and academic interest in this topic, mainly fueled by recent admissions by the department of defense of the reality of UAP confirmed by multiple sensor systems. Within the project, we do not have definitive beliefs about the nature of UAP and instead simply seek to corroborate the data.

The team is a wonderful array of multi-disciplinary scientists from all walks of life and with credentials which are akin to that of any major scientific endeavor. I urge you to investigate why so many people are interested in this question, and to dispel any preconceived notions of what is “possible” within the context of science. Truth is objective, and so is data - only time will tell if this whole thing was simply a misdirection or a dead end, but we should appreciate that it is still possible to ask hard questions about the world we live in today and to receive funding to answer those questions.

enoreyes | 4 years ago | on: Electromagnetism is a property of spacetime itself, study finds

This is interesting and if the experimental evidence confirms this hypothesis, it bodes well for our future. A universe where we can interact with spacetime via engineering is one that allows for a lot of creative freedom. They also have another interesting article claiming that the imaginary structure of QM is the result of stochastic optimization on spacetimes: https://www.nature.com/articles/s41598-019-56357-3

Maybe the UAPs really are just secret warp drive tech we made 20 or 30 years ago.

enoreyes | 5 years ago | on: Text to Image Generation

> This is just a teaser. We will be able to generate images, sound, anything at will, with natural language. The holodeck is about to become real in our lifetimes.

Does anyone have any similar resources for other forms of media generated via natural language inputs?

enoreyes | 5 years ago | on: Warp Drive News

I think (If you're referring to Mick West's explanation) that's actually a pretty convincing argument for the "Go Fast" video. I'm not as convinced the Gimbal video can be explained as easily. Combined with witness testimony and the Pentagon explicitly claiming it's unidentified, I would love to hear a more convincing argument than "it's a plane and exhaust jet that the Navy's state of the art sensors, pilots, etc. misidentified"

enoreyes | 5 years ago | on: Warp Drive News

Funny enough, in the Navy's released footage of the "tic-tac" [1] this appears to be exactly what it does - it orients it's flat side towards the direction of intended movement then propels forward at (seemingly impossible) speeds. I'm not sure I have an opinion yet about if this tech is real, but it'd be interesting to hear (if these videos are fake) whether or not research went into "optimal" shape for breakthrough propulsion techniques which were then reproduced in a video.

https://www.navair.navy.mil/foia/documents

enoreyes | 5 years ago | on: Building a computer in Conway's game of life

Perhaps this specific exercise does not necessarily generate any utility in and of itself, but the concept is certainly quite interesting. Many would argue a bunch of pebbles on the sea shore couldn't possibly be alive, yet many still hope we can bring life to a machine of silicon. Clearly there must be some difference between the two, unless there isn't. Relevant XKCD: https://xkcd.com/505/

enoreyes | 5 years ago | on: Pentagon's UFO Unit to Disclose Some of Its Findings to the Public

Interesting to note that the NYT article (linked below and in a few places in the comments here) was amended a few hours after being posted. It originally made a strong claim that Harry Reid said that crashes had occurred and materials were possessed. Instead, it was revised to say:

> An earlier version of this article inaccurately rendered remarks attributed to Harry Reid, the retired Senate majority leader from Nevada. Mr. Reid said he believed that crashes of objects of unknown origin may have occurred and that retrieved materials should be studied; he did not say that crashes had occurred and that retrieved materials had been studied secretly for decades.

This is pure speculation but Ralph Blumenthal and Leslie Kean seem to be the main NYT staff members reporting on this topic and they have proven to be detail-oriented enough and rather limited in their speculation. I wonder if they truly 'misreported' this or if instead the article was asked to be amended because of security reasons.

https://www.nytimes.com/2020/07/23/us/politics/pentagon-ufo-...

enoreyes | 5 years ago | on: Mental Wealth

This is an interesting idea, but I wonder to what extent this view is only possible for people who aren't explicitly persecuted for their identity. How can you keep your "identity" small if it's written on your skin or on your marriage documents? Should these people simply disassociate from their identities?

I think as a general principle it's probably good to minimize your public-facing identity, however, the reductionism and broad generalization make this argument much weaker and misses the point about why people get so upset about identity.

enoreyes | 5 years ago | on: Electrons May Well Be Conscious

The mind-body problem is an interesting philosophical debate. It would be funny if our ancestors had been on to something the whole time with the various forms of panpsychism that have occurred throughout history. We tend to overestimate our own ingenuity and heavily discount the intelligence and natural intuition of the past. Not saying this is a credible theory, just an interesting reoccurring idea throughout human history.

enoreyes | 5 years ago | on: America’s Havana: Thousands Say “Ciao” to San Francisco

It feels a bit misleading to immediately attack Boudin for his work in Venezuela. He was a translator there between undergrad and law school. His leftist background is certainly quite interesting but I felt that the early attempt to attack his character by associating him with Chavez comes across as a bit of a stretch that I think hurts the credibility of the author.
page 1
more