BrianMingus | 8 years ago | on: Y Combinator applicant/candidate hilariously seeking CTO on Craigslist
BrianMingus's comments
BrianMingus | 8 years ago | on: Nonlinear Computation in Deep Linear Networks
Exact solutions to the nonlinear dynamics of learning in deep linear neural networks
https://arxiv.org/abs/1312.6120
"We attempt to bridge the gap between the theory and practice of deep learning by systematically analyzing learning dynamics for the restricted case of deep linear neural networks. Despite the linearity of their input-output map, such networks have nonlinear gradient descent dynamics on weights that change with the addition of each new hidden layer. We show that deep linear networks exhibit nonlinear learning phenomena similar to those seen in simulations of nonlinear networks, including long plateaus followed by rapid transitions to lower error solutions, and faster convergence from greedy unsupervised pretraining initial conditions than from random initial conditions."
Nonlinear Computation in Deep Linear Networks
https://blog.openai.com/nonlinear-computation-in-linear-netw...
"Neural networks consist of stacks of a linear layer followed by a nonlinearity like tanh or rectified linear unit. Without the nonlinearity, consecutive linear layers would be in theory mathematically equivalent to a single linear layer. So it’s a surprise that floating point arithmetic is nonlinear enough to yield trainable deep networks."
BrianMingus | 8 years ago | on: Deeplearning.ai: Announcing New Deep Learning Courses on Coursera
BrianMingus | 8 years ago | on: Deeplearning.ai: Announcing New Deep Learning Courses on Coursera
BrianMingus | 8 years ago | on: Deeplearning.ai: Announcing New Deep Learning Courses on Coursera
BrianMingus | 8 years ago | on: Ask HN: Who is hiring? (August 2017)
BrianMingus | 8 years ago | on: Ask HN: Who is hiring? (August 2017)
BrianMingus | 8 years ago | on: Ask HN: Who is hiring? (August 2017)
BrianMingus | 8 years ago | on: Comparison of Neural Network Simulators
BrianMingus | 8 years ago | on: Comparison of Neural Network Simulators
Also - a lot of work went into this!
BrianMingus | 8 years ago | on: Deep Learning for Coders – Launching Deep Learning Part 2
BrianMingus | 8 years ago | on: Deep Learning for Coders – Launching Deep Learning Part 2
BrianMingus | 8 years ago | on: Show HN: AI Grant – Non-profit, distributed AI research lab
BrianMingus | 8 years ago | on: Psychology of Intelligence Analysis (1999)
The Neural Basis of Decision-Making During Sensemaking: Implications for Human-System Interaction
https://www.researchgate.net/publication/278679336_The_Neura...
BrianMingus | 8 years ago | on: Show HN: AI Grant – Non-profit, distributed AI research lab
BrianMingus | 8 years ago | on: Show HN: AI Grant – Non-profit, distributed AI research lab
BrianMingus | 8 years ago | on: Show HN: AI Grant – Non-profit, distributed AI research lab
Latently, Bitfusion, and IBM Cloud enable democratized access to deep learning
https://www.ibm.com/blogs/bluemix/2017/07/latently-bitfusion...
BrianMingus | 8 years ago | on: Show HN: AI Grant – Non-profit, distributed AI research lab
https://github.com/Latently/DeepLearningCertificate
Free access to ridiculous amounts of hardware and the opportunity to implement important and hot scientific papers and conduct original research in deep learning.