I could never find anything actionable in NewRelic. Seems like interesting data, but nothing I could optimize for. Skylight has identified slow performing areas where we've worked on and watched a downward trend.
Note to the Skylight marketing team: I had never heard of your service in 10 years of using Rails, even if it was something that could very valuable to me. But if I open the homepage what I see is:
"DO THE ANSWER DANCE". Cool looking weirdo characters dancing. Generic charts-filled dashboard screenshots. Comparatively very small text saying "learn why your app is slow".
If you hadn't been vouched by this HN thread, I would have never read below the fold to learn that you allow profiling Rails apps.
I see that the logs and analysis will be open to everyone. I guess that's equivalent to using Travis, CircleCI, etc. on their free/open tiers. But API logs and analysis like Skylight performs can have much more unpredictable and sensitive info in them than test/build logs.
Does this mean that all private fields needs be scrubbed in-app, before Skylight? For example, a hosted OSS service that includes e-mail addresses or location data in API query strings.
We work differently than other similar products, in that we rely heavily on aggregation, both for presenting useful data in the UI and also to keep our backend scalable. We don't keep around particular aspects of individual requests. Individual requests are essentially only used as "data points" to build statistical models about your app/endpoints. For example, any SQL queries are parsed and sanitized on your server before they are sent to us[1].
That probably sounds more involved than it actually is in practice – you can see it for yourself on the dashboards for The Odin Project[2] and the Homebrew formula browser[3]. The bottom line is that there is no way to get from the aggregated data back to an individual request.
As a further historical note that may interest HN users specifically, Skylight was the world's first production user of Rust (the Ruby gem they ship is written in it), dating back to well before Rust was even stable.
Dangeranger|8 years ago
[0] https://www.rust-lang.org/pdfs/Rust-Tilde-Whitepaper.pdf
sergiotapia|8 years ago
1. What's slow.
2. What's hit frequently.
This combined gives their "agony" ranking for you to fix problems that impact the most. In a very clean UI!
Terrific product. I wish I had Skylight for my Phoenix/Elixir stack.
artellectual|8 years ago
It also supports, profiling background jobs.
igravious|8 years ago
ksylvest|8 years ago
wasd|8 years ago
[1]: https://twitter.com/sunnyrjuneja/status/951973556170215424
snowpalmer|8 years ago
danmaz74|8 years ago
"DO THE ANSWER DANCE". Cool looking weirdo characters dancing. Generic charts-filled dashboard screenshots. Comparatively very small text saying "learn why your app is slow".
If you hadn't been vouched by this HN thread, I would have never read below the fold to learn that you allow profiling Rails apps.
drewda|8 years ago
Does this mean that all private fields needs be scrubbed in-app, before Skylight? For example, a hosted OSS service that includes e-mail addresses or location data in API query strings.
wycats|8 years ago
We work differently than other similar products, in that we rely heavily on aggregation, both for presenting useful data in the UI and also to keep our backend scalable. We don't keep around particular aspects of individual requests. Individual requests are essentially only used as "data points" to build statistical models about your app/endpoints. For example, any SQL queries are parsed and sanitized on your server before they are sent to us[1].
That probably sounds more involved than it actually is in practice – you can see it for yourself on the dashboards for The Odin Project[2] and the Homebrew formula browser[3]. The bottom line is that there is no way to get from the aggregated data back to an individual request.
[1] https://www.skylight.io/support/faqs#security
[2] https://oss.skylight.io/app/applications/g0gJSNnzYAws/recent...
[3] https://oss.skylight.io/app/applications/jut3BrkJo722/recent...
FanaHOVA|8 years ago
avtar|8 years ago
wycats|8 years ago
https://www.skylight.io/support/advanced-setup
We should probably update our copy to clarify this point in the prominent places where it isn't already clear.
kibwen|8 years ago
Cyberdog|8 years ago
Product blog operators, please see: https://news.ycombinator.com/item?id=16278142
dang|8 years ago