top | item 9197834

Working with Apache Spark: Highlights from projects built in three weeks

24 points| ddrum001 | 11 years ago |insightdataengineering.com | reply

6 comments

order
[+] sampathweb|11 years ago|reply
Really Nice set of projects. Would have also like to see a starter application with a mini tutorial on how someone can experiment with some of these technologies.

Github references on these projects would also have been useful. Thanks for sharing.

[+] phaefele|11 years ago|reply
Did you consider Summingbird? Seems like a lot of what you are doing might have been simplified by using Summingbird rather than building separate speed and batch layers in Hadoop / Spark.
[+] ddrum001|11 years ago|reply
That's a great point for our next session - Summingbird would be perfect for everyone trying to implement Lambda Architecture without having to produce separate code for streaming and batch.
[+] PedroSena|11 years ago|reply
Is the code available somewhere ? I'd love to see the one related to fantasy sports
[+] xbeta|11 years ago|reply
Would love to try this! Thanks for sharing !
[+] shamino|11 years ago|reply
Thanks for sharing! This is awesome!!