top | item 17849029

Rave.dj – an artificially intelligent mash-up machine

199 points| ozzmotik | 7 years ago |rave.dj | reply

94 comments

order
[+] paraschopra|7 years ago|reply
This is how well thought out products look like.

- Really simple and intuitive start. I created my first mashup within first 2 minutes and at all times knew exactly what I was doing

- Inbuilt virality. People will show off their produced mixes to their friends and on social media.

- Actually solves a pain point. How many of us have tried mixing songs and gave up? This gives a sense of creativity while taking care of all the complexity.

Even though I don't know how they'll monetize this, it seems a really well thought out product.

[+] ehsankia|7 years ago|reply
Not only that, but the small things like mashing up the song title and album art truly make this a quality product.

Here is my first try: Disclosure - Bang That + The XX - On Hold = Hold That

https://rave.dj/1F1p4ZS9ipWmYA

[+] jerrre|7 years ago|reply
> Even though I don't know how they'll monetize this, it seems a really well thought out product.

Depending on how you define product, this is a major show stopper. I'd say a product can't be called well thought out, if it doesn't have monetization thought out from the start. Although there is always advertizing, I guess..

But very nice tool/toy nonetheless!

[+] svantana|7 years ago|reply
I agree, but two major issues here:

- licensing will be difficult without a paywall, I'm pretty sure this site is "illegal"

- there is no way to keep tweaking manually to correct bad sounding parts etc, which limits usefulness

As it happens I work on a similar iphone app called Pacemaker, which solves both of these problems (using spotify login and a bunch of edit tools, respectively)

[+] wattengard|7 years ago|reply
Ok. I think I nailed the perfect one: https://rave.dj/ySGzN-0svLlPpA
[+] sbarre|7 years ago|reply
Wow, I have to say I'm kind of amazed this mashup was generated and not hand-crafted..
[+] cookiefonster|7 years ago|reply
This one sounds pretty good wow. But Space Jam is hard to mess up to be fair.
[+] linsomniac|7 years ago|reply
I guess the audio mix is good... The video was using 90% of my processing power, what in the world was going on there?
[+] wc_cs|7 years ago|reply
definitely. bravo.
[+] citation_please|7 years ago|reply
At great risk of sounding haughty, as someone who's perhaps a bit more into the DJing scene than what's probably the average HN user, all of these sound horrible. Beat matching is the easiest part of DJing, and that's about all that this tool does, so I don't think it's solving any DJing problems specifically.

One thing that it does do is take away the turntable GUI (or hardware) and replace it with a two-field upload form, radically reducing the amount of know-how required to perform beat-matching. That's just really scratching the surface of what a lot of "live" DJs do (as they're called these days), as many are bringing instruments like drums and saxophones (see Big Gigantic[1]), keyboards and vocoders (see Lorenz Rhode[2]), their voice (see Gallago[3]), and traditional African drums (see Black Motion[4]), let alone simple song selection and set progression - "reading the crowd".

[1] https://www.youtube.com/watch?v=TkxMjfYOE-g

[2] https://www.youtube.com/watch?v=vwf2uvWlL_c

[3] https://www.youtube.com/watch?v=wmCFPjwlxIU

[4] https://www.youtube.com/watch?v=zHEc9uA2Zmw

When the tool comes along that can style-transfer two songs in the same way that it can for images, then I will admit that AI is on the verge of taking our music-creating/music-playing jobs. But for now, I'm satisfied that there's a bit more to the depth of DJing than that what an AI can learn.

[+] ArmelC|7 years ago|reply
Hey, I'm one of the devs at Rave.

I posted some general responses here: https://news.ycombinator.com/item?id=17852736

We're aiming to make the process as simple as possible, so anyone can make mashups/mixes, and will add on customizations over time. Our focus first and foremost will be to make sure that the core process is solid before we add on to it.

Our AI does do more than beatmatching as well. Though a lot of that is going to be more evident in our mix AI, which we've been focusing on recently.

[+] tomphoolery|7 years ago|reply
Agreed! I'm in a band called The Wonder Bars[1], and we play house music live with real instruments, but we also include drum machines. We're very far from computers being able to improvise (well), and 4-5 humans playing live instruments is just a crowd-captivating visual. Along with Agent Zero[2], Worldtown Soundsystem[3], and several other bands in the Philadelphia area, we make up a vibrant "live electronic" scene united by the way we make music, not by the genres of music that we particularly choose to write and play.

We're also DJs/producers, and as a DJ, I somewhat disagree with AI ever taking our music-creating jobs. Perhaps playing music will be somewhat more automated in the future, but history shows that creating music will just become more complex and more interesting as we continue forward. Think about it: There are still _professional_ drummers out there, people just paid to drum, when drum machines exist. There are entire orchestras that are paid almost the same salary as developers, yet the Vienna Symphonic Library lets a single person on a keyboard play an entire orchestra's score. The truth is, compositions have classically exploited the modern technology of the day to their own advantage, and I don't see that stopping anytime soon. I can even imagine a world where the independent singer/songwriter suddenly becomes more capable than ever, with AI allowing them to orchestrate entire film scores by just playing a piano or a guitar into their computer. But I don't see the creative aspect of music dying just because we built a machine to organize some stuff better for us.

[1]: https://open.spotify.com/artist/2nrkwnQWEqM20n92QC7Cdy [2]: https://www.facebook.com/agentzeromusic [3]: http://world.town

[+] wavefunction|7 years ago|reply
It would be pretty trivial to add key-matching to this thing but like you say that wouldn't come close to everything a good dj or live band is doing during a performance with an audience.
[+] thanatropism|7 years ago|reply
So I tried to mix two guitar-heavy songs that were bound to be incompatible and the results are kind of okay. Only one has vocals and it comes out way out of tune, but the general development of the songs fits well. It somewhat feels that this has more to do with the predictable sequence of verse/chorus/verse bars in pop music. But eh.

The video is pretty good too:

https://rave.dj/dBgxMMEtR9j-nw

----

Edit: Here's an example of an utter failure that illustrates my hypothesis: it mixes a song that has a traditional verse/chorus/verse structure with a techno track that's a monotonic crescendo. The algorithm doesn't know what to do about it (the correct answer, although not leading to great music, would be to use parts from the begginning of the crescendo track so not to overpower the pop song.)

https://rave.dj/-Ls2Nu6CPD0Ssw

Edit 2: Here's an easy one it gets wrong: track 1 has great loopable instrumental grooves that go on each for a few bars before rap vocals kick in. Track 2 is a person talking. It should not be overlapping vocals, it should just highlight the instrumental loops.

https://rave.dj/acvjP2J3oQWF4Q

[+] SyneRyder|7 years ago|reply
If there's any Eurovision geeks here, I tried putting two Eurovision songs together, and now I can't stop watching "I Feed You My Rhythm Inside" by Margaret Berger vs Loïc Nottet. I must have played this 10 times in a row now.

https://rave.dj/_sYhWmI-iHgq_Q

[+] stephengillie|7 years ago|reply
After watching this, I want to watch another, similar mashup. This site could really use a recommendation/autoplay system, and I could listen for hours. Maybe I've been watching Youtube too much.
[+] minikomi|7 years ago|reply
This is probably the best one I've seen because it gets the phrasing just right
[+] minikomi|7 years ago|reply
As long as there's a pretty predictable 4/4 beat, it seems to do well.

https://rave.dj/fR61DJEv2DP4Tw

DJ AssultPink - Ass ' n ' TT

Although the BPM detection usually works, It seems to have trouble getting the songs synced in phrase - 2nd tracks come in starting on the 3rd bar or something.

[+] jariz|7 years ago|reply
That blur filter absolutely annihilates my macbook's CPU.

EDIT: 4 hours remaining... hmmm.. feeding it a 400 track playlist probably wasn't a good idea

[+] asdojasdosadsa|7 years ago|reply
Tried to use some generic pop songs ( https://rave.dj/BtHuRn1-lAnDEQ - [madonna - hung up] & [ timbaland - the way i are ]) and result is not bad at all, a bit cacophonous in some parts, but other than that it's [the smashup] quite good!
[+] cookiefonster|7 years ago|reply
A few Raves I did that I like (most are with It's Everyday Bro because rave.dj tends to work well with that song):

https://rave.dj/kzPLdIZQmIsS0Q

https://rave.dj/y1qMUYY7GbNmKA

https://rave.dj/JaJYoO_hBQNkjw

https://rave.dj/U4BPJ9duII-o9Q (gets off-sync later sadly)

https://rave.dj/Xx-6ojmH86hxpA

None of these are perfect but Rave is A LOT of fun to mess around with, there's no denying that.

[+] mburst|7 years ago|reply
Seems to be pretty awesome. I tested out two instrumental bits in Hardwell - Spaceman and SHM - Greyhound and found that the algorithm had some issues with the low end clashing on mixing between the songs https://rave.dj/qP-eYlelx75GjQ Though it leveled out after a few seconds. Would love to know more about how it works!
[+] m00dy|7 years ago|reply
Definitely. I'm so curious.
[+] kvgr|7 years ago|reply
Just one side note, that moving background is giving me motion sickness :) But I am gonna probably spend a lot of time, making mixes...
[+] ArmelC|7 years ago|reply
Hey all! I'm one of the devs at Rave (working on the website). This is really cool to see all this interest in us!

To address a few points I've seen on here: We do more than just beatmatching. That said, most of our recent technical advancements are done on our mix AI, as it's been our recent push. Give mixes a try (which work better the more songs you give them)! We'll be pivoting back to mashups soon as well to continue improvements on that AI, particularly rolling in some of the improvements we developed through the mix AI.

Our goals have really been to bring mashups and mixes to those who don't have the technical ability first and foremost, and focus on making it as accessible as possible. We want to make sure our baseline is solid before targeting customizations. I feel paraschopra's post really captured what we wanted to achieve.

Ultimately, we're still at the beginning of what we want to do, and have plenty of improvements on the way.

[+] samstave|7 years ago|reply
Some feedback:

* Awesome job, here are some feature suggestions:

* The ability to rate the mix/mashup as the author

* The ability to rate as an audience

* visual of the algo's understanding of the songs sound profile and how its lining them up

* The ability to select the time-range of the song which must be included/excluded from the mix

* ability to ask it to weight a repeating frequency of a song

* name of the artist/track/video playing displayed

---

Where are you guys located?

[+] andybak|7 years ago|reply
And a surprisingly successful merger of Cutty Ranks and Abba with the awesome title of "Limb Queen"

https://rave.dj/Mgv2ZGiuYfNnow

I giggled all the way through it. A bit of better volume balancing where the two songs overlap and I'd play that at a party with no regrets...

[+] senorjazz|7 years ago|reply
nice - as you say, would be better if the Abba track was lower in the mix when it first comes in, but the timing and parts used to bring it in are spot on.

Perhaps the algorithm would do better with better quality versions of the track rather than youtube quality?

[+] jjcm|7 years ago|reply
Pretty interesting. I used to be heavily into the mashup scene, even going so far as to make mashup.fm (another turntable/plug.dj clone). Here's some of my favorite classical mashups alongside the rave.dj version:

Thomas the Tank Engine vs Biggie Smalls

Original: https://www.youtube.com/watch?v=ETfiUYij5UE

Rave.dj: https://rave.dj/XUBqv8IsZPVZMQ

This was the easiest as it's just a vocal track laid onto a beat, but it really jumps the tracks around a ton, seemingly randomly. It at least doesn't jump mid-measure though and fits with the beat.

------------------------------------

Modest Mouth (Modest Mouse vs Smashmouth)

Original: https://www.youtube.com/watch?v=wEmJH7JsKgM

Rave.dj: https://rave.dj/gUb_lU_PrHBdKA

The Neil C original is a classic, and really fits two songs together that don't belong near each other. Rave plays the intros in sequential order, with vocals overlapping all over. They really need a central channel filter to see if they can pop the vocals out from the instrumentals. This is really a tuesday-surprise lunchroom casserole of a mashup, with a rather abrupt ending.

------------------------------------

Korn vs Taylor Swift

Original: https://soundcloud.com/user-490703809/we-are-coming-undone-k...

Rave.dj: https://rave.dj/usdGtcmoNJeItg

This one really works because of some of the more complex editing on Isosine's part. The rave one is a disaster. Feels like you're standing in between two parties that are blasting two jams, that just happened to have their drops/choruses line up.

------------------------------------

Kanye West vs The Beatles

Original: http://mashup.fm/media/Hey_Jude_We_Major_More_Popular_than_J...

Rave.dj: https://rave.dj/ZcRpPLK6QZEvZA

This is a personal favorite, and I think it works because of how long the Hey Jude intro is. It really means you forget about Kanye completely until he jumps in. It works because of how slow of a buildup Hey Jude is. The Rave version has no nuance here. They speed up Hey Jude, up-pitching it in the process and making it sound like Raffi or some other child entertainer. They down pitch Kanye, making him seem like some gangsta thug. It really doesn't work at all.

------------------------------------

I really want this to become better, but I feel like it needs to be trained more tricks (vocal separation for one) to really be worth it. Also minor QOL improvement would be to allow you to preview tracks before you add them to the mix. Hard to find one that's a good audio only rip of a song sometimes.

[+] maze-le|7 years ago|reply
Love it!

What I find very interesting is, the stability of the system. There must be quite the heavy load on the machine: retrieval, analysis, tempo matching, mashup creation, encoding and all on a ~11 hours HN-related stress test.