Jump to content


Photo

Vocal Resynthesis


  • Please log in to reply
11 replies to this topic

#1 HeartBeatHero

HeartBeatHero

    Big Masta Member

  • Normal Members
  • PipPipPipPipPipPipPipPipPip
  • 543 posts
  • Gender:Male
  • Location:The Netherlands
  • Interests:http://www.heartbeathero.com
    https://soundcloud.com/heartbeathero/space-nightmare

Posted 27 February 2017 - 16:45

Is there a plugin or way to take one voice sample and re-pitch it with the same speed each time you play it with a different note?



http://heartbeathero.com - all renoise

https://heartbeathero.bandcamp.com
HearBeatHero a.k.a Alien7


#2 Carbonthief

Carbonthief

    Guruh Motha Fakka is Levitating and Knows Everything About Renoise Member

  • Normal Members
  • PipPipPipPipPipPipPipPipPipPipPipPipPip
  • 1077 posts
  • Gender:Male

Posted 27 February 2017 - 19:44

Kontakt can do this.  Load a sample and choose "time machine" from a dropdown in the source menu.  There are different algorithms to choose from to do this.



#3 OopsIFly

OopsIFly

    Guruh Member

  • Normal Members
  • PipPipPipPipPipPipPipPipPipPipPipPip
  • 950 posts
  • Gender:Male
  • Interests:...daydreams... -VS- ...propaganda...

Posted 27 February 2017 - 20:30

I believe the autotune alike plugins are built so they not only are suitable for making the singer seem to sing with perfect pitch, but they can often also be used to tune a voice/singing track to certain notes. Well, maybe because sometimes singers are so drunk and fucked up that snapping to the closest note in scale just isn't enough...I think to remember some autotuners have midi input to the plugin so you can control what the singer was supposed to.....

 

I've once done a setup with a free open source autotune clone with a keytracker, it allowed me to pitch spoken voice tracks to any melody. Even to extreme pitches, though then the voice more and more sounded a bit...unnatural. Also the free plugin had way inferior sound quality to autotune and co though, it had lots of artifacts. I bet the expensive plugins are much better.

 

Autotune plugins can be a bit like vocoders, but way more natural sounding. They are optimized for singing timbres. General pitch shifters probably can also be made to do it, but they often work with algorithms no dedicated totally to voice, so they sound ok on other material but not as natural when speech/singing is considered. It is also a matter of treating voice formants the right way.

 

I hope that is what you are looking for, you didn't describe it clearly.



#4 TheBellows

TheBellows

    Guruh Motha Fakka is Levitating and Knows Everything About Renoise Member

  • Normal Members
  • PipPipPipPipPipPipPipPipPipPipPipPipPip
  • 2430 posts
  • Gender:Male
  • Location:Oslo, Norway
  • Interests:Jepp

Posted 27 February 2017 - 20:31

You could spend a lot of time manually repitching in Audacity for free or you could spend 399,00 € on Kontakt.
Autotune has this thing that you just gotta hate.

Edited by TheBellows, 27 February 2017 - 20:34.

 

Join the Mutant Breaks #10 competition: http://forum.renoise.com/index.php/topic/50588-mutant-breaks-10/

 

Deadline: Sunday, December 10th, 2017.   :badteethslayer: 


#5 OopsIFly

OopsIFly

    Guruh Member

  • Normal Members
  • PipPipPipPipPipPipPipPipPipPipPipPip
  • 950 posts
  • Gender:Male
  • Interests:...daydreams... -VS- ...propaganda...

Posted 27 February 2017 - 20:45

does kontakt also detect the original base pitch of the sample, and warp it around to the new note? just pitch shifting spoken or singing voice by notes will normally also be shifted around by the original note/pitch, which can change a lot, if you know what I mean. autotuners (theres cheaper clones that do the same job without the industry standard glitter...) automatically detect the base pitch of the input, and compensate it to the target note.

 

Also dem dang tuners are realtime usually. not only on the note, but also on the input voice side.



#6 sokoban

sokoban

    Super Advanced Member

  • Normal Members
  • PipPipPipPip
  • 123 posts
  • Gender:Male
  • Location:France

Posted 27 February 2017 - 23:18

Depending of what result you want, you can use :

  • Pitch shifters
  • Vocoders
  • Talk boxes
  • Auto tunes

All of them can use MIDI notes to set the pitch of your final sound, without modifying its length.


Sokoban - Ghisloban - GhisMart

https://soundcloud.com/ghismart


#7 robohymn

robohymn

    Super Advanced Member

  • Normal Members
  • PipPipPipPip
  • 143 posts
  • Gender:Male
  • Location:Victoria, BC

Posted 27 February 2017 - 23:46

I second Audacity, although yeah it'll be a bit of work. There are a few algorithms to check out, including "Paulstretch", which (I think) does a form of true resynthesis. I've used it to turn *extremely* short vocal samples (like .25 seconds and less) into very usable looped choir-like sounds, and it seems to have less distortion than the regular time-stretching stuff in Audacity. Also CDP has a variety of time-stretch algos. If you like scripting and have Reaper, I'm certain a script could be made up to automate the production of pitch-shifted samples using some very good offline algos in Reaper, also


Edited by robohymn, 27 February 2017 - 23:48.


#8 OopsIFly

OopsIFly

    Guruh Member

  • Normal Members
  • PipPipPipPipPipPipPipPipPipPipPipPip
  • 950 posts
  • Gender:Male
  • Interests:...daydreams... -VS- ...propaganda...

Posted 28 February 2017 - 01:02

"praat"

 

mwhuhuhhahah

 

no that is for research only, not for audio production.

 

obwohl...



#9 Neurogami

Neurogami

    Big Super Masta Member

  • Normal Members
  • PipPipPipPipPipPipPipPipPipPip
  • 619 posts
  • Gender:Male
  • Location:Scottsdale AZ
  • Interests:Art, music, technology

Posted 28 February 2017 - 02:36

I understood the question to be, "Is there a plugin that can do on-the-fly sample repitching with fixed tempo?

 

I use Reaper to re-pitch wav files while maintaining the speed, but I'd love to be able to just drop a sample into an instrument, set the keyzone to C4, then if I hit a D4 it plays that sample at the same speed but pitched a whole tone higher.   

 

The Reaper VST does this in real-time so conceivably a Renoise VST could do the same.  If it exists.

 

(I like this better for assorted instrument sounds than for vocals; vocals very quickly acquire a goofy quality when retuned more than a whole step away.  The timbre seems to be mismatched.)



#10 gentleclockdivider

gentleclockdivider

    Guruh Motha Fakka is Levitating and Knows Everything About Renoise Member

  • Normal Members
  • PipPipPipPipPipPipPipPipPipPipPipPipPip
  • 2554 posts
  • Gender:Male
  • Location:something like a sea or a river...just moving
  • Interests:slacking

Posted 01 March 2017 - 00:43

reaktor form is pretty fuckin awesome .


THERE IS NO RELIGION SUPERIOR TO THE TRUTH


THERE IS NO TRUTH SUPERIOR TO THE ONE I CHOOSE

C'EST MIEUX D'ETRE BELLE ET REBELLE


QUE MOCHE ET REMOCHE



RUBIO RABIA

 


#11 ffx

ffx

    Guruh Motha Fakka is Levitating and Knows Everything About Renoise Member

  • Normal Members
  • PipPipPipPipPipPipPipPipPipPipPipPipPip
  • 2995 posts
  • Gender:Not Telling
  • Interests:macOS fanboying

Posted 01 March 2017 - 01:02

Melodyne


MacOS 10.12.6 Retina, Renoise 3.1 64 bit   -   Tuned Shortcuts | Multi-Jump From/To Send | Quick Template | Insert Native DSP Menu (incl. deprecated)


#12 robohymn

robohymn

    Super Advanced Member

  • Normal Members
  • PipPipPipPip
  • 143 posts
  • Gender:Male
  • Location:Victoria, BC

Posted 01 March 2017 - 04:59

I understood the question to be, "Is there a plugin that can do on-the-fly sample repitching with fixed tempo?

 

I use Reaper to re-pitch wav files while maintaining the speed, but I'd love to be able to just drop a sample into an instrument, set the keyzone to C4, then if I hit a D4 it plays that sample at the same speed but pitched a whole tone higher.   

 

The Reaper VST does this in real-time so conceivably a Renoise VST could do the same.  If it exists.

 

(I like this better for assorted instrument sounds than for vocals; vocals very quickly acquire a goofy quality when retuned more than a whole step away.  The timbre seems to be mismatched.)

Thing with this is, Reaper's using licensed algorithms (though maybe SoundTouch isn't licensed, I'm not sure) that any plugin dev would have to also pay for. I don't know if there's anything comparable for free out there. The guys who make and license out the Elastique algos Reaper uses, zplane, used to have a freebie but I think it's withdrawn.

 

Re: timbre mismatch -- actually I've found ReaPitch does a fantastic job with vocal stuff if you use the Elastique Pro algo and set the secondary setting to one of the "preserve formants" settings (they all sounds pretty much the same to me), it creates a far more convincing pitched up vocal even several semitones up, I've found (though naturally it varies by source audio quality and other factors). It helps to prevent munchkin vocals. The Soloist algo doesn't do as good a job, no option to preserve formants, although it's the one meant for monophonic vocal/instrument tracks.


Edited by robohymn, 01 March 2017 - 05:01.

  • TheBellows likes this