Jump to content


Photo

Fragment : Collaborative Spectral Synthesizer

softsynth spectral synthesizer collaborative raspberry experiment spectral live-coding

  • Please log in to reply
2 replies to this topic

#1 Mammoth

Mammoth

    Member

  • Normal Members
  • PipPip
  • 23 posts
  • Gender:Male
  • Location:France
  • Interests:Music, Coding, Retro hardware

Posted 29 January 2017 - 23:31

Hello everyone,

i want to present you an experiment, Fragment, a collaborative and free spectral musical instrument.

 

Here is a demonstration video where Fragment act as a virtual instrument for Renoise, the base audio is generated by a Raspberry Pi :

 

 

 

This is a "live-coding" synthesizer which associate visuals/audio through direct manipulation of the spectrum, the visuals are generated by a GLSL script (your GPU is producing the visuals) which is shared between users and per sessions, the visuals represent a kind of possibilities space from which you choose what to hear by "slicing it", spectrum slices are fed to a pure additive synthesis engine in real-time, i believe that some weird sounds can be made easily with this synthesizer, complex sounds can also be made but it may require higher knowledges.

Visuals/sounds can be manipulated by tweaking the script variables directly or through MIDI enabled controls widgets (this is a Chrome and Opera only feature because FireFox does not implement it right now), it is also possible to manipulate the spectrum with your camera or images, that way it is possible to draw a score on a piece of paper or anything else and play it back with your camera or by adding images.

This is mostly web-based but there is a port of the synthesis engine to Linux/Windows/Raspberry which provide crackles free performances in case you have a "slow" CPU, i will also soon release a standalone all-in-one executable for Linux and other platforms which will allow beefy performances directly.

This synth. require a beefy CPU, GPU and some knowledges of GLSL in order to use it, you can follow the example comments for some hints and the help dialog for some helps, a full documentation is coming soon!

 

If you have any questions, i will be glad to answer them here. :)

You can try it at : https://www.fsynth.com


  • danoise, vmuriel and magickz like this

#2 Mammoth

Mammoth

    Member

  • Normal Members
  • PipPip
  • 23 posts
  • Gender:Male
  • Location:France
  • Interests:Music, Coding, Retro hardware

Posted 15 February 2017 - 02:17

A quick track made with Fragment and Renoise while i was testing things today :

 

 

Some more videos were uploaded :

 

 

 

 

The standalone version (much better performances) and the complete software documentation with examples and tutorials is also in progress.

 

Also, while i was jamming with it today, found out that having multiple instances of the synthesizer to play different sounds is right now quasi impossible, it is a major set back so this will be enhanced in the next version by adding the possibility to assign different output channels to the spectrum slices and have a way in the fragment shader to determine which "sound" is to be played for MIDI notes messages, that alone would solve the problem without performances hit altogether, something which will be done after that is render buffers which will allow an "easy" way to add fx such as reverb. to the sounds produced with Fragment, it is possible to do it right now but either quite limited or very cumbersome.


Edited by Mammoth, 15 February 2017 - 02:27.


#3 magickz

magickz

    Advanced Member

  • Normal Members
  • PipPipPip
  • 76 posts
  • Gender:Male

Posted 15 February 2017 - 06:56

Fragment generates very interesting sounds! Amazing to watch and listen, but I guess it's not for me.  Maybe when I have some more free time... :blush:

 

Btw. the first time I have seen a live programmable interface was a presentation video by Sam Aaron playing with samples on a Sonic Pi just a few days before you posted this one here. When I saw your post here I thought the user interface has a similar approach.







Also tagged with one or more of these keywords: softsynth, spectral synthesizer, collaborative, raspberry, experiment, spectral, live-coding