2SYNts- regular guitar to poly MIDI & synth

Started by nix808, January 31, 2014, 12:50:53 PM

Previous topic - Next topic

0 Members and 1 Guest are viewing this topic.

nix808



Heya,
First post in this cool forum.
My name is Nick Johnstone, and my startup audio software tag is Phonics Audio.
I will keep this thread updated with where I'm at with my pitch to MIDI device,
best to put everything in here than make multiple posts IMO.
I have been tinkering with pitch to MIDI since 2005,
when I first started using Flowstone which is my development environment.
Originally using a regular pickup and doing the conversion in mono,
in 2011 I got breakout boxes for the GK-3 and my Ubertar passive hex.
Currently I run the Ubertar hex on a home built custom Strat.
So the Ubertar PU runs into a breakout box,
and then into my soundcard. This gives me access to the signals to do whatever I like with.
I haven't experimented with FX really, just focussed on MIDI conversion.
The software is called 2SYN, here is a screen of it currently->

It is not overly complex-I can outline the process if you are curious of it.
It does not slide pitch atm, however it does push out velocity if you want.
The approach using a soundcard means that the box u use is a multi-track interface,
as well as your guitar box.
Here is my thread on KVR, with pictures of the gear->
http://www.kvraudio.com/forum/viewtopic.php?f=180&t=323713
I can post pictures here too, if you are interested.
Here is a short piano noodle->
edit- https://soundcloud.com/nix808/2synpiano
The current version is available at the end of this post.
Hope you are loving the music and technology!
Cheers, Nick

EDITS-
full version 2SYN midi & synth 2.0.6->
https://www.sendspace.com/pro/dl/mtcjg9
^This is now natively 64 bit and VST3 (but for Windows only)
The .zip includes the source and resources required to modify the build
17 04 2019

These builds require your GK3 equipped guitar to be strung with all C strings(.711mm .028" 22 gauge-- MIDI note 48)

NOTE: all 2SYN builds require a samplerate of 44.1k

<<edit 14/7/20>>
Hello again, I have been working on a regular electric guitar to synth plugin for Windows
You can get the project here->
https://www.sendspace.com/pro/dl/vnccr5
It's fully functional and free & open source again. The download includes VST2,VST3 compiles and the required resources to mod it. It's rather polyphonic,
and uses my usual filter tricks to modulate the guitar signal into sine of consistent periodicity.
The source can be opened in Flowstone Alpha,
which will perhaps be available this upcoming year
^^now added MIDI out!^^
Here's a screen->
Rock and Rock my boat, as long as you don't rock and rock my boat!hehe

drjoness2001

Nicely done!

Here is a similar guitar synth, run in Reaktor, I posted a brief clip from my long video on the GK Expander:

http://youtu.be/7tLNdJVzaB0?t=6m9s

I have more details here:

http://www.joness.com/gr300/GK-Expander.htm#gsynth


drjoness2001

The YouTube post did not include the start time, skip down to six minutes to get to the Reaktor synth part.

Wayne

nix808

#3
Hey, that's really interesting.
I will get the ensemble today and have a look at what has been done-
I have used Reaktor just a little.
There are infinite processing options for sure, ta for the lead on that one

Here is a link to my piano demo on SoundCloud->
edit-https://soundcloud.com/nix808/2synpiano

I just did it quickly, but since it's the only one I have for now,
I decided to up it. Will do one with better playing today-
and also analog synth.
Toward the end some notes sound in forte, and quickly mute,
this has been fixed with some logic. It's due to bleeding of velocity.

The GK Expander is cool, but batteries have varying current and run out.
Will post a shot of my mains powered breakout-
you might like it.

Cheers!
Will watch the entire vid too- the expander is compatible with my gizmos
Rock and Rock my boat, as long as you don't rock and rock my boat!hehe

drjoness2001

Here is a much better demo of the Reaktor gtr synth. This was done without MIDI, with all the pitch-to-synth processing done inside Reaktor, with very low latency:



Wayne

nix808

#5
That is a truly beautiful guitar body mate.
The audio is clean as,
although I picked you had minimally edited it.
I will give the ensemble a go again,
it seemed really cool,
but when I tried to add another string,
the 2 strings sounded totally different.
I dunno what I did, anyway I will try again.
It's certainly interesting to use audio streams instead of MIDI,
like u say,
the response time is only soundcard latency.
Also polyphonic pitch bend is integral with a stream synth.
Thanks for the demo!
I think the luthering on my current MIDI axe is finished,
loving the look and feel of the thing 8D


just a little edit-
I had confused the Expander with another break-out box,
that also allows the 6 signals to be accessed,
it's this->
http://www.separate-strings.co.uk
Rock and Rock my boat, as long as you don't rock and rock my boat!hehe

nix808

#6
I have made this open source and freeware now,
including wireframe graphics.
You can get it in the first post 8D
Rock and Rock my boat, as long as you don't rock and rock my boat!hehe

nix808

#7
Hey again fellas,
I have done a lot more work on this,
and it approaches perfection, ie. a completely switch-like behaviour in the trigging mode.
Rock on!    Nick
Rock and Rock my boat, as long as you don't rock and rock my boat!hehe

Elantric

Looks good!

2SYN- guitar to MIDI now ver1.1



2SYN is a VSTfx that takes the 6 signals from a hexaphonic guitar pickup,
and outputs MIDI.
So some hardware is required, a hex pickup,breakout box,soundcard and windows computer.

It works nearly 100% of the time to track pitch correctly.
It's based on a zero crossing time counter.
My necessary innovation is to feed back the counter's reading into cutoff of an LP and BP filter.
So a feedback path is used. This has an analog to electric motors and valve pumps,
in that it uses it's own mechanism to function. It is also a dynamic creation.

It's open source now, here is the FlowStone schematic and VSTfx .dll->

https://www.sendspace.com/pro/dl/oilwad


The UI should be easy to use, it is necessary to set the gate to trigger note ons for the pickup and soundcard you have. I am using a Roland GK3 pickup atm, but I will get my Ubertar going again soon.

I have been working on this since 2005

Cheers all, Nick- PhonicsAudio

update 1.1 10 April 16


More here:
http://www.kvraudio.com/forum/viewtopic.php?f=1&t=439603&sid=3e0dc3dd2969794dbc653a4140d4a2a6&start=15

nix808

#9
Thanks Elantric for the repost and comment.
I have here a screen of the current UI, hope it seems straightforward->

I'll make some audio demos with 1.1 soon and link here.
Cheers
Rock and Rock my boat, as long as you don't rock and rock my boat!hehe

Mauri60

#10
Quote from: Elantric on April 10, 2016, 01:45:15 PM
Looks good!

2SYN is a VSTfx that takes the 6 signals from a hexaphonic guitar pickup,
and outputs MIDI.
So some hardware is required, a hex pickup,breakout box,soundcard and windows computer.
sorry Elantric, may you explain me what kind of appareil is a breakout box?
thanks as usual! :)
Mauri
Nothing is impossible,if someone else will do for you.

admin

#11
QuoteSorry Elantric, may you explain me what kind of appareil is a breakout box?

RMC Fanout / Break out boxes for creative uses.
https://www.vguitarforums.com/smf/index.php?topic=9733.msg69854#msg69854


http://www.separate-strings.co.uk

This is approach to trigger special soft synths with direct audio input alone - separate audio channel per string ( no MIDI )for use with


u-he Zebra,
https://www.vguitarforums.com/smf/index.php?topic=13010.0

Pure Data,
https://www.vguitarforums.com/smf/index.php?topic=8207.msg58296#msg58296

Reaktor  / GSynth2:  Software Based Guitar Synthesizers
https://www.vguitarforums.com/smf/index.php?topic=7772.msg54665#msg54665

Read more in this area

Guitar to MIDI - USB to Softsynth
https://www.vguitarforums.com/smf/index.php?board=51.0

nix808

Hi Mauri,
I use this manufacturer of pickups and breakout boxes->
http://www.ubertar.com/hexaphonic/products.html
My 2 boxes convert from 13 and 7 pin, to 6 patch leads which connect to a soundcard.
I usually use the 7 because it is passive and I prefer the guitar it is in.
Here are some photos of my hardware->







The breakout box is a pretty simple device

Any softsynth or hardware synth(with midi) can be controlled by my 2SYN.
The VSTfx is ideally loaded in a modular host,
but any DAW that supports multi channel ins to fx will work.
My favourite hosts to run it are Console and energyXT
Rock and Rock my boat, as long as you don't rock and rock my boat!hehe

Elantric

#13
Thank for sharing

Since we are talking about divided pickups

Cycfi Six Pack Project - Hexaphonic Pickup Project
https://www.vguitarforums.com/smf/index.php?topic=8666.msg80095#msg80095


http://www.cycfi.com/2014/08/infinity-control-panel/




The Nu Series Modular Active Pickups are hacker friendly, general purpose pickups that can be used in a variety of applications. These are active multichannel pickups with low impedance coils and integrated single-ended, low-power, low-noise preamplifier for each coil. These low-profile, Neodymium-core pickups are modular and can be used individually or in groups.

https://www.cycfi-research.com/product/nu-capsule/

Nu-Exploded

The Nu Series Modular Active Pickups are hacker friendly, general purpose pickups that can be used in a variety of applications. These are active multichannel pickups with low impedance coils and integrated single-ended, low-power, low-noise preamplifier for each coil. These low-profile, Neodymium-core pickups are modular and can be used individually or in groups.


Multichannel (8-String) Nu System with Internal Breakout

This is the next evolutionary stage of our flagship multichannel Neo pickup. The Nu sports better crosstalk performance using permalloy ring shields and even lower noise with improved discrete preamp design. Most importantly, they sound just as good as the original — same coil, same magnetic structure.

The pickups are designed for multichannel effects processing — one for each string (distortion, EQ, compressor, delay, pan, pitch-shift, etc). Such extensive processing is now possible due to advances in digital signal processing and the proliferation of multi-channel audio interfaces and multi-track audio software.

These modular pickups are not just for guitars. Nus can also be utilized for other musical instruments such as the bass guitar, harps, pianos, xylophones, etc. The Nus are perfect for fanned-fret electric guitars (and basses) where the pickup poles are positioned at various angles.

nix808

#14
The model looks amazing.
Would they still transfer a signal if passive?
Passive is my preference,
coz my delicate audio equipment can not get a DC spike if something short circuits.

I just played a little piano with 2SYN 1.1->
edit--https://soundcloud.com/nix808/2synpiano

The velocity isn't as I wish yet, but it tracked pretty well, maybe 2 almost indiscernible muffs
Rock and Rock my boat, as long as you don't rock and rock my boat!hehe

Mauri60

#15
thanks a lot for explain me about breakboxes.
it's a kind-of midis poly or mono transmit/receive data... (applied to audio signal o.c.)
:) this remind me my backwardness.
please look at my bird-avatar for astonished look  :o
every day is good to learn something amazing!
guys, you're damn awesome.
have a good time!
mauri
Nothing is impossible,if someone else will do for you.

nix808

Yep-
it's one like mono(1 lead) to poly(6 leads)-
But actually the signals are just the same.
The box has no components that you can't see from the outside,
it's wired guitar jacks, from 1 lead with 7 wires to 6 leads with 2 wires.
The signal is always poly and the box just routes the cable types,
without doing anything else.
I have one for a GK3 too, which is a little more complex,
as it has a 9 volt power supply attached(and that's all).

You have fun too mate, ta!


Rock and Rock my boat, as long as you don't rock and rock my boat!hehe

nix808

G'day!
Version 1.2 is now available in the first post.
It's a good bit better and I'm having fun with softsynths.

It now uses 2 bandpasses alone to manipulate the signal,
which preserves high notes near the 24th fret better.

I hope it's as ace for you as me
Rock and Rock my boat, as long as you don't rock and rock my boat!hehe

nix808

#18
Download is in the first post, ver 1.3.
Audio demos to follow.
I got it to register the 22nd high E fret on my strat(while letting B open ring out over it), which was very wishy-washy until now.
Now it switches to last played note in the detector, which seems better than a string root.
Cheers

PS- Also, when in bend mode, there is only soundcard latency and RMS window time(max 700 samples at 44.1k) as the delay before note on.
Rock and Rock my boat, as long as you don't rock and rock my boat!hehe

nix808

#19
Here is NI Akoustik piano,
in 2 similar jams.
I think the note on/off is more of a problem than the pitch detection.
There are 3 wrong notes in the 2 short doodlings->
edit--https://soundcloud.com/nix808/2synpiano
I'll be back with more.
Piano is a good test, it asks such precision.
Rock and Rock my boat, as long as you don't rock and rock my boat!hehe

nix808

Rock and Rock my boat, as long as you don't rock and rock my boat!hehe

nix808

Updated again, now a more finalised and logical structure, and a little more accurate.
It's available in the first post.

Here is the edited version of that lead in the prior post->
https://soundcloud.com/nix808/leed-master

It's real,real fun IMO
Rock and Rock my boat, as long as you don't rock and rock my boat!hehe

shawnb

Nice work!   
Love the tune...  Tom Waits techno...
Clearly responsive...
Address the process rather than the outcome.  Then, the outcome becomes more likely.   - Fripp

nix808

oh!
thank you kindly.

More stuff from me in the upcoming whenever I hope.

Here is the guts of the detector as a .png->


It has been described as a naïve Kalman filter/system
Rock and Rock my boat, as long as you don't rock and rock my boat!hehe

nix808

#24
D/L new version in first post.

Changelog-
-It came to my attention that bend was sending out 3 note offs instead of 1. There are no unwanted note OI any more.
-Velocity will do. It is workable. Play naturally for small humanising, and pluck a little harder to send max velocity
-The individual string's detuners are fixed(it was a missing connection)
- The filters now feature 1st and 2nd harmonic nullers(notches)
- The lower 3 strings track more accurately, but 25ms slower.

So eventually I will make an aesthetically/graphically more complex UI, with more saturation and 3D knobs.
I will redo almost all of the audio demos too.

It's ready to rock!

I have the 551 sample(@44.1k) delay audio conversion to synth coming soon.
I need to order the UI and finish the 1 oscillator polysynth.
Rock and Rock my boat, as long as you don't rock and rock my boat!hehe