Multitouch Control Interfaces

Started by Elantric-fgn, April 03, 2010, 01:26:33 AM

Previous topic - Next topic

0 Members and 1 Guest are viewing this topic.

Elantric-fgn

Re the new Ipad - Actually I think I'll try to wait for the next rev with a camera - probably due January 2011.

So i can do this  - but create a virtual control surface anywhere I point the camera .
https://www.vguitarforums.com/smf/index.php?topic=32167.msg238262#msg238262


Virtual guitar interface using Guitar Rig and wiimote Whiteboard

http://johnnylee.net/projects/wii/


But Portable like this
http://techsparked.com/project/portable-mt

. . . the future ain't what it used to be . . .

Elantric-fgn

#1
QuoteSo i can do this  - but create a virtual control surface anywhere I point the camera .
Although i may just adapt this

http://www.cameramouse.org/

http://www.cameramouse.org/downloads/CameraMouse2010Manual.pdf


. . . the future ain't what it used to be . . .

Elantric-fgn

. . . the future ain't what it used to be . . .

Elantric-fgn

#3
But make it cheap


cerupcat  —  April 28, 2008  — Follow me on Twitter:
http://www.twitter.com/SethSandler

*READ BELOW FOR MORE INFORMATION*

my website: http://www.sethsandler.com

*NEW SOFTWARE RELEASED - GET IT FROM THE LINK BELOW*

-Software and Getting Started Guide-
-------------------------------------
* MTmini Software and Updates: http://sethsandler.com/multitouch/mtm...

-What's a MTmini?-
-------------------------------------
Don't have a Multitouch Table yet? Have one, but need something smaller for testing? Building a small portable multitouch pad will allow you to test software and experiment on a smaller scale while building your full table or when away from your multitouch screen. Have fun and make a MTmini! This uses Front Diffused Illumination, with normal ambient light (infrared not required or needed) and a normal off-the-shelf webcam (IR filter can still be in place).


-How's it Work?-
-------------------------------------
For this to work, all you need is a room with (at least) some light. The results will be best when the room lighting is even (no bright lights shinning from one direction onto the multitouch pad).

When you place you fingers on the surface, shadows are created where your fingers are. The webcam sees these shadows and sends the image to the tracking software which tracks the shadows as they move on the surface.

It's important to try different lighting setups and to configure the software in order to get the best results.

Thanks to:
-------------------------------------
-David Wallen
-Christian Moore
-Laurence Muller
-NUIgroup Community
Category: Howto & Style






and more here:
http://interactivemultimediatechnology.blogspot.com/

and join others here:

http://techsparked.com/

"techsparked is a social platform for people that are sparked (inspired) by creative and emergent technology. Get sparked and join today! "

http://gestureworks.com/about/supported-hardware/

. . . the future ain't what it used to be . . .

Elantric-fgn

. . . the future ain't what it used to be . . .

Elantric-fgn

Semsomusic Usine
http://www.sensomusic.com/usine/

Usine is a universal audio software especially designed for live or studio utilization. Usine is made by musicians and audio engineers to respond to their specific problems in a lot of domains like live sampling, effect processing or sound design. Usine is a real musical instrument, flexible and powerful if you like to transform, resample the sound on stage, improvise and create unusual effect.

http://www.sensomusic.com/wiki/doku.php?id=manual:modules:patches:mackiecontrol





. . . the future ain't what it used to be . . .

Elantric-fgn

. . . the future ain't what it used to be . . .

riffanvil

sure glad i joined this group!!  this thread was allot of fun and i see most of it is over a year old.  elantric, please keep adding to this.  it is thought provoking and just plain fascinating.

Advoc

This is a big fascinating world open to all of us DIY guys.  If you want more info head over to www.nuigroup.org and read through the wiki and take a look at the forums.

I've just finished my first multitouch table and I've done a bunch of youtube videos describing how I did it.








All together this might be around an hour long, I talk too much, but if you've got the time you could just watch the last one to see it working.

I'm going to build myself a new computer desk and put this in as the top for a control surface for  my DAW.  Saves me a lot of money on control surfaces for mixing when I record.  there are so many different ways you can do multitouch, Either the main methods on the NUIgroup site, or Johnny Lee's method.  There are others too, with the The Leap and various hacks with a Kinect.  It's fun stuff!  Keep this thread alive, I know its old but the content keeps evolving, and the applications for music, especially realtime control, are out of this world.

Elantric-fgn

Glad you enjoyed the articles on Multi-Touch user interfaces.

More is happening in this space all the time
==

http://arstechnica.com/gadgets/2012/05/ubi-turns-any-wall-into-a-touchscreen-using-microsofts-kinect/

"We can turn any surface into a 3D touchscreen," explained Anup Chathoth, one third of Munich-based startup Ubi Interactive. Such claims typically conjure up images of floating Minority Report-style touchscreens made from curved glass, but that's exactly what this three-person team has developed.

Ubi's system uses a  Microsoft Kinect sensor to turn a regular projector into a multi-touch PC projection system, where regular PowerPoints, web pages, even games no longer require clickers or wireless mice to be navigated. By using the motion-tracking and depth-perception cameras in the Kinect, Ubi is able to detect where a user is pointing, swiping and tapping on a surface and interpret these gestures as if they were being performed on a giant touchscreen or interactive whiteboard.

All well and good in principle, but does it actually work? Wired.co.uk visited Ubi Interactive at Microsoft's Westlake offices in Seattle this week for a hands-on demonstration. And the answer was a resounding yes.

A conventional boardroom projector lit up a pane of frosted glass that was suspended in the centre of a low-lit office. On the other side of the pane was a Kinect sensor, which was capturing the movements and gestures of our hands in front of the glass and sending the data to Ubi's software, running on the same Windows PC that was sending the live image to a projector.

Responsiveness was excellent, with only a split second delay between performing a gesture and action happening on-screen. We played with a 3D model of Earth (as used on Microsoft's Surface), using two hands to zoom in and out of the virtual planet, spin the globe around and locate ourselves in downtown Seattle. Naturally, this was followed by a successful test of Rovio's AngryBirds.
Universal compatibility

Being able to play a PC version of Angry Birds highlights an important aspect of Ubi's software-based system—it works with Windows' built-in touchscreen support and works with any PC application.

"It's all Windows touch-based gestures," Chathoth explained. "We wanted to start with an experience everyone knows, but we can open up our API for 3D gestures. It knows exactly how far your fingertip is from the surface—when you actually touch it, that's a click; when you're not touching, it becomes a hovering motion."

This depth-based action was also demonstrated. Hovering a finger over a strip of book covers projected onto a wall let you gesture left and right to browse titles from an ebook download store's app. Actually tapping one of the covers selected that book for download.

Ubi is one of 11 startups that won $20,000 (£12,300) of funding and support from Microsoft as part of its Kinect Accelerator programme, but it remains independent as a startup. Its business model has several aspects: selling the software to individuals who already have a Kinect and a projector; selling a unit that bundles together a projector with a Kinect, as well as the software; retrofitting office spaces with Kinect sensors and software; working with advertisers and outdoor agencies who want to add interactivity to public displays and surfaces.

"We are already deploying some advertising displays," Chathoth explained. "It's attractive to a customer because of the cost, the ease of deployment; it's portabl—an 80-inch screen you can carry inside a laptop case—it's flexible and it's also an engaging experience."

The software itself, Chathoth noted, would cost an individual "close to $500" (£320), and the company is keeping its options open for working with companies who want to integrate richer 3D applications that require custom gestures and software APIs.

He also highlighted the potential uses within educational establishments. "Kids can go and scratch on a wall, but nothing happens," Chathoth said, highlighting that by using a regular wall instead of a costly smart whiteboard means there's nothing a particularly aggressive pair of young hands could break.
History

Ubi Interactive is the name under which its three employees—Anup Chathoth, Chao Zhang and David Hajizadeh—operate. Chathoth and Zhang were school friends who wanted to develop an alternative to smart pens such as LiveScribe; Hajizadeh was a friend of a friend who came on board to develop the business side of the startup.

The original system the trio built was not based on the Kinect, however. Instead it was a bespoke device with custom software and an in-house operating system.

"We built a prototype [and] then the questions came up like, 'Yeah, the content is not there. You have your own OS, but we don't like it because we want to run PowerPoint on it', and the projector lacked the intensity," explained Chathoth. "But we we're a small start-up; we can't build a huge hardware business. So we were working with David at that time as he was helping us with the business side of things, and that's when we started using Kinect.

"We thought it could probably do everything we wanted to do—we just have to make the software. So we started playing with Kinect for Xbox when the beta software development kit (SDK) came out and then a couple of months ago we came across the Windows version and we thought this was the right business model for us—what we want to sell today is software for people who can buy Kinect for Windows from some third-party, or from us."

The result is a low-cost technology that can be retrofitted into existing projection systems without any technical experience. Without an effective demonstration it might appear to be a bit too good to be true, but this young German startup has proved its system works. What it needs to prove next is that it can scale itself well enough to support the demands of major clients. It'll likely be an interesting business to watch over the next couple of years.


. . . the future ain't what it used to be . . .

Elantric-fgn

I want a guitar with this technology..

. . . the future ain't what it used to be . . .

vanceg-fgn

And don't forget Soundplane (though it doesn't have a video display on it as these other interfaces do).  It's even pressure sensitive!

http://madronalabs.com/hardware