Project design Leap Motion 3d jam Future dj\vj virtual Fan Experiences objectives

Leap Motion Apps Reviews

Basic level

Music composition:

• 
  Syntheremin
  
  • 
    https://apps.leapmotion.com/apps/syntheremin/osx
    
• 
  Review
  
  • 
    The sound quality & the app itself does not remotely, come close to Synth or Theremin. Audio experiences, much less even offer a learning basic to either instrument The way of controlling the sound is not like controlling the sound of a Theremin.
    
  • 
    Cmon Man, your stament about annoying the cat was as clever as the use of advertising this app as a Theremin or MIDI learning tool…to make money.
    
    • 
      Roland's MC - line of drum machines used sound similar to Theremin with its D-Beam feature would have got a better result if you had of sampled that. the MC line of units. They can be grabbed as low as 90$ used at Guitar center.
      
    • 
      variation of the Theremin used in Billboard Top music tracks - Surprised none of this was in the learning part of the app,
      
      • 
        oh what ya there wasn't any experience of learning!
        
• 
  Jimmy Page of Led Zeppelin used a during performances of "Whole Lotta Love"
  
• 
  The Beach Boys: "Good Vibrations",
  

• 
  Gravilux
  
  • 
    Gravilux is an interactive musical star field visualizer. As you wiggle and wave your fingers before the screen, gravity draws simulated stars to your fingertips.
    
    • 
      https://apps.leapmotion.com/apps/gravilux/windows
      

• 
  Review
  
  • 
    I have to be nice because I love me some Bjork so that is super cool however the application is so limited in its capabilities to do basic game or computer functionality it's kind of got me wondering what or how much did they pay to get solid reviews from...or this was there fist exp with VR,
    
    • 
      "Apps like Gravilux awaken an 'Avatar'-like sensitivity to electricity in the body, power in the palms and general connectedness." —NY Times
      
    • 
      "Of the millions of apps out there, none quite capitalize on the sheer fun and beauty of interactivity the way that Scott Snibbe’s do.” —CoolHunting
      
• 
  Scott Snibbe...
  
  • 
    bro computer basics - Save & Save Often is the most common computer term we tell ourselves next to, take a backup & a backup for a backup & so on.
    
  • 
    I see kids going crazy, when they can’t save the hours of work.
    
    • 
      There are other’s that reported the inability to save as annoying, but over looked because of the possibilities in total coolness this app could have or might become.
      

• 
  Looking to develop similar game,
  
  • 
    use one these apps & a nice space explores 3D mod. From Source forge…If, I remember, there is even an Art application that will generate music from color schemes on Source forge. Good Luck, remember (Save please)
    

• 
  Fractal painter
  
  • 
    http://sourceforge.net/projects/fractalpainter/files/latest/download?source=directory
    

• 
  Fraqtive
  
  • 
    http://sourceforge.net/projects/fraqtive/files/latest/download?source=directory
    

• 
  Fractal Zoom Explorer
  
  • 
    http://sourceforge.net/projects/fractalzoomexplorer/files/latest/download?source=directory
    

• 
  Soundscape VR
  
  • 
    https://apps.leapmotion.com/apps/soundscape-vr/windows
    

• 
  Review
  
  • 
    fail to meet real world real time integration or a solid gesture based capability
    
• 
  Recommendation
  
  • 
    Would not download or waste your time this should have been developed by Audio tool, working with Leap Motion direct for better hand gesture experience & a real DJ style experience that tone matrix currently offers.
    

• 
  I believe that if developed by Audio tools, this would provide a more realistic VR music production experience, and been worth playing on a regular base.
  
  • 
    I would have pull from my list but giving the possible legal issues with use of tone matrix & there being no true Open Source or Developer SDK available, any longer.
    
• 
  Leaving me with the feeling that this app is more of a legal issue and one that brings more copyright concerns to the music creation industry when we have enough of them already
  
• 
  Legal Note
  
  • 
    I would review the credibility of this application unless (sander snake) has approval from (audio tool or andre-michelle tonematrix creator).
    
  • 
    Since andre-michelle tonematrix merger to Audio Tools after 10 years @lab.andre-michelle.com
    
    • 
      This application appears to be a direct violation of the Audio Tools usage policy not for commercial purposes (sandersnake) should provide Leap Motion with legal proof that (Soundscape VR) in not violation of German law or audio tools legal terms of use.
      

• 
  Validating approval to commercially distribute the hirable attempt at recreating an amazing online Audio creation tool.
  
  • 
    legal page:
    
    • 
      http://www.audiotool.com/terms
      
  • 
    Tonematrix developed originally
    
    • 
      http://lab.andre-michelle.com/
      

Mid-level

Music composition:

• 
  Veil
  
  • 
    an interface for virtuosity using a Thin fabric object in front of you; touch it, strum it, bend it, the fabric responds and generates a sound.
    
    • 
      https://apps.leapmotion.com/apps/veil/windows
      

• 
  Review
  
  • 
    Mid-level score because of price & as its own maker states Veil is neither an ever-good-sounding toy or Noise maker...It's a real instrument & can be a keyboard, it's a guitar, it's a violin, it's a harmonica
    
• 
  Not even sure how to rate this,
  
  • 
    other than unique...the fabric seems odd for use but so far my remedial understanding of the application is that it must offer offers vibration emulation. Which is key to how string music instruments work.
    
    • 
      Just going to be hard to explain if someone is watching why your banging and strumming a fabric.
      

• 
  Sculpt Musical Grooves Out of Thin Air
  
  • 
    https://apps.leapmotion.com/apps/oscilloscoop/osx
    
• 
  Review
  
  • 
    Good "musical" creation with this is possible but not going to win anyone an Emmy award, Application has preprogrammed audio & Lacks customization for loading loops, samples and modifications to them. The ability to change or integrate standalone effect parameters, like reverb, flange, LFO
    
  • 
    I really hope the developer keeps updating the app and making it better, as the app's usage and capabilities does not live up to the name Oscilloscope’s are most useful to audio engineers looking to sculpt audio files modify or change them. The Application calling them crowns is kind of a joke...So I hope coming from renown musical talent and application developers.
    
  • 
    The rating was given because some coronations of audio created Good Music that could have been played with other affective musical instruments and effect processors. Also cost not being free, while there as a few good moments of music creation the lack of extended music creation was just that. Lacking and then the inspiration was gone.
    
  • 
    Solid game or toy for youth learning about audio and sound based coronations.
    

• 
  Dropchord while a game the controller of sounds and interest was given a Mid-level score because of cost & some of the gaming levels were challenging
  
• 
  Also Since it was possible to Mix alternative sound with the music in the drop cored game, if you ran the audio out to a mixer and had mix capabilities
  
  • 
    https://apps.leapmotion.com/apps/dropchord/windows
    

• 
  While cool in sparking creativity, this will not be the app you create your next Emmy award with
  

MIDI/OCS:

• 
  Chordion Conductor
  
  • 
    https://apps.leapmotion.com/apps/chordion-conductor/osx
    
• 
  Review,
  
  • 
    offered the best user interactivity from beginner to advanced level the widest range of internal instrument base music creation as a MIDI controller
    

• 
  However, you only available for use with MAC,
  
  • 
    Cmon Man - Project Darwin anyone?
    
    • 
      I care because the root of my demo project for 3D jam is based on the long standing issue with projecting live streaming format.
      
• 
  Which, has been the toll that is put on the graphic card and that most users would not have supportable GPU to process the data. Windows Live Broadcast features in Azure help control and lift some of the load so I needed a Windows based application.
  
  • 
    Sorry, you’re not number 1.
    
    • 
      You are on the list as the quickest for users to learn & the integration of cord to help teach music reading and cord scaling fundamentals. Nice work, with this music learning function.
      

• 
  I so wish, you were on the Microsoft platform!
  

Advanced level

Music composition:

• 
  Muse empowers and inspires anyone to compose and perform beautiful ambient music.
  
  • 
    Designed Ideal, unbound music composition from a typical or standard instruments
    
    • 
      https://apps.leapmotion.com/apps/muse/windows
      

• 
  Created by BT & Dr. Richard Boulanger the Search for New Sound
  
  • 
    Using MIT's with a Virtual gesture based motions & MIT's CSound, one of my inspirations to build a better experience for the Artist Fan experience
    
    • 
      https://www.youtube.com/watch?v=fTWn2vLTMIk
      
• 
  Live w/BT in the Studio on Leap Motion Technology
  
  • 
    prior to the new Leap Motion Hand & gesture being used in Leap Motion 3D Jam 2015
    
    • 
      https://www.youtube.com/watch?v=u6BhiRi-sno
      

MIDI/OCS:

• 
  Steinberg Cubase 7 & Cubase Artist 7 controller for leap motion
  
  • 
    https://apps.leapmotion.com/apps/cubase-ic-air/weblink
    
• 
  Review
  
  • 
    What can you say its Steinberg & Cubase!
    
  • 
    Does not surprise me that the first Music development company To deploy with Leap Motion. They are integrated in almost all of Roland's product suites & every other major music Hardware\Software vendor.
    

• 
  Steinberg & Cubase integrates well, with legacy & current MIDI hardware. Steinberg & Cubase is amazing an easy. It’s also, rare to find a MIDI mapping that is not already in the preset list when connected with MIDID to USB.
  
  • 
    Support of Hardware vendors with Steinberg & Cubase is & has been amazing from my experience since the early 2000’s.
    
• 
  One thing I noticed with Cubase iC Air
  
  • 
    Platform: Web link & Steinberg eLicenser
    
  • 
    wondering if there could be come cool HTML5 or Unity integrations in the future for simplistic music creation for Web based gaming?
    

• 
  Online podcasting or stream live broadcasting, don't know but cool app from one of the legendes in this industry Steinberg always a Pioneer for new area Dev.
  

• 
  GECO doesn't produce or manipulate sound directly, its purpose is to control other software or hardware that understands MIDI, OSC or CopperLan.
  
  • 
    https://apps.leapmotion.com/apps/geco-midi/windows
    
• 
  CopperLan
  
  • 
    Creates virtual MIDI ports to connect to standard MIDI applications
    
    • 
      http://www.copperlan.org/index.php/download
      

• 
  Note:
  
  • 
    Geco MIDI does not create music - it a gesture MiDI controller that modulates the MIDI signal sequences between MIDI based Instrument
    
  • 
    The Geco MIDI/OCS/Motion & gesture controller does offer some unique integration capabilities when leveraging CoppereLan to extend Geco motion application manipulation integration to legacy hardware & across multiple MIDI devices with the virtual port capabilities of CoppereLan
    
• 
  Geco - Leap Motion Video
  
  • 
    show cool capabilities
    
    • 
      but are misleading as to the true usage for the Geco MIDI/OCS widget is not a sound creation
      
  • 
    DJ SelArom Creates Live Music with Geco MIDI
    
    • 
      https://www.youtube.com/watch?v=OcnrPbKCVSk
      
  • 
    Creating Live Music with Leap Motion
    
    • 
      https://www.youtube.com/watch?v=N8uFiJZpkgY
      

• 
  Review
  
  • 
    the Geco application does offer an insight into where the future DJ\VJ Integration is going. However, this capability off manipulation to sound has been around for many years with Roland’s Drum machines that were integrated with D-Beam.
    
  • 
    Thus our usage of the Geco application was nothing more than another effect processor layer, for individual MIDI unit in Parallel to the Roland’s SP-555 D-Beam that applied as a master effect.
    
• 
  The Roland’s D-Beam currently one up the Geco application widget as it offers the ability to create sounds...with hand gestures while the sounds it creates are cheesy and a bit annoying unless you know the Theremin controller pitch’s.
  
  • 
    So giving this review Geco a solid thumb up for cross-platform capabilities and I see good thing with Geco.
    

• 
  What is the D Beam controller?
  
  • 
    http://roland.com/support/article/index.cfm?q=faq&p=V%2DSYNTH&id=1831585
    

• 
  Tekh Tonic is an OSC/MIDI control interface reimagined for today’s high-tekh motion capture input devices
  
  • 
    https://apps.leapmotion.com/apps/tekh-tonic/windows
    
• 
  Review
  
  • 
    Tekh Tonic One ups the Geco MIDI with the ability to manipulate sound & the Grain Plane synthesizer available within Tekh Tonic's Morph controller.
    
  • 
    Grain Plane turns any sound you load into it into a rich, gesture-controlled pad. Similar to the Roland’s D-Beam functions on some legacy samplers & Drum Machines, which the One up as well. Offering ability to load individual, sounds of your choosing.
    

• 
  However, the MIDI Controller capabilities are only supported on OCS/MIDI supported units & applications.
  
  • 
    Thus the competition Geco MIDI/OCS one up's and would be my product of choosing at this time because of the cross platform and overall extendibility with the CoppereLan product suit
    
• 
  Even with them being the same price, and I have plenty of other music instruments and would rather use more legacy application\Instruments with the Leap Motion MIDI/OCS then another virtual synth.
  
  • 
    However, If the competition is any sign of the future to come Tekh Tonic's Morph controller is a solid product for anyone needing an added Instrument with MIDI capabilities and a Ableton Live user, Grain Plane synthesizer could meet your needs.
    

Our Finalized Setup for 3D Jam

• 
  Documents about our Project Blue Print Diagram on our Microsoft One drive
  
  • 
    View - Permissions
    
  • 
    http://1drv.ms/1lcIzes
    

• 
  There Leap Motion hardware controllers
  
• 
  Leap Motion or Unity app capabilities of controlling Windows computer mouse
  
• 
  Mixed in Key Flow 8 Application
  

• 
  There Leap Motion hardware controllers
  
• 
  Leap Motion or Unity app capabilities of controlling Windows computer mouse
  
• 
  Native Instruments F1 Controller w/ Traktor Pro 2 software
  
• 
  Yamaha MG10xU Mixer, added for Effects application & its design to record audio for upload to sound cloud, which we leveraged for stems-music stem recording
  

• 
  Roland’s Motion Drive Tokyo software connected installed USB to hardware controller
  
• 
  Motion Dive Tokyo Hardware controller USB to Roland SP-555
  
• 
  V-Link SP-555 instrument connected direct from Motion Dive Tokyo with a XLR cable.
  

• 
  Gibson Cakewalk Sonar application
  
• 
  This computer will recorder the live mixes in real time that are being sent from the Master Mixer to computer via RCA to 1\8^th inch jack.
  
• 
  This allow for the compliance for Native Instruments Stems-Music creator tool. Which requires 4 individual audio files and a Master Mix File.
  
• 
  The leap motion controller hardware on this box is optional, since the design was to capture the audio stream
  

Methodology behind why we used this configuration

An AR Head Mounted Device would have been Ideal for the DJ\VJ operators.

• 
  This way at a live event, User can physical see functionality of real application that the DJ\VJ have set for augmented display from the music workstations.
  

• 
  Allowing users to validate the artist is using real-time software for live performance.
  

• 
  Music
  
• 
  Video
  
• 
  Augmented projection mapping
  
• 
  As well as Broadcast streaming
  

• 
  CPU
  
• 
  But the biggest issues are the GPU become saturated & over loaded till it can’t handle the processes.
  
  • 
    then lock the Monitor display until GPU load decreases.
    
• 
  This however fails to happen since the Visual affect will keep moving in a real-time loop until the computer is rebooted
  
• 
  Unmarking CPUs on multi core systems did have a positive effect on the added load a single computer was able to absorb.
  
• 
  Broadcasting the event through Microsoft’s Office 365 services, also assisted in lowering the load experienced as the Broadcasted connection requests were not leveraging the computer being used for the live performance
  

Since we leveraged so many platforms like:

• 
  Gibson Sonar
  
• 
  Korg,
  
• 
  Mix In Key
  
• 
  Native Instruments
  
• 
  Pioneer
  
• 
  Roland’s
  
• 
  VDJ display
  

Then configuring each of the isolated platforms with a standalone Computer, Mixer, & other desired device (effect processer, MIDI Interfaces) allowing for products & platform Isolation.

We found the MIDI clocking of same product was more accurate & the non MIDI interfaced drum\synth modules were more successful to Live Artist timing with is set in the platform based isolated\segmented network design.

• 
  When in a production studio work environment lowering this cost overhead, for studio recording time…by not missing cue causing retakes.
  
• 
  Example, we found that the Korg MIDI devices were almost 300 milliseconds off from Roland’s devices & a MIDI merge devices would be required to keep the accurate
  
  

• 
  we then loop the Master Mix through an Analogy EQ, back into its self-using (tape records out\in functions)
  

Offer’s expedited ability to press vinyl & gives a Master Mix Steam-Music file required for our Native Instruments Stems-Music creator tools. Isolated Digital Stems files, are created on each of the platform isolated network computers we used. So the artists can leverage the stems audio files if a digital audio file is requested, however most of the artists still prefer Analog samples for live mix processing, since affects & converting to digital is easily done in their own live mixes.

• 
  Some people think Dj, only use Native Instrument Traktor or Serato scratch with CD\Loops & Sync Timing, through MIDI clocking
  
• 
  or if Artists have a vinyl, show most of the Fans have little clue the vinyl played can be pre pressed from production track mappings during a studio setting.
  
• 
  To be performed as trick mixing sets, which is a 2 to 4 turntable event, using vinyl records to remix tracks back and forth.
  

Purchasing drum machines, to preform remixes and samplers for live loop creation during the events, extended the enjoyment of trick mixing.

• 
  The time has finally come where the drum machines are unable to be replaced & the value has gone from 450$ to worth 2400$ for example on a Roland’s 303 or 808 drum machine.
  

• 
  There’s also was that overhead for paying the cost of scratching records,
  
• 
  Pressed DJ vinyls were typical 50 play because DJ presses we lower cost. Since they were super thin
  
  • 
    if it was not for that wet scratch sound that made the thin DJ pressed vinyl popular, they would always useful as a Frisbee for Fans
    
  • 
    Scratching, other vinyl records can cost a wide range depending on popularity availability, in today’s age let’s, just say there not 0.1 cents like they use to be from Columbia house.
    
    • 
      It’s rare you find a single under 10.00 anymore,
      

• 
  However, if you are attempting this DJ\VJ challenge the once the network is complete & you have selected from the application & loop samples we provided you free.
  
• 
  The network design you will use is done,
  
  • 
    Then the samples for the audio & video have to be timed ensuring proper, MIDI clock timing was setup for the final show.
    

Client viewing will need for Skype Live Meeting Broadcast:

• 
  Unity Web browser
  
• 
  http://unity3d.com/webplayer
  
  • 
    Rendering and Special Effects in Unity setting configured
    
    • 
      Special Effects with Depth, setting configured properly
      
  • 
    Unity setting for Full screen if desired
    
• 
  Option for other devices can enable Broadcast keys
  
  • 
    Unity Setup for Broadcasting
    
  • 
    Unity setting for Full screen if desired
    
  • 
    Unity configurations for WWW
    
  • 
    Microsoft app store Skype, Skype for business. Or Lync meeting
    

It's time to play

Once the music kicks in, the screen display shows the Virtual 3D Graphical Arts Videos, sync with the Roland’s Motion Drive Tokyo. Which will connect via Roland’s V-Link allowing the Motion Dive Tokyo video a real time tempo sync with the SP555 instrument.

were designed to allow for the comparison with Mix In Key Flow leveraging already spliced Stems & Native Instruments Traktor Pro using F1 controller and Yamaha MG10xU MU10 mixer for effects to create stems compliant audio & illustrate the DJ\VJ fan experience of the future.

We found that allowing for a Parallel Multi DJ music production using both Native Instruments & Mix In Key features as a Dual DJ was more enjoyable in which offered capabilities such as:

• 
  Live musical collaboration
  
  • 
    By leveraging both musical application in Parallel extended the CueUps provided creativity and sharing of audio samples with each other that the other person testing did not have
    
• 
  DJ Battle style play
  
  • 
    Where we created remixes and audio compilation then used a pump it or dump it style of judging to determine which version was better
    
• 
  DJ Mix Off type play
  
  • 
    Where you have to find relevant & compatible audio based on what the other artist played that utilized Vocal samples & beat on beat Live (Mashup\Remixing)
    
  • 
    Along the way using the Dual DJ method
    
    • 
      It was found that a buy product of testing was offering an automated method for creating STEMS-Music Compliant audio files.
      
  • 
    Capabilities to test Leap Motions application stores (Music and Visual) applications
    
    • 
      Offering a Parallel head to head comparison of similar products was very nice
      

• 
  Native Instruments Native Instruments
  
  • 
    F1 Controllers using
    
  • 
    Traktor Pro software
    
  • 
    Stems music creator tool
    
• 
  Yamaha MG10xU
  
  • 
    Used as an affect processor
    
  • 
    As well as send audio from Native Instruments Traktor Pro to Master Mixer
    
  • 
    Its feature for recording audio played, was leverage to obtain Isolated recorded stems from the Native Instruments Traktor Pro2 audio
    

• 
  Master Mixer to Analog EQ
  
  • 
    Design to generate & convert the Digital Audio to Analog
    
    • 
      This was for the ability to Have an Analog Master file
      
  • 
    The data was then transferred to Cakewalk Sonar
    
    • 
      Which recorded the master Stem compliant file needed for
      
  • 
    Native Instrument Stems-Music creator tool compliance
    

• 
  Mix In Key Flow 2 & 2.5 referred to as (flow 8)
  
  • 
    Usage with Leap Motions Windows control abilities
    
  • 
    Also using MIDI configured setting with
    
    • 
      Native instruments Maschine
      
    • 
      Native instruments Mikro
      
  • 
    Flow 8 by far accelerated live mixing and CueUp of Tracks & Stems vs Flow 2
    
    • 
      Flow 2 solid application however was limited to 2 track CueUps
      
  • 
    Both Flow applications allow for connection with VST plugins
    
    • 
      Offering usage with come cool legacy Open Source Instruments & Effects
      
• 
  Gibson Cakewalk Sonar
  
  • 
    This application was set on an Isolated computer to recorded the Master Mix from all channels, this was used to create an analog audio copy of the complete Mix from all workstation.
    
  • 
    This was done, Because the Native instruments stems music application requires a master audio copy.
    
    • 
      Since each workstation records their Isolated mixes and then also set each song or loop used in the mix in to a folder on the device, we were able to functionally load, play & records all Native instruments required stems music files samples needed.