NODE13 – Forum for Digital Arts, Documentary from NODE Forum for Digital Arts on Vimeo.

Here’s some ambition in an event description: NODE, the Frankfurt digital arts festival, is interested in how circuits and code are transforming the world around us. And unsatisfied with just talking about it, they get a group of people together who are doing it.

NODE is built around vvvv and includes a lot of technical content around that Windows graphical programming tool, but it also incorporates work from a variety of techniques and tools – even some analog ones.

This video from out of the German gathering neatly packs a lot of the ideas around the conference into ten minutes of time. There’s plenty to digest: a sampler that might still leave you full. And you’re likely to see some familiar faces, as well.

Description:

Paoloreste Gelfo and his team of ambitious videographers followed every stage of the festival and
have taken hours of video footage, to create a documentary about NODE13. NODE is a biannual reunion of vvvv developers, users, artists and activists. It is an international platform, with talks, workshops and an exhibition. A platform to share knowledge and to meet each other- also away from keyboard.
Direction: Paoloreste Gelfo paoloreste.tumblr.com/ and vimeo.com/user5329150
Editor/Colorist/Graphic: Antonio Labbro Francia vimeo.com/user3449801
Music: Edisonnoside soundcloud.com/edisonnoside
Production Coordination: Jeanne Charlotte Vogt
Camera: Constantin Urban, Paoloreste Gelfo, Markus Haertel, Yannic Bill
This video was made possible with the help of
meso.net
wirmachenbunt.de
m-box.de
vvvv.org
Commisioned by NODE Verein zur Förderung Digitaler Kultur. node.vvvv.org

The new, svelte-looking Kinect. It’s not that it looks better, though, that matters: it’s that it sees better. Courtesy Microsoft.

It’s a new world for media artists, one in which we look to the latest game console news because it impacts our art-making tools.

And so it is that, along with a new Xbox, Microsoft has a new Kinect.

The new Kinect uses standard infrared tracking (ideal for in-the-dark footage and accurate tracking), but also returns RGB imagery. It’s 1080p, 30-60 fps (it seems tracking is at 30 fps and video at 60, but I’m reading conflicting reports). Hands-on reports say latency is reduced. If the finished product is consistent with rumors, that could be owing to more in-hardware tracking analysis; once you get to trying to do the analysis on the computer (or console), you encounter additional bottlenecks. Now, musical readers have much greater expectations of low latency than gamers, though, so it’ll be interesting to see this in practice.

The big news is tracking that gets closer to your body, breaking analysis into smaller bits. Wired, granted exclusive early access, goes into some detail about the way the tracking tech has changed. Instead of a straight depth map created by producing a 3D picture of two separate infrared-based camera images, the new tech uses “modulated” IR light. Given that this is new technology, I’m not yet clear on the specifics of that, and would love some reader feedback. (Ahem.)

The original sensor mapped people in a room using “structured light”: It would send out infrared light, then measure deformities in the room’s surfaces to generate a 3-D depth map. However, that depth map was lo-res to the degree that clothing and couch cushions were often indistinguishable. The new model sends out a modulated beam of infrared light, then measures the time it takes for each photon to return. It’s called time-of-flight technology, and it’s essentially like turning each pixel of the custom-designed CMOS sensor into a radar gun, which allows for unprecedented responsiveness—even in a completely dark room.

Xbox One Revealed [Wired.com]

Say what? Well, the basic idea is that, by using a modulated beam of light, you can determine the depth of an object by measuring the phase shift between the emitted and received light. In fact, this is very similar to the way a single IR or (with sound) ultrasonic sensor works, only using a pixel array instead of just one emitter. You can read a paper on the subject, or follow a forum discussion on the B3D board. (Thanks to Sam Tuke for posting this. Now – specifics, still, could be interesting.)

The upshot to all of this is better tracking:

• More discrete people can be tracked independently, without having to add more Kinects (as some hackers did) – up to six, says Microsoft. And that includes tracking people if they cross one another – a major breakthrough.
• It’s easier to distinguish between people and objects (like your couch).
• Individual gestures can be tracked – facial gestures, or finger-by-finger tracking (as touted by other systems like Leap).

What’s missing so far: any word of how hackable the new system will be. The last time, it took hackers to get access to camera images and tracking data, even as Microsoft themselves lagged in providing an SDK for Windows. I’d like to see more openness this time, especially given how much of the hype about Kinect has been generated by hackers – and knowing that Microsoft would like more inventive independent game design (or even art) with their tool on the Xbox platform.

MIT Technology Review is evidently waiting, too:

What Will Hackers Do with the New Kinect?

That article is largely speculative, as is mine. But I can tell you, even if you aren’t planning to use individual finger gestures and the like, anything that provides more precise tracking or reduces latency will help applications and art, generally.

And that makes this look very good indeed. Here’s a hands-on video from The Verge, for a quickie:

WIRED goes into more detail:

We’ll be watching – particularly on the hacker info. If you know anything about the development picture or can make sense of this modulated IR business, please do get in touch!

There’s a reason for Processing’s popularity. By making code simple, elegant, and direct, and catering directly to the kinds of visual ideas creative people have, the environment has made programming accessible to artists and designers in a way nothing else could.

Coding no longer has to be a source of fear, or a bad word.

But Processing, years into its life, has also badly needed a refresh. 2.0 is more than just a house cleaning. It’s a new direction, with “modes” that mean it’s no longer tied to old desktop Java architectures. (See a tantalizing screenshot below – with the click of a menu, you can make CoffeeScript JavaScript for the Web, or run on Android.)

I still love Processing as a way of sketching out ideas, and with strategic use of the GPU in its now-native OpenGL rendering, it can also be surprisingly high-performance.

Of course, that 2.0 reboot has been a long time coming, enough so that you might have even forgotten it was enroute. That’s why the recent 2.0 beta 9 is big news. It includes some major new features that finally reveal what 2.0 is all about – and bug fixes that have been a long time coming. In fact, it’s that moment when the betas stop looking so much like betas. Here’s what to expect.

New in this version: an all-new interface. Things do look prettier, including a new icon, but it’s under-the-hood changes that matter more. You can install a command-line tool for building Processing sketches easily with any tool you like – such as your favorite text editor. Modes, now as separate projects, hold the promise of getting speedier updates than they would if everything had to be rolled into Processing proper. And a succession of changes make things like finding examples easier — some kindly rolled retroactively into the stable 1.5x sequence, but which, added together, make this a very friendly environment.

Other major changes accompany this release:

• An official JSON library.
• MovieMaker finally works again, for recording your work. (Syphon and that library will work, too, of course, but this is nice to have anyway.)
• Vastly improved and streamlined data classes – good news for data visualization and the like.
• 2.0b8: Windows 8 and Retina Display fixes.
• 2.0: Built-in video library that really works (and, again, with the GPU can actually work really well – think HD mixing on lower-end machines).
• 2.0: Core OpenGL library for all rendering – with super-fast results.
• 2.0: Table support for easy data processing, plus improved XML support.
• 2.0: Native 32-bit and 64-bit support.

For more detail, see:

An overview of what’s changed in 2.0

A detailed changelog with every little bug fix and improvement

I think it’s the better integration with the community that may make the biggest different, which we can see visually.

For instance, the update manager now automatically installs supported libraries as they’re improved:

The mode manager supports targeting things other than just desktop Java – addressing one of the biggest complaints about Processing as the years have ticked by (though, I will say, it is useful having Java library support, and that can still deliver searingly-fast performance when you’re doing mostly OpenGL things):

Oh, and there’s a new letter “p.”

processing.org/download/

4 ways to sync VDMX and Ableton Live from Studio Rewind on Vimeo.

Frequently asked question? Maybe incessantly-asked question.

Live performers simply want a way to have more intimate relationships between music and visuals onstage. That means whether they’re working solo or with a live visualist, being able to get useful signal between music and visual tools and performance elements.

Livegrabber has got to be about the easiest way to do this I’ve seen yet. It’s actually a suite of plug-ins for Ableton Live’s Max for Live environment that spits out OSC (OpenSoundControl) messages to any visual tool that can respond.

And as you can see in the video, the results are both effortless and profound.

It’s best seen in this example with VDMX. (Any OSC tool will work – I’m rather keen to code around this with Processing, for instance, just for kicks. But speaking of VDMX, that superb tool is on a fire sale for a hundred bucks this month; act fast!)

The basic elements:

Sender: sends a bunch of OSC
Receiver: receives a bunch of OSC
ParamGrabber: here’s where things get interesting — connect to any parameter in Live
TrackGrabber: here, pull track-level parameters (like triggering clips)
AnalysisGrabber: this does more conventional audio spectral analysis
VoidGrabber: perhaps the most fun, you can use Automation and Clip Envelopes to send discrete information output for visuals
SingleNote: here, you can dig into individual notes – but with assignment that could theoretically be easier than simply using whole MIDI streams (which can be too much data)

The ability to go fine-grained, for solo performances or instances that need lots of synchronization, all the way to larger grain, when you just need particular cues to pass off to a visualist, seems really nice. And with Max for Live now in Live Suite and on more Live machines, this should also be a boon to audiovisual collaborations.

And if you can find a live visual performer with whom to collaborate, it gets all the more powerful.

Now in free “beta” (no word yet on what they’re planning to do with pricing long-term):
http://showsync.info/index.php/tools/livegrabber/

Lots of other amazing-looking Live-based visual/lighting tools, too many to mention:
http://showsync.info/index.php/tools/

Thanks, David Lublin and Dave Gutt for the tip! (Dave endorsed!)

Call it laser mapping.

Melbourne-based artist Jayson Haebich has rendered in thin air, literally, architectural forms in color. He uses custom software to map lasers through particles to produce an ephemeral sculpture of air. The results are gorgeous – frozen digital motion.

From his description:

These are a series of static light sculptures that have been created using laser light, smoke, shadows, physical shapes and custom built software to create complex compositions of shadow and light that play with the sense of depth and perception. These pieces challenge the observers idea of perspective and ask them to consider what components of the installation are physical objects and what are non physical objects such as light and shadow. These sculptures fill the room with light and colour creating an almost mesmerizing effect as the beams of precisely mapped light from a laser cut through swarming particles and haze suspended within mid air to create almost solid looking planes of illumination.

These pieces were created using custom built software that is used to map out physical features using a RGB laser and was created using OpenFrameworks.

He tells CDM more about his intentions and inspiration:

The main motivation behind these pieces is to use non-physical elements such as light and shadow as components of a solid-looking sculpture. They are quite simple in design: I place blocks and columns throughout the room and then map these out with my laser software. This enables me to create several effects such as having the columns stop the laser beam directly, or having the columns cut the laser beam in certain spots which, due to the contrast of the very bright laser, creates dark shadows that themselves look like they are made of some kind of physical object. There is also a smoke machine, which makes the laser beam easier to see as well as enhancing the atmosphere of the space.

These pieces (and my other works) are heavily inspired by Anthony McCall‘s light works such as “Line describing a cone” and “Cone of variable volume”.

To me, this strikes at some of the essence of the reason we work in digital media. In these immaterial forms, he bends perceptions to their outer boundaries. Beautiful work; see the whole set:

http://www.jaysonh.com/vector.html

Take your visual app. Take a parameter. Now control it with timelines and automation – anything, anywhere.

The appeal is clear for visualists, particularly with built-in options sometimes limited. Now, sequencing control – clocked to MIDI – can take on powerful new dimensions.

Vezér isn’t the first app to go this direction, by any means. I’ve admired in past the insanely-powerful IanniX, for instance. But then, “insanely powerful” isn’t always what you want – particularly if that depth just drives you insane trying to do something simple. Vezér, just now entering beta, promises to be a bit simpler. And coming from the developer of CoGe, it also arrives from a coder with a track record.

We’ll be watching for this to come out, but in the meantime, its creator gives CDM a first look. Details:

Vezér is under development, no public beta available yet.
You can have any number of compositions and each composition can contain any number of tracks.
There are different track types in Vezér, like single Midi CC message or Midi CC range.
Vezér supports Undo/Redo in the whole application and also supports Copy/Paste of keyframes.
The playback speed of a composition is adjustable and can be synchronized with a Midi Clock.
The resolution – FPS – of a composition can be set.
Vezér supports sending of Midi CC messages.
Different interpolation can be set for each keyframes.
Vezér support recording of incoming Midi signals.
Vezér can be controlled via Midi or OSC.
Vezér is a 64 bit application for Mac OSX 10.6 or later.
Vezér will be a commercial application.

Developer Tamas Nagy explains that ease was part of his goal:

And maybe that is the key of Vezér. I really trying to make it very easy to use but also powerful. My goal is keep it simple at possible, I want to users feel its just a tool, not something other complex 3rd party software which needs a lot of time to setup That why I chosen MIDI support instead of OSC for the release, because it -almost – does not need to anything to make it working – but yeah, OSC will be supported in a future release for sure. And other important thing from my point of view, its not “just” a timeline, where you can set up when your clips will be triggered, but more likely a tool for setting up predefined MIDI actions for your performances. Likely in this article, but without recording – sending actions to applications:

RECORD AND PLAYBACK MIDI IN COGE, MODUL8, RESOLUME AND VDMX [Vezér Blog]

Ah, color me interested on that. Keep up with the latest on the new app site:

http://www.vezerapp.hu/

Body mapping and dance/visual fusions are still explored only in fits and starts, compared to the extent of live music and visual performance in other media. So, it’s encouraging to see this latest experiment from dancer Christian Mio Loclair. Working with Microsoft’s Kinect, the slowly-undulating tendrils of visuals behind him create visual counterpoint for headstands and hip-hop dance techniques. Far from running up against latency, here there’s a sense of visuals that answer the moves with a slow sigh, creating a kind of living architectural space behind him.

The tools:

• ofxOpenNI and ofxCV work with OpenFrameworks to analyze imagery from the Kinect camera.
• MSAFluid for OpenFrameworks by our friend Memo Atken again provides visuals (actually, some of you probably already spotted it)
• ofxUI adds the UI.
• vvvv (“V4″) is used for calibration; see Christian’s blog post for more tips on making the most of calibration technique, and don’t miss the Elliot Woods tutorial that inspired him.

Christian muses to CDM, “I am very convinced that especially the Kinect and the upcoming Kinect 2 will change the way dance will be performed. I hope I can contribute to this development … just some streetdancers, hackers and a Kinect. I wanna see how far we can get by open source Code, own code and Open Dance.”

More:
flow no. 1 | kinect projector dance

Blast from the past: this color organ is from 2007. But it’s a beautiful demonstration of light and sound, fused into a single interface, and thus worth mentioning as I pull together notes for a talk at Mapping Festival tomorrow here in Genève. Compare the 60s-vintage Lumigraph of Oskar Fischinger, which I write about today on Create Digital Music.

In gooey pinks and purples, traced with imaginary sparks, the game controller-manipulated system resembles looking into the heart of a great jellyfish made of plasma.

Lightbender v2 – audiovisual instrument from Sixth Sensor on Vimeo.

From the notes, as well, are some nice thoughts and references on other “painterly” av interfaces and color organs, including the PhD dissertation work of none other than Golan Levin.

Worth reading:

Lightbender v2 is an audiovisual instrument developed for four players each controlling the expression of a color and a tone. It was exhibited at the contemporary music festival Sound Around (2007) in the Plex music theatre in Copenhagen.
The instrument incorporates a half sphere shaped water tank that serves as a semi-3D video screen. A particle system is projected into the tank leaving illuminated traces in the water. The sound is based on an additive fm synth with filtered white noise. Synth parameters are mapped directly to the behaviour of the particle system. The sound is emitted from four speakers in a surround set-up where the panning of the sound fits the position of each player and the movement of the particles. The physical interface consists of four modified game pad controllers.
The first version of the instrument which was built for the exhibition Social Aktion (2007) at The Museum of Contempoary Art in Roskilde had only visual output. The initial idea was to engage people socially in a musical experience by enabling the control of visual expressions while listening to a selection of the museums extensive sound art archive.
Building color organs is no novel idea. The first in this family of instruments is the Clavecin Oculaire completed by Louis-Bertrand Castel in 1734, but the idea of audiovisual coherence dates even further back (Peacock 1988). Since then many have followed, most notably (I think) Thomas Wilfred’s Clavilux from 1919.
I’d like to thank Golan Levin for compiling a brief a historic overview in his PhD thesis from 2000. Thanks also goes to Morten Søndergaard, for the invitation. Museet for Samtidskunst, for providing materials. Daniel Høier Øhrgaard, Morten Carlsen and Thomas Sørensen for general help. Marie Louise Andersson, for game-pad modification help. Michael Edinger, for help with the electronics. Enrico, for lots of practical help at the museeum. Dennis Paul, for teaching me a bunch of Java tricks. Christian Riekoff, for providing the procontroll library.
Peacock, Kenneth: Instruments to Perform Color-Music: Two Centuries of Technological Experimentation. Leonardo 1988. Vol. 21, num. 4, p. 397–406.
Levin, Golan: Painterly Interfaces for Audiovisual Performance. PhD thesis MIT 2000.

The project is the work of Copenhagen-based Sixth Sensor, aka Carl Emil. Loads of other projects to explore of his, as well.

Lightbender

Nail the finger fireworks of a particularly hard Rachmaninoff, and you may well feel like blasts of light are shooting out of the piano. But to give the audience the same sense, a DIY instrument made of cardboard and homebrewed responsive lighting translates that keyboard virtuosity to an optical show. Reader Aylwin Lo sends us this project out of Canada:

Rachmaninoff’s Étude-Tableaux Op. 39 No. 6, as performed by YT//ST’s Brendan Swanson from Aylwin Lo on Vimeo.

I’m with YAMANTAKA // SONIC TITAN. We’re an art collective based in Toronto and Montreal that is most known for making music and putting on dramatic live shows. People like Pitchfork, Vice, and MTV Iggy have nice things to say about us.

We made a video of our keyboard player pulling off a notoriously-difficult Rachmaninoff composition on a special piano we constructed
from an electric piano, a cardboard baby-grand shell, and a homebrew, Arduino-based LED-controlled light rig, and we thought you might like it.

You thought right. Now, if you want to play piano like this, you … uh, have some practicing ahead. But in a novel twist on crowd-funding rewards, they’re also using this very artist to help – even as they work on a video game. (Stay with me here.)

We’re partly doing this for an EPK we’re putting together, but also to promote a perk on the Indiegogo campaign we’re running to finance the development of a videogame we’re working on, called YOUR TASK // SHOOT THINGS. That perk is piano lessons with our keyboardist:
http://igg.me/at/ytst

Clever.

Here’s a look at the game.

YOUR TASK // SHOOT THINGS Trailer from Aylwin Lo on Vimeo.

Music and gaming, sound and immersive lighting converge again!

Entropy never looked this good. Or, certainly, it looks a lot better than when I broke that beer glass. (I know, I know: there are reasons why we don’t want to live in a universe where doing that would make the glass re-assemble itself from its fragmented shards.) Photo courtesy the designers.

In an elegant, balletic dive, taking an almost impossibly-long span of time, a single droplet of water falls and splashes, an animated logo peeking out from the inside. But it’s what isn’t there that may surprise you. There’s slow motion camera behind the scenes, meaning the usual way of doing this is absent.

Instead, what you’re seeing is a stop motion time lapse – a record of the shifting patterns of entropy in nature, thousands of different droplets appearing as connected that in reality are not. It’s a trick of animation and high-speed lighting, not high-speed photography, stroboscopic illusion.

And it’s a fun DIY project, to boot. 3D and robotics? Okay, we’re in.

The Barcelona-based studio that produced it shares not only the animated result (including a logotype for design mag IdN, but also a short film explaining the making of. Physalia’s Belén Palos writes us:

We got your contact through Alex Trochut, who shares studio here in Barcelona with us. We are big admirers of Create Digital Motion, so we would love to share with you our new piece Entropy, a joint effort from our 3D division and robotics Lab, in which we created a system to capture the fall of a water drop without a slow-mo camera- with replacement animation mapped inside the drop! There’s an Arduino involved, as well as our self-developed Motion Control.

Watch the results:

Entropy – IdN Magazine v20n2 from Physalia Studio on Vimeo.

And then the making of:

Making of Entropy – IdN Magazine v20n2. from Physalia Studio on Vimeo.

For all the gory details, they’ve got a terrific post explaining how they came to this project and how they pulled it off:

Entropy – Long version [Physalia Blog]

In brief, though, the ingredients:
1. A laser beam-photodiode, to detect the water.
2. A “Photoduino” Arduino circuit. (Be sure to read the blog post to avoid burning out optocouplers.)
3. A DSLR, the camera the trigger circuit will trigger.
4. A custom-built water course made by hacking a medical drip.
5. A motion control rig that tilts the camera’s lens with the water.
6. (My favorite part) a servo whose sole job is to tap keys on the keyboard for serial communication via Arduino. And it’s inspired by Homer from The Simpsons – the best kind of hack.
7. A whole mess of Arduino code.
8. Some conventional digital animation, then mapped to the photos.

Fantastic. Hope we see more from this crew.