TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Musical User Interfaces

274 点作者 acarabott大约 8 年前

20 条评论

archagon大约 8 年前
Speaking of experimental music interfaces: if anyone is interested, I made an iPad app called Composer&#x27;s Sketchpad[1] to explore a more freehand process for musical composition. Instead of placing note symbols on a stave, you draw notes on a continuous time&#x2F;pitch grid using your finger or the Pencil, bending to any pitch and extending to any length. Makes it super easy to jot down complex rhythms and bendy guitar solos in an instant. I&#x27;m working on other things right now but I hope to come back to it in the near future to add MIDI support, microtonal grids, repeating sections, and other features.<p>[1]: <a href="http:&#x2F;&#x2F;composerssketchpad.com" rel="nofollow">http:&#x2F;&#x2F;composerssketchpad.com</a>
评论 #14119341 未加载
评论 #14118874 未加载
pierrec大约 8 年前
One of the musical UI elements I always rant about (here we go...) is the global modular view, which is a way for a DAW to show you everything that&#x27;s going on in your project. It should show the project&#x27;s complete signal routing. This is particularly useful for electronic genres (as opposed to acoustic&#x2F;instrumental genres, where the traditional rack-based paradigm is well adapted).<p>Here&#x27;s an example: <a href="http:&#x2F;&#x2F;www.lazytrap.com&#x2F;img&#x2F;cut_four_isolated.png" rel="nofollow">http:&#x2F;&#x2F;www.lazytrap.com&#x2F;img&#x2F;cut_four_isolated.png</a><p>Every DAW has an internal graph of how everything is routed together: the waves you put on your timeline, every effect and synth, etc. I just want that graph to be exposed, visible, and freely modifiable.<p>The problem is that DAW makers and users seem very attached to interface elements that are somewhat incompatible with this paradigm: mostly the track mixer and &quot;insert effects&quot;. This requires the DAW to manage the routing behind closed curtains and hide everything behind layers of abstraction that I consider unnecessary and often opaque.<p>There&#x27;s a variety of weird tradeoffs that are made to get modularity while still having these traditional features, like per-track modular views (eg. presonus), modular views contained inside plugins (eg. bidule, reaktor). While these are nice in their own way, I find that nothing can replace a global, freely modular view. The bee&#x27;s knees is when you can nest it arbitrarily like Reaktor does (as a plugin). If I want a mixer, I can place it myself in the modular view.<p>Does any DAW do this? So far I&#x27;m using Buzz, which pulls this off perfectly, but has its own limitations (no good pianoroll, no arbitrary timeline placement...). From my rather extended foray into the topic, I&#x27;ve found that Mulab seems to fit the bill, though I&#x27;m not sure. Some software like Max&#x2F;MSP, PureData, and Usine are 100% centered on modularity, but they cheap out on the &quot;timeline&quot; aspect, which I find very important when I&#x27;m working with lots of samples and video.
评论 #14119592 未加载
评论 #14118516 未加载
评论 #14121623 未加载
评论 #14118661 未加载
评论 #14119221 未加载
评论 #14119781 未加载
rl3大约 8 年前
Music production software is home to some of the most complex and inventive UIs out there, so significantly improving upon the status quo is <i>tough</i>.<p>As an aside, when looking for Qt alternatives a few months ago I stumbled upon JUCE.[0] Prior to that I had no idea there were general purpose UI libraries with such heavy emphasis towards music creation. Granted, the cross-platform support was quite lacking, but perhaps things have improved since.<p>[0] <a href="https:&#x2F;&#x2F;www.juce.com&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.juce.com&#x2F;</a>
评论 #14119323 未加载
评论 #14117438 未加载
评论 #14117427 未加载
评论 #14119630 未加载
mrkgnao大约 8 年前
Didn&#x27;t someone (well-known on HN) write an essay with descriptions of UIs that would be controllable using Solresol-ish voice commands​, with more advanced users using three-or-four syllable commands up from the monosyllabic ones for lay users?<p>It was a very 90s website.<p>Edit: found it. <a href="http:&#x2F;&#x2F;www.erasmatazz.com&#x2F;library&#x2F;the-journal-of-computer&#x2F;jcgd-volume-9&#x2F;little-languages.html" rel="nofollow">http:&#x2F;&#x2F;www.erasmatazz.com&#x2F;library&#x2F;the-journal-of-computer&#x2F;jc...</a>
评论 #14119532 未加载
makecheck大约 8 年前
The second constraint in the article is key: given that there <i>is</i> a computer, how can the computer help?<p>I can&#x27;t <i>believe</i> we have these ridiculous music&#x2F;sound editor UIs, full of awkward, knob-looking controls that are almost impossible to operate with the mouse. Clearly the standard <i>computer interaction</i> controls such as a menu or slider or even a text field would be easier for computer-based settings.
评论 #14119964 未加载
评论 #14119442 未加载
jedanbik大约 8 年前
This is why I get so excited about the (very rich) iOS music ecosystem: Audiobus, Ableton Sync, etc. You can see what audio is flowing into what, you can use touch to change things, and you can use Bluetooth and MIDI to outsource controls to different hardware as needed.
评论 #14117620 未加载
评论 #14117692 未加载
anotheryou大约 8 年前
I really want a force-feedback x&#x2F;y-controller. I built a prototype of a slider and it worked quite amazing at emulating physics.<p>I&#x27;m now thinking about building a passive x&#x2F;y controller with responsive breaks: I&#x27;s super hard for motors and rails to actually push against a human arm with some force, just clutching a break should be able to counter quite a bit of strength though. I&#x27;ll just have to be a little creative on how to make tough pressure sensors on the handle.<p>So I&#x27;ll have: one knob on a flat pane, pressure sensors measuring what force goes in to the knob, optical encoders to know the position of the knob and 2 or 3 motorized breaks that adjust for the correct counter-force. It should be quite easy to simulate a guitar-string that than flings away, I just can&#x27;t emulate slow relaxation of the &quot;string&quot;.
adamnemecek大约 8 年前
You might be interested in AudioKit, audio synthesis, processing, &amp; analysis platform for iOS, macOS and tvOS.<p><a href="http:&#x2F;&#x2F;audiokit.io&#x2F;" rel="nofollow">http:&#x2F;&#x2F;audiokit.io&#x2F;</a><p><a href="https:&#x2F;&#x2F;github.com&#x2F;audiokit&#x2F;AudioKit" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;audiokit&#x2F;AudioKit</a><p>Full disclosure: I&#x27;m a core member of the project.<p>Oh and also check out WebMIDIKit, <a href="https:&#x2F;&#x2F;github.com&#x2F;adamnemecek&#x2F;WebMIDIKit" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;adamnemecek&#x2F;WebMIDIKit</a>, it tries to wrap the terrible CoreMIDI APIs.
评论 #14118247 未加载
评论 #14119181 未加载
pmoriarty大约 8 年前
Virtual reality and augmented reality have so much potential for innovative interfaces. I&#x27;m really excited to see what full-featured, professional-quality music production applications will look like there.
评论 #14117563 未加载
iammyIP大约 8 年前
Musical interfaces, more than any other type of interface seem to try to &#x27;materialise&#x27;, my guess it&#x27;s to compensate for the abstract a-material nature of music. There are 2 main direction this goes, for one the super slick retro realistic renderings with lots of shaded knobs and sliders, complete with screws and even simulated rack-mounts, and then the (not so numerous) super stylised futuristic and sometimes borderline experimental interfaces.<p>For plugins, the beautiful interface with poetic descriptions could be regarded even more important (for sales) than the actual sound, thus the vst world might be the most &#x27;full of bullshit&#x27; realm of software development.<p>From my experience the best musical interface is a dedicated hardware unit. Mouse, keys, and a big screen are generally inadequate and inherently contraproductive, and a small 20x40 lcd should be more than enough as visual info.
iLoch大约 8 年前
With regards to taking an instruction and converting it into a state representation, I think creating music is very similar to programming. Coming from a web background, I&#x27;ve seen experiments like React Music which I think are really interesting. If the question becomes &quot;how can we best represent the changing state in code?&quot; Then I think that&#x27;s a question that can be solved for both interface programming and music programming at the same time. This is why I find React Music interesting: React&#x27;s declarative syntax makes it easier to understand what the final product is going to look like. Can the same thing be done for programming sound, in a way that represents the final product in a more naturally understood way?
评论 #14122211 未加载
cyberferret大约 8 年前
Speaking of innovative interfaces, I love using my iPad as a music production tool... In terms of innovating interfaces, I love Animoog from the point of view that the keyboard is not just a &#x27;press and hold&#x27; thing - it reacts to up&#x2F;down and sideways motion too, once the key is pressed - far better than trying to use a mod wheel or tweak another MIDI parameter at the same time as pressing keys. Bebot is another one with a similarly cool interface, and a lot simpler than Animoog.<p>Also, I love using NodeBeat HD - That one has a very unique 2D way of representing a beat pattern, but placing nodes and joining them up at different distances etc.
igotsideas大约 8 年前
Really love this write up. I&#x27;ve gone back to my MPC just for something different for a while but the right interface depends on what style of music or sound design you&#x27;re doing, IMO. If I&#x27;m sampling, I want something I can chop up real fast and have the ADSR and other fields on each chop. That&#x27;s why I think Ableton is one of the best DAW&#x27;s out there, workflow wise (not sound quality), because you can change up your workflow in there in more ways than one.
gtani大约 8 年前
My favorite user interface is the rubber bands i use to connect pots&#x2F;encoders on synths like mopho, ms2000 or MIDI controllers. You have to find the right length and thickness to get kind of a sigmoid acceleration curve to the connected-over knob with not too much slippage.<p>Aside from that, like many guitar&#x2F;piano people, I&#x27;m pedal oriented, I see all these new things like Elektron Analog Heat and i think, that would be a great pedal. I don&#x27;t know if it&#x27;s possible for a single pedal to control multiple parameters but if it exists I&#x27;m willing to practice dexterity for months to get the control
WWKong大约 8 年前
Here was my humble attempt to create a non-linear music interface (I&#x27;m not a musician by any stretch): <a href="http:&#x2F;&#x2F;buildanappwithme.blogspot.in&#x2F;2016&#x2F;04&#x2F;lets-make-music.html?m=1" rel="nofollow">http:&#x2F;&#x2F;buildanappwithme.blogspot.in&#x2F;2016&#x2F;04&#x2F;lets-make-music....</a><p>I have since abandoned iOS development in favor of mobile web apps
100pctremote大约 8 年前
On a related note: <a href="http:&#x2F;&#x2F;www.pushturnmove.com" rel="nofollow">http:&#x2F;&#x2F;www.pushturnmove.com</a>
crucialfelix大约 8 年前
I think the main reason for all the skeumorphisms is Gear Lust. Musicians are obsessive collectors and they can&#x27;t afford all that hardware. So plugins are like collecting trading cards. Even software that is not a replica still wants to look like the other metal plated gear.<p>I really detest screen knobs myself.
markcerqueira大约 8 年前
This post immediately made me think of Spencer Salazar&#x27;s Auraglyph. www.auragly.ph
squeaky-clean大约 8 年前
Read about half of it so far. I love exploring UI for music, so I&#x27;m happy to see this, though I&#x27;ve got to make my complaints, eh? (Also it&#x27;s a Friday :P )<p>About the &quot;tiny windows&quot; section, Fabfilter has had interfaces very similar to what they&#x27;re describing for a long time. I think they&#x27;re some of the most intuitive visual interfaces for these musical tools. I&#x27;m really surprised they weren&#x27;t mentioned.<p>Their limiter [0] easily lets you see volume before (light blue) and after (dark blue) limiting, as well as what gain reduction (red) is being applied over time and RMS (white line in the area between -10 and -16).<p>Their EQ [1] lets you see the affect each individual band has (blue and green), the overall eq curve (yellow) and frequency spectrum before and after.<p>&gt; There is a bigger underlying issue: we are making decisions that will affect the whole recording based on this tiny real-time view of the world. This is like trying to decide on which filter to use on an image by shifting a tiny square preview around the image, trying to imagine what the whole thing will look like try it below:<p>I disagree with this though. Visuals tell so little compared to your ears. It&#x27;s not like deciding an image filter by scanning a small square across an image, it&#x27;s like deciding an image filter by converting the image to a .wav and listening to the output. The Fabfilter plugins have great GUI&#x27;s but you can&#x27;t make a mix by turning off your speakers and only relying on visuals.<p>About envelopes, for example. On my hardware synths, I&#x27;m comfortable with the position of the ADSR knobs and what effect it will give. I know that if I want a plucky sound, the decay knob goes to a certain point. With visual envelopes, the shape seems more intuitive, but because they scale their lengths to fit within the display, it actually gets very hard to tell exactly how long something is just by looking. In Massive, if you turn the release up to 10000ms, setting decay between 50ms and 500ms provides almost no visual difference because it stretches the envelope graphic. So you end up using the virtual knob positions anyways and ignore the graphic for the most part. I don&#x27;t use Logic, but I get the same vibe from the screenshot.<p>You often do not want &quot;their values in proportion to each other&quot;. For example, changing attack time doesn&#x27;t change the sound of the decay&#x2F;sustain or release sections, so they should not affect it visually. Serum is the only synth I&#x27;ve used where the envelope graphics actually add a lot to the value of the interface. The way you can draw curves or steps is also genius. [2]<p>The ADSR model also responds to your playing, unlike the programmatically made examples. You can&#x27;t hold two notes, let go of one and have it slowly release while the other is still sustaining because you&#x27;re pressing the key. Would singing the envelope or using an audio sample to generate the initial envelope data be useful? Maybe, I&#x27;d certainly like to try. But my first guess is that it wouldn&#x27;t be that helpful. Most of my time with envelopes is spent adjusting values by milliseconds or so to get it to sound perfect, and not by a whole second or so. I couldn&#x27;t achieve that accuracy with my mouth, and dialing in an initial envelope is already easy enough that I wouldn&#x27;t want to plug in a microphone instead.<p>I&#x27;m really interested in better interfaces to musical instruments, or sets of them, especially in real time. There are some amazing things people are doing with grid controllers like the monome or Push. PXT-Live-Plus is one I&#x27;ve been playing with. One of my favorite additions is the drum mode where you can set pads to not be an individual sample, but a set which rotates to the next each time you hit it (so it&#x27;s entirely deterministic and predictable). From a small number of pads you can build really intricate melodies&#x2F;rhythms by managing what notes&#x2F;samples will be available to you next, it&#x27;s a very different way of thinking.<p>[0] <a href="http:&#x2F;&#x2F;www.fabfilter.com&#x2F;images&#x2F;screenshots&#x2F;screenshot_pro-l_full.jpg" rel="nofollow">http:&#x2F;&#x2F;www.fabfilter.com&#x2F;images&#x2F;screenshots&#x2F;screenshot_pro-l...</a><p>[1] <a href="http:&#x2F;&#x2F;www.fabfilter.com&#x2F;help&#x2F;pro-q&#x2F;images&#x2F;analyzer@2x.jpg" rel="nofollow">http:&#x2F;&#x2F;www.fabfilter.com&#x2F;help&#x2F;pro-q&#x2F;images&#x2F;analyzer@2x.jpg</a><p>[2] <a href="https:&#x2F;&#x2F;www.audiotent.com&#x2F;wp-content&#x2F;uploads&#x2F;2017&#x2F;02&#x2F;lfo.jpg" rel="nofollow">https:&#x2F;&#x2F;www.audiotent.com&#x2F;wp-content&#x2F;uploads&#x2F;2017&#x2F;02&#x2F;lfo.jpg</a>
评论 #14120815 未加载
empath75大约 8 年前
I think VR interfaces will be super useful for music making because you&#x27;ll be able to place audio sources in 3D space.