So HN, what are some cool, shiny new technologies that you worked with this past year? Care to tell us what those technologies are and why they are so cool?
2010 was, for me, the year of JS-related technologies. (I'm actually rather disappointed I haven't had more time to check out Clojure and to use Haskell and Scala more--I was doing quite a lot of front-end web stuff.)<p>1. Socket.IO (<a href="http://socket.io/" rel="nofollow">http://socket.io/</a>)<p>It lets you use websockets and automatically fall back to flash sockets, long polling, or several other real-time communication methods if websockets aren't supported by the client. There's a JS client and node-compatible server, as well as in-progress server implementations in a few other languages. Node is nice by itself, but it's with things like Socket.IO that it really shines.<p>2. Coffeescript (<a href="http://jashkenas.github.com/coffee-script/" rel="nofollow">http://jashkenas.github.com/coffee-script/</a>)<p>Coffeescript is a nice-looking and nice-to-type syntax on top of JavaScript. It's made JS development a lot friendlier, and I now miss things about it every time I'm programming in Python and Ruby. I now use it whenever I'm doing any significant amount of coding in JS.<p>3. Node.js (<a href="http://nodejs.org/" rel="nofollow">http://nodejs.org/</a>)<p>Node should, by this point, need no introduction. Server-side JS. Plays very nicely with websockets thanks to Socket.IO, making it very easy to write the server-side part of real-time webapps. I've also found it very useful when trying to quickly prototype simple non-webapp things that have to communicate over a network.<p>I haven't had a chance to check out Backbone.js (<a href="http://documentcloud.github.com/backbone/" rel="nofollow">http://documentcloud.github.com/backbone/</a>) yet beyond a very quick look, but I expect to use it (or something like it) next time I'm developing something that uses a significant amount of client-side JS.<p>I'm also very excited by the continued development on (and Yehuda Katz's participation in) SproutCore (<a href="http://www.sproutcore.com/" rel="nofollow">http://www.sproutcore.com/</a>).
Varnish, the reverse proxy, has been my favorite new-to-me technology of 2010. It sits in front of Apache and caches static content (or anything really) based on rules you define in the Varnish Configuration Language (VCL).<p>Varnish is cool because it is very fast. It was written by Poul-Henning Kamp, who has a lot of experience in FreeBSD kernel development. He makes effective use of virtual memory, is careful to avoid memory operations that result in expensive bus transactions on mutli CPU systems, and knows how many system calls it takes to serve up a cache hit. All of this work has paid off. Varnish can turn a plodding CMS into a site that screams, and your profiling tools (siege, apache ab) will fall over before the site does.<p>Of course it helps if your CMS supports cache control headers, and isn't utterly laden with cookies, but that's where the VCL language comes in. You can write code to strip bogus cookies (like google analytics) coming from both the client and the server which vastly improves your cache hit ratios.<p>I like the way Varnish uses a shared memory pool for statistics and logging -- a wealth of information about the system is available to you but it doesn't generate a ton of I/O logging it to a file unless you ask it to. I love how you can use the telnet admin interface to compile new VCL code into a running system and then switch to it, while keeping old named configurations around in case you need to revert back.<p>Varnish has really helped me make slow sites fast this year, although it hasn't happened without some VCL coding effort and some understanding of how the sites operate.
The iPad has changed everything. It's an entirely new type of computer that turned out to be substantially better than anyone imagined. Watch a 5-year-old use an iPad for the first time and you will immediately see and understand why this is a major paradigm shift. It's the first "socially acceptable" computer -- at Christmas I can pull out my iPad, plop it down at the dinner table and share pictures with the family, and it's not at all considered rude.
Redis. Fucking awesome database. Does exactly what it's advertised to do, with no unexpected surprises. Great documentation. Finally we can go beyond the simplistic key-value map/reduce datastores, for when you don't need all the guarantees that traditional SQL forces you to have.<p><a href="http://redis.io/" rel="nofollow">http://redis.io/</a><p>(I still use postgres and sqlite for other database needs, but I'm strongly considering moving a few of those over to redis if I have time.)
These aren't new to the world, but they are new to me this year, and a lot of them sort of hit some sort of "usable by those without active interest in the continuation of said tech".<p>1. Mongodb -- This year it really hit its stride and have been able to use it without worry for storing test results and experimental data. This is much nicer than the textfile logs -> sql -> processing datapath I was using previously.<p>2. flask: this little framwork is in my sweetspot. It does all the annoying crap of webby stuff, without all the "use our orm/routing model/way of thinking of http" so common in the space<p>3. mongrel2: I like it because it uses 0mq as the backend and sanely integrates some components in a way I feel could be better for many use cases than traditional stacks.<p>4. 0mq: This gets special mention, because it has been around for a while and I was actively using it, but 0mq 2 came out sometime this year, and is different enough from the first round, that it could be considered a separate technology. It isn't revolutionary in the MOM space, but it is a cool lightweight approach, and the core team has the type of dedication I like to see in OSS projects.<p>5. ABSOLUTELY NOT NEW: Haskell -- this year is the first year I've had time to sit down with Haskell for real, and start understanding the weird FP thing. This has made everything I do feel shiny and new, because even though I never actually use Haskell, I find myself writing very short hsskell programs in python and c and the other languages I use in my day job. When I started coding I remember thinking "This must be what a wizard feels like!", Haskell has brought back that feeling for me.
I continued to work with F#, deploying a couple of small apps.<p>The really cool part came when I realized that with F# I was programming at the language level -- that I could effectively and easily write my own languages. So I decided I would like rails-like entities, where the entity reads the structure of the table and then conforms itself to whatever is in the table.<p>Couple hundreds of lines of code later, and presto chango, I could simply say "give me a list of customers" and point it to the table and I had a list of customers. This totally disconnected the database data structure from the code. Add a new field in the database and there was nothing to change in code. Or add a new field in the type and have it percolate out to the database. Change database providers and it was only a few function changes. Very cool. The kind of simple fix Microsoft should have done with data access instead of writing ODBC/ADO/OleDb//EF/etc<p>Then I had a blast with mailboxes, er monads, agents, and threads. Ended up writing a small app that was purely functional and all ran in the background. It was so automatic, at first I couldn't figure out how to start the dang thing!<p>This led to a venture into MPI and other technologies which has just begun. I'm also trying to wrap up my language work with a full DSL sometime soon (if I have a project that needs it). Looking forward to parsing and setting up trees and walking them. I also broke out of windows and started working in a linux environment using Mono, Apache, and MySQL.<p>Incredibly fun stuff. Looking back, I really had a blast this past year. Next year should be even better.
I am a huge fan of Vagrant ( <a href="http://vagrantup.com" rel="nofollow">http://vagrantup.com</a> ) which is virtualized development environments, package-able. Works with chef and virtualbox. I don't know if I can state just how game changing this is for me.<p>DocumentCloud really dropped some bombs this year. backbone.js, underscore.js are really great.<p>Socket.io saved my ass. I promised some big clients that I could make websockets driven apps for the iPad and then apple pulled websockets support without saying anything. So I was able to get socket.io for the win.
1. MongoDB / Mongoid have blown me away this year. Is now my default database for new rails projects.<p>2. CoffeeScript language is an amazing replacement for Javascript. I can't see myself going back to pure JS at any point in the future.<p>3. Rails 3 finally feels like a stable and maintainable web framework. All the web frameworks now all seem to work together using Rack. The ruby web development world is really a nice place to be at the moment.<p>4. Bundler really nailed the gem dependency management issue (though the journey to 1.0 was very painful)<p>5. Sass / SCSS / Compass got really good. It feels unimaginable to go back to regular CSS.<p>Wow, now that I think about it, way too many great technologies to list. 2010 was an insanely good year for ruby web developers.
Clojure - it's the gift that keeps on giving. It keeps getting faster and the feature set for writing robust object-oriented software (minus the broken stuff) just keeps getting better. In fact, it's changed how I assess the feature set of other OO languages old and new.<p>miniKanren - logic programming w/o the Warren Abstract Machine. Has opened my eyes to a ton of incredible literature on this under appreciated programming paradigm.
Jekyll (<a href="https://github.com/mojombo/jekyll" rel="nofollow">https://github.com/mojombo/jekyll</a>)<p>First touched it two months ago just to tinker with but didn't really do anything with it. Then after numerous frustrations with my current blogging setup, I spent the last 5 days hacking on it over the holidays and I think it's almost ready to launch. Had to do some custom stuff that I'll write about in a post. It's extremely hackable and I love it. The only thing that doesn't work for me is LSI for related posts. Even with a fast computer and gsl/rb-gsl it still takes 10+ hours with my 1,000+ posts. Anyways, having a super fast site is going to be a breath of fresh air. Google was saying 88% of sites loaded faster than mine ( <a href="http://paulstamatiou.com" rel="nofollow">http://paulstamatiou.com</a> ), though likely due to the images in many of my reviews.<p>Also installed Google mod_pagespeed and all is well so far.<p>* Though to be fair most of that is just my redesign that is more minimal, less ads, etc, but there's something extremely attractive about simple, flat files. No worrying about if your database will get corrupted. Everything is in git..
I'm kind of ashamed to admit it (at the end of 2010!), but I did some Objective-C/iOS apps for the first time this year, and I was pretty amazed by how good the Apple dev tools and the iOS simulator actually are.<p>The other thing which impressed me is kvm, in contrast to Xen.
This is the first year I've really used the real released Windows 7 - on my new SSD-loaded work laptop and on my personal netbook. It's amazing to see Windows more or less work and do what I want it to do most of the time.<p>GPU-accelerated VLC on my netbook has been amazing.<p>I got a Canon T2i / 550D this year. It shoots some amazing HD video and will only get better as I spend more on lenses and develop better techniques.<p>The Kindle 3 (brighter display and cheap price) have me reading books I've been putting off for years. It's great to have a device that's great at one thing and not very good at random browsing, Facebook, Twitter, HN, etc.
All thanks to jashkenas: CoffeeScript, Underscore.js, and Backbone.js.<p>Using those tools has helped me to really enjoy writing JavaScript and to start doing it in a much more organized manner. They have been a huge catalyst for my growth as a JavaScript developer.<p>Also, using MongoDB has been awesome!
I was shocked by how powerful SproutCore was, once I actually started hacking on it. I suspect that it will be a very big deal in 2011.<p>I am also really excited by socket protocol tech advancements in the browser. I was able to pull off seriously cool stuff using <a href="http://pusherapp.com/" rel="nofollow">http://pusherapp.com/</a> and also <a href="http://faye.jcoglan.com/" rel="nofollow">http://faye.jcoglan.com/</a> which is a nifty JS implementation of the Bayeux protocol.
In 2010 I fell in love with:<p>1. Groovy - a programming language, it rocks because it less verbose and more powerful than Java and I can fall back onto standard Java syntax when I don't care to figure out how to do something in the 'Groovy' way. (<a href="http://groovy.codehaus.org" rel="nofollow">http://groovy.codehaus.org</a>)<p>2. Gaelyk - a groovy framework that runs on Google App Engine. Google App Engine is great for launching apps. It's free until it gets traction. (<a href="http://gaelyk.appspot.com" rel="nofollow">http://gaelyk.appspot.com</a>)<p>3. Objectify - The simplest convenient interface to the Google App Engine datastore. Takes a lot of the pain out of using Bigtable. (<a href="http://code.google.com/p/objectify-appengine" rel="nofollow">http://code.google.com/p/objectify-appengine</a>)<p>These all pack a mean punch and let me work on my night/weekend projects quite productively after overcoming a small learning curve.<p>I built <a href="http://icusawme.com" rel="nofollow">http://icusawme.com</a> and <a href="http://chatroulettespy.com" rel="nofollow">http://chatroulettespy.com</a> with all three.<p>I'm looking forward to diving deeper into Appcelerator Titanium Mobile in early 2011.
1) MongoDB - I started off using it in place of a few tables that had some varied column requirements, and I'm now in the middle of converting my entire DB to it. So awesome.<p>2) Kohana - I love working with this framework. I never really worry about the ugly warts in PHP, because honestly? I'm not programming in PHP any more. I'm programming in Kohana, and I only occasionally fall back to PHP for "low-level" stuff.
Protocol Buffers (<a href="http://code.google.com/p/protobuf/" rel="nofollow">http://code.google.com/p/protobuf/</a>)<p>Not what you would call cool technology, but definitely the best technology I have used this year. Protobufs get out of the way so you can get work done.
Not new, but I've really enjoyed working with Lua (<a href="http://lua.org" rel="nofollow">http://lua.org</a>). The C API is really nice and I like how you can start from a known-safe, minimal interpreter and add new procedures carefully.<p>libev (<a href="http://software.schmorp.de/pkg/libev.html" rel="nofollow">http://software.schmorp.de/pkg/libev.html</a>) was also a lot of fun to use for multiplexing sockets, plus it has a whole pile of other useful watchers that can use its event loop.
Most of these are not new to 2010 and some are quite old, but here goes:<p>- All the Amazon offerings. They are innovating like crazy and improving and expanding all their offerings all the time.<p>- Compass/SASS/SCSS - All the pain gone from CSS<p>- Capistrano - All the pain gone from software deployment<p>- Apple laptops & OS X. A bit on the clichéd side now but it really makes my life easier.<p>- SSDs. Damnit I really need to buy one of these things. After having tried them out it's hard to go back to spinning platters.<p>Also things I wish I'd worked with but haven't had the chance yet:<p>- anything in the CNC milling, laser cutting, desktop fabrication and 3d printing fields. This is a huge area to watch.
Not directly but I'd say Erlang and Redis, definitely the most "exotique" technologies I've been in contact this year that made <a href="http://mysyncpad.com" rel="nofollow">http://mysyncpad.com</a> possible
The closest to "cool, shiny and new" I got was Scala. And I never found time to dig as deeply into it as I wanted, so I still haven't done any meaningful coding in it yet. But I did sit down last week and spent a couple of days working through the <i>Programming Scala</i> book, and one of my major goals in 2011 is to learn Scala well.<p>Other than that, the stuff I did this year that was merely "new to me" was mostly about Groovy and Grails. I spent a ton of time working with Grails, and I'm really liking it.
Seaside - a WebFramework based on smalltalk and continuations that make developing complex WebApps extremely easy.
Seaside led me to learn:<p>Smalltalk - What a powerful language. This is what OOP should look like.<p>Object Oriented Databases - Gemstone and db4o. Not having to deal with the OO and Relational mismatch is a breath of fresh air.
1. MongoDB - I see several people also listed mongodb but I particularly want to mention the simplicity of setting up the database and using the API.<p>2. AndroidOS - It came out few years back but it really took off in 2010. I can’t wait to see the new features for 2011 and how it’ll fare against iOS.<p>3. Python - even though I’ve been using python for several years I’m still constantly surprised by it’s core features (recently coroutines) and it's plethora of awesome third-party libraries.
Normally, I'm a software producer and I've worked with a few technologies that are great, but this year (as of late) I'm becoming a software consumer.<p>I've finally gotten to experience the Kindle 3 (Christmas gift) and the Google CR-48 is pretty sweet too. I believe the Kindle will change the amount I read. I have so many books on deck. My biggest challenge is balancing development time with watching movie time and more reading time.
#1 - MongoDB: see comments above. :)
#2 - Redis: also see comments above. ;)<p>#3 - new to me: Twisted as a server framework; more specific Cyclone which is a Twisted-based clone of the Tornado server framework.<p><a href="http://github.com/fiorix/cyclone/" rel="nofollow">http://github.com/fiorix/cyclone/</a><p>Comes with built-in MongoDB (TxMongo) and Redis (TxRedisAPI) support too! :)
This post made my day. I've found some new interesting stuff from the comments. Thank you.<p>2010 was a year of discoveries for me. I started learning and using technologies like Ruby, Rails, Sinatra, HAML, Google Maps API v3. I started reading HN. Just in the end of the year I've discovered that with technologies like Rhodes framework, Appcelerator or Phonegap I can create iPhone/Android applications with HTML/Javascript or Ruby without knowing objective C. And this is just the most recent excitement I got.
Firesheep, actually. It took a scary-to-people-who-know problem and made it scary to people who don't know. I didn't ever expect to explain session hijacking to my dad.
Apologies for blowing my own trumpet, but pound for pound, the neatest thing I've worked with this year is a C++ template I wrote. I like to have the tightest possible scoping of names, but a common pattern makes that difficult. If you've got a function that produces a good value or indicates that it couldn't do so one way to write it is:<p><pre><code> Type theVar;
if (theFunction(theVar)
{ /*do something with theVar*/ }
</code></pre>
theFunction returns true if it set theVar, false otherwise.
The problem is that theVar's visibility extends beyond our interest in it. The ZQ template lets me write this:<p><pre><code> if (ZQ<Type> theQ = theFunction())
{ /*do something with theQ.Get()*/}
</code></pre>
and all of a sudden I don't have to come up with anywhere near as many meaningful names as before.<p>To me it's neat because I've found many unanticipated uses for it e.g. wrapping the values in option-specifying structures where a default is cleanly indicated with a default-inited (or subsequently Clear()ed) ZQ, rather than having a separate 'use default' boolean, or 'set default' function.<p><a href="http://zoolib.svn.sourceforge.net/viewvc/zoolib/trunk/zoolib/source/cxx/zoolib/ZQ.h" rel="nofollow">http://zoolib.svn.sourceforge.net/viewvc/zoolib/trunk/zoolib...</a>
CoffeeScript, Raphael.JS, and Django (not new this year, but new to me) were definitely my favorite tools of 2010. I've just started playing with Tropo as well, which is better for my purposes than Twilio.
PSGI/Plack: <a href="http://plackperl.org/" rel="nofollow">http://plackperl.org/</a><p>node.js for HTTP-related activities. (I needed a rate-limiting proxy that returned a special HTTP code when the rate limit was exceeded. 20 lines of node.js later...)<p>0MQ: the way network messaging should be. (Did you know that the same socket can be bound and connected multiple times? Amazingly flexible.)
GLM (<a href="http://glm.g-truc.net/" rel="nofollow">http://glm.g-truc.net/</a>) - A C++ mathematics library based on GLSL. It's not a new library, but I didn't know about until 2010. It's really convenient to use (almost) the same syntax in C++ as you do in GLSL.
Redis
Rails 3
Cocoa
Sparrow-Framework
Chipmunk Physics
jQuery<p>Anyone who says MongoDB without having a proper use will get a very angry stare from me.
Seriously...
Ruby on Rails 3: It's much more succinct than Rails 2.<p>Ruby 1.9.2: It was time to move up from 1.8.7.<p>MongoDB: I introduced this new technology to the company I work at which has now adopted it for two significant projects. One was the project I researched it for initially, which handles millions of writes per week, and the other is a rewrite of something we used to use MySQL for. It currently has a hundred million or so documents and is going strong. It's new and fun. My collection uses dynamic sharding; I think the other one does as well. One is hosted in our data center, the other is in the cloud. Both are in production and running with 100% uptime so far.
beanstalkd<p>I've worked with MongoDB, Cassandra, and a host of other tools, libraries, databases, and frameworks, but beanstalk is the only one to <i>never</i> fail me. It's not a full swiss army knife like Redis or the sexy app of the year like MongoDB: beanstalk does 1 job and does it, as far as I can tell, perfectly.
For me?<p>· Rails 3 became everything I wanted Rails to be — I've come from Django and am really loving the ecosystem and the way the documentation has matured.<p>· Varnish — just an awesome piece of software. Fantastic job of caching, from small sites to large, without having to write mountains of config files. It's something you can drop it from an early stage with little cost in time, and know it'll be ready to help an application as it grows/scales.<p>· SSD's: didn't realise how good they were until I got a machine with one. I don't think I can buy a new machine without one now.
At work, I've used the Java Play framework and absolutely loved it. Been recommending it to only java guys ever since. Learnt python and django this year and was blown away.
Redis, that super quick key value pair data store which integrated support for hashes has made my life easier for message queuing and session management.
Flourish Unframework for PHP (<a href="http://flourishlib.com" rel="nofollow">http://flourishlib.com</a>) I've looked at it in the past, but this was the first time I was able to work in it professional thanks to a change in career.<p>It's a really great core library for building web applications, takes the 1389408103 functions in PHP and produces a nice modular library that gives you everything you need and nothing you don't.
- WebServices, to provide access for R, Python, and spatial calculations (WPS norm). Complex calculations without installing any client software, anywhere with an Internet connection.<p>- PostGIS raster capabilities (at last some raster storage and computing inside the database).<p>- Devon:Think / Bookends / Nisus Writer : Scientific papers and books intelligent storage, bibliography management and scientific writing.
This is not a new technology, but new for me this year was working with MVC frameworks for web development. My workflow has vastly improved because of it. Specifically, the Play Framework (java/scala) and Rails 3.0 (ruby) have been great new additions to the many available.
makerbot cupcake cnc.<p>It was an on again off again sort of project mostly off, but i finished it up a week or two ago. Now I can print plastic in any shape i can draw in art of illusion. It's satisfying fiddling at the computer for a while then printing and having a real 3d thing.
Juce:
<a href="http://www.rawmaterialsoftware.com/juce.php" rel="nofollow">http://www.rawmaterialsoftware.com/juce.php</a><p>It makes cross-platform native app development easy, and is a <i>huge</i> leg up for audio work.
Just realized that I need to add Mirah (<a href="http://www.mirah.org/" rel="nofollow">http://www.mirah.org/</a>) to my list of cool 2010 tech.<p>I only started using about a week or so ago, but, hey, that;s still 2010.<p>I was trying to manipulate Kinect data in JRuby, but it was too slow. However, I may be able to use Mirah instead, and if all goes well get Rawr to auto-compile Mirah files as part of the build process. Mirah's still a bit rough, but knowing Charlie I expect it to rock.<p>I'm pretty excited about 2011. Which should be starting in about 30 minutes for me ...<p>Happy new year, all!
Neither of these are truly "new" but maybe new to mainstream?<p>1.Haskell or "how I learned to stop worrying (about monads) and just do io." Still fighting with the type system occasionally but I think it's getting better.<p>2.Erlang - I so love this language. The concurrency support makes me think about programming the way I want to think about programming. I also like that's it's most of the fun of functional programming (Haskell style) but without having to deal with types.
I'm actually beginning to enjoy writing things in Haskell. It's the first statically typed language that I enjoy using (although I do still miss dynamic typing).
OpenCL - this year I've been learning about GPU acceleration, and while it may not be good for everything it is looking very interesting for various applications.<p>While my area is currently graphics/simulation I'm wondering how effective adding GPUs as accelerators to large scale web problems would be. It's really taking of in the Super Computing area, so I'm sure there is room for it!
Well, i still was in the university but i've had chance to play with a few ones:<p>LCDS, WebORB specifically and Flex 3
RoR
Lift Web Framework<p>And in the Q4 of the year i used all my time to learn Android and a lot of cool API's:<p>Overlay-Manager to recognize gestures in Android
AndEngine
Geocoding and reverse geocoding
Notifications by vibrating
SMSManager<p>I really enjoyed developing Android stuff, and i'm keeping up with these for a while.
haXe + FlashDevelop. <a href="http://www.flashdevelop.org/wikidocs/index.php?title=Features:Interface" rel="nofollow">http://www.flashdevelop.org/wikidocs/index.php?title=Feature...</a> Lightning fast compilation and IDE plus a language that can target multiple platforms = major time savings for a bootstrapped startup.
three.js (<a href="https://github.com/mrdoob/three.js/" rel="nofollow">https://github.com/mrdoob/three.js/</a>)
An easy to use wrapper for doing 3D graphics via JS using canvas, WebGL, and SVG renderers. Check out the cool demos. I'm betting 2011 will see a lot done with this and similar libraries.
I have to develop a from-scratch application for work and have been pleasantly surprised with the current crop of .NET technologies and how well they can be integrated with open-source systems.<p>MVC.NET 3 + Entity Framework 4 + OpenRasta + Membership Framework + MEF + LINQ + dojo has been a good experience so far.
Here are some great open source iPhone libraries I use:<p>* Mopub - mix and match ad networks, server side - open source SDK (brand new start-up that just got funded, out of AngelPad)<p>* ASIHTTP - makes networking easy<p>* TouchJSON - the fastest JSON library, AFAIK<p>* Appirater - easy drop-in widget for prompting for reviews
Solid State Discs in everything.<p>Ok, perhaps not what you were asking, but they made a big difference for me. I have two, raid0 in my desktop, and a sandforce in my MBP. What a difference. Compiling, linking, copying, everything not just faster, but almost instantaneous. Yum.
#1: SSD<p>#2: MongoDB<p>#3: iPad<p>though I have not used them significantly, I have sort of drooled from afar over: Twilio, Redis, Node.js, Clojure and Kindle<p>(ok some of the above are not super new-new, but new enough to me)
I worked on LPC2148, an ARM7 based controller. A refreshing experience I guess. Made me realize how easy AVR series actually is. Started working with Atmega8s again this Wednesday and realized that I find it easier to work on.