Normally my shell prompt gives me fairly standard information. Current working directory, time, hostname and current user.

[nick@20:47:31] dusk : ~/Work
$ 

When I’m inside a git repository, I see something like this.

[nick@20:47:31] dusk : ~/Work/git/MacRuby (master) [2]
$ 

The bracketed ‘master’ shows me what branch I have checked out, and the red ’2′ shows me that I have two stashed change-sets. This is accomplished by the following bashrc/profile code:

function parse_git_branch {
  ref=$(git symbolic-ref HEAD 2> /dev/null) || return
  echo "("${ref#refs/heads/}")"
}
 
function parse_git_stash_size {
  lines=$(git stash list -n 100 2> /dev/null) || return
  if [ "${#lines}" -gt 0 ]
  then
    count=$(echo "$lines" | wc -l | sed 's/^[ \t]*//') # strip tabs
    echo "["${count#}"]"
  fi
}
 
export PS1="[$red\u$NC@$green\t$NC] \h : $cyan\w $yellow\$(parse_git_branch) $RED\$(parse_git_stash_size)\n$NC\$ "

This has been invaluable in helping me keep track of what I’m working on, and helps me make fewer mistakes when managing git repositories.

CloudSites has some very customised Apache configuration, and we found that the standard mod_rewrite approach didn’t work. There was no mention of a solution within their support wiki, so for anyone else looking for a similar solution, I’m placing ours here:

RewriteEngine on
RewriteBase /
RewriteCond %{ENV:PHP_DOCUMENT_ROOT}/maintenance.html -f
RewriteCond %{REQUEST_FILENAME} !/maintenance.html
RewriteRule ^.*$    /maintenance.html [L]

We found that when checking the DOCUMENT_ROOT environment variable, it didn’t get the correct path to test for the presence of the maintenance.html file, but using ENV:PHP_DOCUMENT_ROOT, it did.

It was during the porting process that I ran into a small issue when attempting to read ID3 tags from mp3 files. I’d previously used the native Ruby gem ruby-mp3info, but this had some compatibility issues with MacRuby 0.6, and refused to install. After hacking around with the gem source, I worked around the issues, but the resulting performance was awful, so I reviewed my choices:

1. Investigate the cause of the performance problems in ruby-mp3info
2. Switch to using id3lib-ruby
3. Investigate bundles and use a C/C++ library directly

I didn’t sink a lot of time into fixing ruby-mp3info’s specific problems on what is still a relatively niche platform, and I felt that using id3lib-ruby would complicate my ability to create standalone binaries. id3lib-ruby is so named because it depends on the libid3 C++ library, which would introduce another layer of complexity into the build process. Lastly, the id3lib gem didn’t support the latest version of ID3 tags, and wasn’t under active development.

That left the last option, which I had always wanted a good excuse to investigate. I had originally looked into this when I originally started looking at RubyCocoa in Summer ’09, but linking with native Objective-C seemed excessively difficult and poorly-documented.

One of the many improvements that the MacRuby project brought over RubyCocoa was to make this functionality as easy as loading bundles in native Objective-C applications. This is achieved with use of the NSBundle class, so I thought all I needed to do was to take a C or C++ ID3 library, and wrap it in a very small Objective-C wrapper. Through the magic of runtime introspection, all of the wrapper’s methods would become available when you loaded the bundle into the MacRuby environment.

After reading up on existing tutorials, I managed to get this to work, and because it’s using the native compiled code, it’s extremely fast. This process of using interpreted Ruby code with compiled C/C++/Objective-C code is tremendously powerful, and allows for a mix and match approach to development that enables both rapid prototyping, and an ability to optimise for performance, from within a single codebase.

So powerful is this technique that I wanted to write up my experiences for others, who like myself, had maybe had just enough experience with Ruby (through Rails) and iOS development to feel that merging them together might be fun. With Mac OS X as my primary desktop environment, I’ve now achieved a triumvirate of control:

1. I can write web-based code that lives in the cloud and is available from anywhere in the world.
2. I can write mobile applications that I can carry with me at all times.
3. I can write larger, more flexible and powerful applications when a desktop environment is appropriate.

I can remember buying my first Powerbook back in 2002 and getting the distinct feeling that Mac OS X had successfully channeled all of the potential energy that the original NeXTSTEP had so successfully created. That this was a futuristic platform that eagerly awaited the craftsman’s touch. Something that could be deftly moulded it into whatever shape you could conceive, if only you invested a little time in the tools.

Eight years on, the choice has grown richer. MacRuby occupies a unique place within the spectrum of development tools on the Mac, offering a high level ease in harnessing low level power. If you haven’t looked at it yet, I can recommend a good tutorial.

Michel Thomas on the iPhone

The first project was the Michel Thomas iPhone app. This is one of the most well-rounded apps I’ve implemented, and proves that you don’t need a large team in order to produce an intricate and attractive application. BERG’s supremely talented designer, Matt Brown, designed the visuals, and I worked on the iOS implementation. Between us we came up with a product we’re both very proud of, and it’s now the flagship mobile application of Hodder Education.

Since its launch, the Learn a language with Michel Thomas application has been steadily gathering interest, and It has recently taken the top spot in the Free Education category of the App Store, both in the UK, and in the USA and Australia.

There are more details of the design process in the “Behind the scenes” post that Matt Brown wrote up for the BERG Blog, and a comprehensive Flickr image set of the sketches we created during the design and development process.

In my view, one of the standout feature is the playfulness we worked into the interactive audio player. We went through a number of design iterations, many of which were discarded because the technical implementation didn’t capture the feeling of the original design sketches. Our final design struck a great balance between gorgeous design and the constraints of the real-time rendering power on iOS devices.

At the height of the work on the audio playback, I listened to the same phrases so many times that Michel Thomas percolated through into my subconscious. At one stage, during a particularly intense week of work, he took a starring role in a dream, chatting up girls at a party in his uniquely accented Spanish!

Popular Science+ for the iPad

The second application we worked on was Popular Science+ for the iPad. BERG had previously worked with Swedish publisher Bonnier in late 2009 on an exploration of the future of digital magazines. Very shortly after the Mag+ video had been released, Apple announced the existence of the iPad, and Bonnier, along with BERG, were invited to create the magazine experience that had been conceptualised in the earlier work.

The challenge of bringing Mag+ into the world in only 8 weeks made it an extremely ambitious project, which took a great deal of concentrated effort from many people across numerous timezones (London, Sweden and Florida, USA). Thankfully I was joined by another developer, Lei Bramley, who really pulled out all the stops to get everything in place on time.

After a fevered period of development, we submitted the first version of Popular Science+ to the App Store for the launch of the iPad, and Steve Jobs himself had very nice things to say about our work:

Somebody snapped this picture of the street-level advertising of Popular Science+ while out and about in Manhattan:

The sheer ambition and timescale of the project saw everyone involved in the project raise their game, and it was a fantastic experience to have been part of the iPad product launch.

Mill Colour

Lastly, a small update concerning Mill Colour. What began as a small project to give people a taste of professional colour grading, has gone on to be a big success worldwide. It has been downloaded over half a million times to date.

Viva Mill Colour!

Over the past few months I’ve been working on developing professional iPhone and iPod Touch applications with a number of clients, and I wanted to mention the first one, which has had a great 6 week run at the top of the free photography apps chart.

My very first public iPhone project has been Mill Colour, for world-renowned visual effects company The Mill. The idea behind this app is to offer users a means of  manipulating their pictures in a simple way, with built-in looks. It also offers the more adventurous user direct control over the Lift, Gamma, Gain and Saturation in their picture. These controls are the same as the Colourists at The Mill would use when colour grading video footage.

An important feature of this app was to offer users a learning curve suitable to the immediacy of mobile applications. Our goal was for the user to be able to see results within roughly 30 seconds of launching, but to offer additional controls which extend the learning curve, and offer a deeper experience for those who want to invest time. To achieve this, the simple built-in looks and the more direct controls interact with each other, offering a large combinatorial set of possible ways to alter the image.

Another interesting aspect of the project was the toolset I specifically built to capture the lookup tables for the looks. Each of the looks available within the app is based on a famous advert that The Mill have graded. To capture these looks, I wrote a program which would read and write the colour values from RGB ‘ramp’ images. This allowed the Colourists to apply the same colour transform to the ramp image as they had done to the original source image. The tools then read this image back in and created a lookup table which could be applied to any image. This saved us a great deal of time in the early stages of the development process.

It has an active Flickr group, and by adding pictures to the pool, you can get entered into a competition to win time at The Mill, and get taught directly by their award-winning Colourists.

There are more applications in the pipeline, and I’ll post about them closer to the release date.

Once a recording has been made, the recording schedule is made dormant, so it will not clutter your existing schedule list as time goes on. You can decide if you would like to turn that recommended program into a permanent schedule or not, and reinstate it if desired.

I hope to add more feed parsers as the code matures, but as things stand there is only one written, specifically for The Guardian here in the UK.

MythTV has a web interface written for it in the form of MythWeb, and it allows decent remote interaction with the system. It is also my main mode of interaction when trawling for interesting programmes to record. It’s much more convenient to use a keyboard and mouse to navigate, rather than a remote control. This is especially true here in the UK, where there are many Freeview channels that could contain content of interest.

Creating a pleasant API

However, if you’re looking to play around with integration, and prototype some ideas you have to help you navigate and interact in different ways, you’re not going to have an easy ride. There’s no single clean implementation of the functionality you can access in any one language. PHP drives the main MythWeb code, but it also mixes in some Perl to access some fairly major functionality (downloading/streaming the recorded programmes). There are also Python bindings within the MythTV codebase, but I’m not aware of anything substantial built on top of them, and what is implemented is mainly concerned with metadata.

The main functions I wanted a MythTV integration library to offer were the ability to list what had been recorded, obtain a thumbnail for that recording, and to be able to stream the data to you. This was achieved in the 0.1.0 release. Now we’re up to version 0.2.0, it now supports listing of EPG data, and creation/editing of recording schedules. This paves the way for experiments in automatic scheduling of recordings. There are many potentially interesting sources of TV reviews to scrape. For instance, if you like what The Guardian has to say about Television in its Watch this section, then extracting the titles from that page, and feeding them to ruby-mythtv is easy.

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27

  require 'ruby-mythtv'
 
  # Connect to the server
  mythbackend, mythdb = MythTV.connect(:host => 'mythtv.localdomain',
                                       :database_password => 'password')
 
  # Find matches on our search term, and limit the results to 5 matches
  programs = mythdb.list_programs(:conditions => ['title LIKE ?', "%Bruce Parry%"],
                                  :limit => 5)
 
  # Take the first program match, and convert it to a recording schedule
  new_schedule = MythTV::RecordingSchedule.new(programs[0], mythdb)
  new_schedule.save
 
  # Signal the backend of recording changes for our recording schedule entry
  mythbackend.reschedule_recordings(new_schedule.recordid)
 
  # Let the backend resolve matches
  sleep(1)
 
  # Enumerate the list of pending recordings, find ours, and check for any conflicts
  pending_recordings = mythbackend.query_pending
  conflicts = pending_recordings.find { |p| p.recordid == new_schedule.recordid &&
                                            p.recstatus_sym == :rsConflict }
 
  # If conflicts is empty, then all is good. If it is populated, then action needs
  # to be taken, such as bumping the priority, or removing the clashes....

Ruby-mythtv is present both on Rubyforge and Github. Major release versions will be present on Rubyforge, and development versions will be present on Github. This method allows me to push out code which I consider functional, but not necessarily finalised. Release early, release often, as the saying goes, and this is all the more relevant when forking projects and sharing ideas is central to the way Github works. There’s nothing worse than code which is “almost there”, languishing in your “I really should finish it” folder, destined never to see the light of day.

Although complex, this enables the most cost-effective use of each system, marrying the functionality needed to the number of physical people required to attend the session for any given day. There is a large variation in price and functionality with certain high-end systems, so you always want to try and get maximal use from the systems you have chosen to invest in.

He’s looking at using one of the boards from the wonderfully named Acme Systems from Rome. The idea is to communicate with the video router via its RS-232 serial interface, and retrieve an ASCII representation of the current router configuration. It’s a fascinating area of software AND hardware as glue. A physical device which will run some bespoke code to bridge information from one system into another.

In related news, I’ve also received my Artigo Pico-ITX kit and am now a proud owner of the tiniest system running Linux that I’ve ever seen. It also seems to play happily with the DVB sticks that I had stability issues with on the older Mini-ITX M10k board.

The fan is noticable in a very quiet room, but as soon as there’s anything else to be heard, it’s drowned out, so it’s not quite suitable for your bedroom. They do a fanless system, but it’s half the clock speed. Installing it was done over PXE from my Mac, using the Ubuntu netboot downloads.

Incidentally, for anyone looking to figure out the ssh username and password for your freshly enabled ssh daemon, they are both frontrow, and that user has passwordless sudo privileges.

I also had a minor breakthrough with my x86_64 Ubuntu 8.04 machine. I have a Zyxel G-202 Wireless USB stick, to keep the number of trailing wires to a minimum, but I kept getting an error saying:

1

zd1211rw error ioread32(CF_REG1): -110

Which was exceedingly unhelpful. I eventually tried disabling hi-speed USB from the BIOS, and rebooted to find it sprang into life immediately. Great! What was even more strange that when I rebooted and reset the BIOS back to enable USB 2.0, the G-202 kept working. I’m unsure whether this is due to the device not being cold booted, and I’ve yet to see if it stops working after I power the system off, but so far so good, and I don’t need to resort to NDIS.