extras

Welcome!

Julian's photo Hi there! I'm Julian M Bucknall, a programmer by trade, an actor by ambition, and an algorithms guy by osmosis. I chat here about pretty much everything but those occupations. Unless you're really lucky...

Most recently this is what I've come up with:

Restoring old negatives: the bad and the not quite so bad.

As hinted a couple of blog posts ago (From ‘57 to 57), I’ve been resurrecting a stash of old film negatives from those halcyon days when I first started learning about photography after I’d bought an SLR. And by “resurrecting” I mean separating them from the stuck-together block some of them had become. A couple of people have asked me what I did, so a quick post is in order.

In essence, the film processing service I used back in the day (30-35 years ago, note) put all the negative strips in a little paper folder when it returned the processed film with the photos. Over time, humidity has taken its toll and the emulsion side of the strips has become stuck to the glossy side of others. Even worse, with some of the processed rolls, the emulsion on some of them has actually become stuck to the paper of the folder. In other words, it was a mess, photography-wise.

For the first set of negatives, I tried carefully separating them, but I was worried I was causing too much damage to the negatives. So I went a different route: I dumped a stuck block of strips into a bowl of water. I also put the merest smear of washing up liquid on my finger and mixed it in well in the water to provide a hydrophobic agent for the negatives – it would help the strips separate and shed the water droplets later. After about 5 minutes, I would tease apart the negatives under the water and they came apart pretty easily. After that I shook them in the air and hung them up to dry (using straightened out paper clips), playing the air from a fan on them to help the drying process. Since we’ve been having some hot weather here in Colorado, they dried after an hour or so.

After that it was a case of placing them in the film tray in my scanner (a two-year-old Canon 9000F, although probably replaced with something else by now – ah ha, the Mark II) and scanning them. I then placed the strips in some archival storage pages (the ones I used allow for 7 strips of four negatives apiece) for safekeeping. I will admit though that in my scanning I did not spend too much time making sure that any dust was blown off (or in our house, cat fur) – in essence I was only scanning them so that I had digital copies. If there were one I wanted to use in particular, I could always rescan later with more care. And of course, it must be remembered that these negatives were not in the best of shape anyway. Besides which, for those photos I wanted to display here or on my Facebook page, there was always Adobe Photoshop and its damn clever context-sensitive healing brush.

Here’s an example of an unprocessed scanned photo:

Raw Scanned Image

Note the specks of dust and, even worse, the big splotch of fiber in the middle of the shot – this photo appeared in one of those strips that was stuck to the paper folder (it was frame 36, in fact). This could, in all honesty, do with being recleaned and rescanned, but let’s see what 10 minutes of Photoshop work can do.

Wooden Cross

OK, so I’ve also cropped using the rules of thirds, and I’ve messed with the contrast, exposure, and vibrance as well, but it looks a lot better than it did.

You’d think though that digitizing these negatives would be the end of it. Perhaps not. This evening I read this intriguing article about digital decay and the very real possibility of our digital memories becoming unreadable because file formats change, backup media becomes unreadable, and so on. Perhaps I should print these photos off again…

Album cover for LaughNow playing:
Hall, Terry - Take it forever
(from Laugh)

Amsterdam canal houses

Back in April this year, we went and stayed in Amsterdam for a few days. We were at the Hotel Pulitzer on Prinsengracht – although our room overlooked Keizersgracht at the rear of the hotel – and one of our pastimes was to look at the canal houses, which ones we liked, which ones not so much. On the last day we were there, I suddenly decided that I should photograph a whole bunch of them as we walked around, and create a collage of the best houses. Of course, it was that day it decided to rain.

Collage of Amsterdam Canal Houses

So, I’d have to say, not altogether successful. I did manage to capture some of the different crenellations, and in some of them you can see the rope still dangling from when the merchandise was stored on the top floor of these merchant houses. (And obviously on that day the people in Amsterdam brought out their black hatchbacks to celebrate.)

Album cover for The Belly of an ArchitectNow playing:
Mertens, Wim - Close Cover
(from The Belly of an Architect)

From ’57 to 57

A couple of months ago I celebrated my birthday; it happens every year. This is not about that event particularly, but more about changes over time and how I’ve almost become inured to the wonder embodied in those changes.

Steps in CanterburyTo take a quick example: I was born in the same year that the Space Age started. In October of that year, the Russians launched Sputnik 1 (Спу́тник-1). These days, although truth be told I hardly think about it, I use several effects of that momentous launch daily. No, I’m not talking about non-stick frying pans and the other reasons NASA had to come up with in the 70s to justify continuing the space race, but about GPS, the Global Positioning System. And about online map systems. And about accurate weather with satellite images. I use each of these every day, I’d say, but I can’t say I even ponder on the technology needed to provide me with this information. I did actually write an article on GPS and SatNav for PCPlus once, when I had to understand how it all worked, but since then? Ha!

Another big change that I’ve lived through: that of the provision of music. Back in the very early 50s, the market was just moving from shellac disks for recordings to vinyl, 78 rpm to 33 1/3 rpm (and the smaller 45 rpm disks). That was the era I was born into, but in the early 60s, Phillips introduced the Compact Cassette with Musicassettes being sold by the mid-to-late 60s, although of poor audio quality. However, by 1976 (which is when I bought by first cassette recorder for my University room) the tape was usually CrO2 and had much better fidelity. I would record LPs onto cassettes to try and help prolong the life of the easily-scratched vinyl. I even had a cute little cassette case that I kept in my first car – mirabile dictu, it had a cassette player – containing 24 cassettes. Well, until the case was nicked when the car was parked overnight near my girlfriend’s digs in Catford. By the time I was married to that particular girlfriend, CDs had just been introduced and we bought a CD hi-fi for our flat and I bought my first CD (Brothers in Arms by Dire Straits, if memory serves). Much later on after the divorce, I already had up to 100 CDs when my flat was broken into and my hi-fi stolen with a copy of Grace Jones’ Nightclubbing still inside the CD player.

Dredger on the River Great OuseBy then I was hooked on the better fidelity (no clicks or hissing), so, of course, I had a Sony CD Walkman (the Discman) that I used in the car – a heavy piece of kit that’s long disappeared now. I used to hook it up to the cassette player in the car with a fake cassette that merely transcribed the signal from the headphone jack in the Discman to the head in the cassette. With a bit of luck the cassette player would assume that the fake cassette was a real one, and you’d get great music with nary a soupçon of a hiss.

And then after a few years it was time for MP3s to arrive and we haven’t really looked back. (Yes, yes, I know there is a small market still for vinyl, but it is very small. You won’t catch me buying a record deck nowadays.) My first player was a small light Panasonic something-or-other that had DRM built-in. You had to load songs through a special version of RealPlayer on your PC, so it could encode the MP3s to stop people just copying music tracks. Yes, really. I mean to say, WTF? After that, I’d play MP3s on my Sony Clié PDA. And then came the iPods…

Arches at the SavoyNowadays, there’s Pandora and Spotify, you buy DRM-free high-quality tracks from Amazon and iTunes, and my wife listens to Classic FM streamed from England. I ripped my CD collection several years ago – they’re all in the basement in boxes and they stare at me every time I go down there to give me a guilt trip. All my music now is compressed (here’s an article I wrote about the compression used), online in the cloud and streamed, especially streamed.

Over on Facebook, there’s a meme that happens every week. It’s bled into more social networks and apps over time (or maybe it was the other way ’round): Throwback Thursday, or TBT. For this meme, people post pictures on their timeline of themselves from days gone by and I’ve been posting some doozies there from my past. Unlike photos these days, these were taken with a film camera and eventually stuck in a photo album (when I was into that kind of thing). For the TBTs then, I’ve taken them out of the albums, scanned them (or even the negatives), the colors and contrast auto-corrected with a photo app (perhaps with some work with a healing tool in said app to cover the dust flaws), and then – finally – posted to Facebook. Which can be viewed as yet another type of photo album.

Sign for the National Film TheatreAt the time the originals were taken, the cost of processing film was expensive: you essentially had to want that photo to be taken. These days, the economics of photography has been reversed: the cost of taking a photograph is virtually zero but the cost (in terms of time) of selecting them, tidying them up, has risen. In the past, I’d take a photo and that was it. These days, I take a photo, the camera saves it as a RAW image, I then crop it, fiddle with exposure, contrast, color, sharpening, something Adobe Lightroom calls “Clarity”, and store it on disk and in the cloud.

Am I a better photographer? I’d say yes, mainly because of the instantaneity and “zero” cost of photography these days. I can take several photos of a scene, maybe varying aperture and speed, perhaps even switching lenses, and be able to view them on the camera’s screen straightaway. The cost, as I said, is zero, at least once I bought a large SD card for the camera. I also know that back on the PC I can select the ones that “work” and discard the rest. I’m improving through probability in other words: if I take one good photo in a hundred, say, then a day out photographing will produce a good couple of images, several lesser ones, and the ones inevitably destined for the bit bucket.

Fields near Cople, BedfordshireOver the past few weeks, I’ve been trying to restore those early photography days of mine. I bought an SLR (notice no D) with my Christmas present money in January 1979 (still at University, note) and basically took it around with me all over the place. Every reel I’d dutifully mail off to be processed, and after a few days I’d get the results back and lament my “eye”, the inability to get things properly focused (the camera used split screen focusing – in this era of autofocus you just don’t want to know). I’d try and remember the rule of thirds and other stuff, and produce good pictures. One in a hundred is a nice approximation that I tried to reach. Anyway, although I have all of the negatives from those days, I’d never really taken care of them and they’ve stuck together. So I’m going through them, soaking in water to release the stick between the emulsion on one strip and the glossy side of the next, hanging them up to dry, and then scanning them. Some of the strips come out quite well, others are pretty damaged, but it’s interesting to see what I was taking photos of and how well at this digital remove. The photos in this article are all scanned from the negatives and lightly processed (usually cropping a bit, fiddling with exposure and sharpness).

Old train station near EtretatAnd another small example: back in the third form at school (for you non-Brits of a certain age that means age 14 or so) I flunked some homework essay in biology, mainly because I did bugger all on it. As punishment, and to recoup brownie points or something, I had to write an essay on Joseph Lister. I went to the school library a couple of lunchtimes in a row, found everything I could in the biology section on Lister and wrote up a two-page essay (handwritten, of course). These days? Jump on the internet, go to wikipedia, find Lister (as I did a couple of sentences ago), and, if you’re an idiot, copy it, or if you have some intelligence, rewrite it in your own words.

Of course, I could go on detailing the changes over the past 57 years since 1957, but you’ll note that all of these advances I mention are due to computers and the rise of more and more computing power in smaller and smaller packages. This is endlessly fascinating to me: I wrote my first program in FORTRAN-66 on paper tape at age 17; part of my Mathematics degree had a programming component (same FORTRAN, but now on cards); and my job ever since University has been dealing with programs and computers. Computing has become an essential part of our lives, to the extent that we are not even aware that computers are being used. Our smartphones, the cables they use to recharge, the fitness monitoring devices we wear, our wifi routers, our car engines and driving systems, our Kindles, our house security systems (and the heating/cooling systems), as well as our iPods and phones and cameras, all use some kind of chip, software, and computing power.

Sunset just off the M1, junction 15

As I said above, at some point, these wondrous things start to lose their wonder. We take Arthur C Clarke’s maxim to heart: Any sufficiently advanced technology is indistinguishable from magic, and, after a while, we stop wondering at the feats of technology required for some of our devices and almost assume it just works by “magic”.

Almost…

The rise and fall of my Jungle Disk

Quite a while ago (I was surprised when I looked it up: 2008) I subscribed to a backup app called Jungle Disk. The interesting thing about it was (a) it used Amazon S3 (then relatively new) as a backup store, and (b) you subscribed to it at a rate of a mere $1 per month. So, in essence, it’s an online backup program and it allowed me to keep documents and photos – about 6 folder trees in all – somewhere else than a local backup drive. It was the “house burns down” option: in the event of a catastrophe (like, say, if the Black Forest fire last year had been a little more ferocious and the wind from the north-east a little stronger) I’d have our decade’s worth of photos still around once we’d rebuilt.

And, for the next 6 years all went well. The monthly bill from Amazon for the storage came to around $15, sometimes more, sometimes less, but not by much. Even when I experimented a few months back in deploying a couple of static websites to Amazon, using Route 53, the bill never really made it over $20 every month.

And then, boom, February’s bill arrived: somehow I’d managed to spend just over $100. WTF?

The statement/invoice was no real help: all it said was that I’d somehow managed to incur over $80 of outward-bound data transfer. A grand total of two thirds of a terabyte had been downloaded from my S3 account in February. I don’t know about you, but a distinct chill went down my spine. Had I been hacked? Was there someone out there just continually downloading the larger files – images, PDFs, zips – I’d linked to from my blog? 0.67TB worth? The possibilities all looked dark.

I fired off an email to AWS support asking for help in trying to understand my latest bill. They responded after about a business day with lots of details about how to find out which buckets were being downloaded from and when – details that I’ll admit to being hard to find from scratch. In order to see the data transfer usage and when it started, I downloaded a usage report for S3 (actually it’s a CSV file, ideal for opening in Excel) – you can download one for your AWS usage from here. This report gives you an hourly breakdown of data transfer from your buckets and could help in identifying what caused these charges to accrue.

For me, the results were shocking. Here’s a glimpse from the time it all started:

AmazonS3 GetObject DataTransfer-Out-Bytes jd2-f12ac61040xxxxxxxc267e70f7e26c07-us 2/07/2014 3:00    2/07/2014 4:00               275
AmazonS3 GetObject DataTransfer-Out-Bytes jd2-f12ac61040xxxxxxxc267e70f7e26c07-us 2/09/2014 18:00   2/09/2014 19:00              275
AmazonS3 GetObject DataTransfer-Out-Bytes jd2-f12ac61040xxxxxxxc267e70f7e26c07-us 2/11/2014 20:00   2/11/2014 21:00              275
AmazonS3 GetObject DataTransfer-Out-Bytes jd2-f12ac61040xxxxxxxc267e70f7e26c07-us 02/18/14 02:00:00 02/18/14 03:00:00  2,905,266,065
AmazonS3 GetObject DataTransfer-Out-Bytes jd2-f12ac61040xxxxxxxc267e70f7e26c07-us 02/18/14 03:00:00 02/18/14 04:00:00  2,905,262,825
AmazonS3 GetObject DataTransfer-Out-Bytes jd2-f12ac61040xxxxxxxc267e70f7e26c07-us 02/18/14 04:00:00 02/18/14 05:00:00  2,905,262,934
AmazonS3 GetObject DataTransfer-Out-Bytes jd2-f12ac61040xxxxxxxc267e70f7e26c07-us 02/18/14 05:00:00 02/18/14 06:00:00  2,905,263,028

From a minimal data transfer of a few bytes every other day, suddenly on 18-Feb, from 2am onwards Amazon time, something somewhere had started downloading nearly 3GB every hour. From where? Well that GUID-like thing in the middle is Jungle Disk’s generated name for my backup storage. Something was downloading data from my backup.

AWS support’s other hint was to turn on S3 server access logging for the bucket and regularly check the log reports. After a few hours, I checked the logs: lo and behold, all of the data requests were made from my IP address from the Jungle Disk Desktop app. No weird hackers out there who are really, really enamored of my data files: it’s all just Jungle Disk. For grins, I disabled Jungle Disk backups for a couple of hours, and the big data downloads stopped; enabled backups again, and the big downloads restarted. Pretty convincing to me: something in Jungle Disk Desktop was initiating these hourly data downloads.

Time for an email to Jungle Disk support. First answer: “what are you restoring from your backup?” and “Maybe it’s your antivirus. It’s scanning the files in your network folder.” In other words, the typical non-answer to get rid of the question. The interesting thing is that I’ve never restored from a Jungle Disk backup in the six years I’ve been using it (which in and of itself is a HUGE problem: how do I know it’s backing up properly if I don’t try and restore?) and nothing changed about my antivirus anyway; besides which I don’t make use of the network (that is, “mirrored”) folder functionality in Jungle Disk.

Before I replied, I deleted a couple of older backup hives from S3, something I should’ve done ages ago when I retired (and wiped) those machines being backed up. After I’d done that, I enabled backups again to see whether the clean-up had any effect. The data downloads were still there, but now they were only 750MB in size per hour (0.75GB). Score! I disabled the backups again before replying and presenting this new information. The reply was (in essence): “Some computer/person is initiating restores on a regular basis.” and recommended changing my Jungle Disk password.

Let’s get one thing straight: in order to initiate a regular backup (750MB every hour, remember), a hacker would have to know my Jungle Disk password (there’s an authorization check to see if you are still subscribed to the service every time you run the Desktop) and ALSO my Amazon AWS Access ID and Secret Key. Of course, once they have the latter, they have complete control over my AWS account and wouldn’t need to do bloody stupid “24×7 hourly restore” tricks (“hey I can store a cracked installer for Windows 8 on this stupid idiot’s S3 account and send all my friends the link”). Sorry, but it doesn’t fly. Also they must have access to my main machine to spot when I turn on or off Jungle Disk backups (this big data download only happens when backups are turned on for this one and only machine that uses Jungle Disk in my household). Not only doesn’t fly but doesn’t even walk. This, my friends, has no signs of life.

So, yesterday I decided that all this kerfuffle and investigation just wasn’t worth the time and effort. Nice app, but I’ve better things to do. I cancelled my Jungle Disk subscription, deleted the backup on S3, uninstalled Jungle Disk, and deleted the cache it uses on my C: drive (all 59GB of it, WTF?). I performed a backup to an external drive and put that in my car.

Update: so last night at the Denver Visual Studio User Group meeting – it was a boring bit of the proceedings – I viewed the access logs I had for the Jungle Disk bucket on S3. And found an interesting bit of behavior I’d completely missed before. Here’s a synopsis of the server access logs over a particular period of time late Friday evening/early Saturday morning showing access to various files that are numbered sequentially in a DB folder in the Jungle Disk backup bucket.

21-Mar 20:23:28 GET    ~/DB/75780 *
21-Mar 20:24:50 PUT    ~/DB/75781 *
21-Mar 20:31:59 DELETE ~/DB/75770 
21-Mar 21:31:51 PUT    ~/DB/75782 *
21-Mar 21:33:20 DELETE ~/DB/75771
21-Mar 21:38:19 GET    ~/DB/75781 *
21-Mar 22:30:36 PUT    ~/DB/75783 *
21-Mar 22:32:00 GET    ~/DB/75782 *
21-Mar 22:40:51 DELETE ~/DB/75772
21-Mar 23:30:25 DELETE ~/DB/75773
21-Mar 23:30:26 PUT    ~/DB/75784 *
21-Mar 23:26:21 GET    ~/DB/75783 *
22-Mar 00:22:43 PUT    ~/DB/75785 *
21-Mar 00:23:33 GET    ~/DB/75784 *

So for example: at 20:23:28 a GET is requested for file ~/DB/75780; about a minute later a PUT is requested for file ~/DB/75781. Then file ~/DB/75770 is DELETEd. And so on. As you can see, some part of Jungle Disk is reading these files one by one, sequentially, some other part is adding new new ones at regular intervals, again sequentially, and some other part is sequentially deleting the older ones with a delay of about 10 files. These files are 750MB in size, and I’m guessing are the database of the backups that Jungle Disk is doing.

And the reason for the asterisks? These requests come from Jungle Disk Desktop at a completely different IP address: 162.209.124.28. No idea who owns or what’s at that IP address, but it’s very peculiar that it was totally in sync with my copy of Jungle Disk and the only operations that it was doing was GET & PUT (with the files being deleted a little while later by my copy of Jungle Disk Desktop).

Well, it’s all moot now of course. Now, I’m researching apps that automatically mirror local folders to Amazon S3.

Now playing on Pandora:
Depeche Mode - Dream On (Dave Clarke Acoustic Version)
(from Remixes 81...04)

Upgrading the SSD in the Dell XPS 12 – what not to do

So, in the previous installment in this upgrade game I was crowing about how I knew how to boot from a USB drive on the Dell XPS 12 and therefore upgrading the SSD in it was going to be a piece of cake. Well, it turned out to be a piece of the heaviest, densest, fruit cake you’ve ever seen. Dropping it onto a wood floor would have dented the floor. To recap, I decided to purchase a new Crucial M500 480GB mSata SSD to replace the 240GB unit I’d initially installed a year ago in my Dell...

Read more »

Booting from a USB drive on the Dell XPS 12

There are several possible reasons for wanting to boot from a USB drive, I suppose, but mine came from this thought experiment: I’ve been diligently making regular system backups of my Dell XPS 12 for a while and today I wondered if I would be able to recover from, say, a crashed hard drive or – a much better scenario – from upgrading the hard drive to a higher capacity one. In fact, this latter scenario is the one that interests me: I’m contemplating a 480GB drive (currently...

Read more »

21 reasons to enjoy DCI Banks

Back in November 2012, I ordered the first series of DCI Banks on DVD from amazon.co.uk , an ITV crime drama series starring Stephen Tompkinson as, well, DCI Alan Banks and Andrea Lowe as Annie Cabbot. For one reason and another, I really enjoy the traditional British police procedural: there’s some bizarre murder, after which proceeds a nicely drawn and perhaps drawn-out investigation of the crime, with lots of character development along the way. The epitome of this type of drama was undoubtedly...

Read more »

Routers: the next big security hole

There I was, minding my own business, when I came across this article in ArsTechnica: “ Dear Asus router user: You’ve been pwned, thanks to easily exploited flaw ”. I read on avidly, because, well, I have an Asus router, an RT-N66U to be precise and the subject of this article. It seems that some hacker had taken advantage of a security flaw in Asus routers, first described – wait for it – 8 months ago. The report on that flaw is pretty scary security-wise: access to...

Read more »

Flying Standard Twelve

When I was younger my parents used to regale me with stories of Dad’s first car, a Flying Standard Twelve saloon. It was from the late 30s, so I would guess it was 15 years old or so by the time Dad bought it. Here is the car in pre-marriage days, Dad sitting in the driver’s seat (the “suicide door” open) with Dad’s best friend Derrick Hill leaning on the front mudguard. I think they were off on a camping trip to Wales somewhere. Dad must have been around 19 or 20 when...

Read more »

Three quick takes on HDR

Every couple of weeks (on payday essentially, so I remember to do it), I go searching through my photo collection for a new Facebook cover image. There’s a couple of reasons for this I suppose: one, I like having cover images that change periodically since it allows me to show off some photos that I’m proud of; and, two, it forces me to continue to learn how to take what you might call good photos. I do not pretend to be a great photographer, but I continually try and cultivate an “eye”...

Read more »

Extras

Search

About Me

I'm Julian M Bucknall, an ex-pat Brit living in Colorado, an atheist, a microbrew enthusiast, a Volvo 1800S owner, a Pet Shop Boys fanboy, a slide rule and HP calculator collector, an amateur photographer, a Altoids muncher.

DevExpress

I'm Chief Technology Officer at Developer Express, a software company that writes some great controls and tools for .NET and Delphi. I'm responsible for the technology oversight and vision of the company.

Validation

Validate markup as HTML5 (beta)     Validate CSS

Bottom swirl