Saturday, October 31, 2009

Data Backup Action: Backing up a life time of data

If you have one HD crash, you're probably more likely to have another one in the future with the same hard drive.

Just yesterday, I had a small HD crash, leaving some data corrupted. I managed to backup most of my important data before the crash happened (what a stroke of luck) and restored stuff like my e-mail address book. I just realized that I have close to a life time of data sitting on this computer, starting from my university years.

Probably the most important data are my digital pictures and old university assignments. Looking back, I think I managed to solve some rather interesting problems in my spare time and I would hate for the work I did a long time back to get suddenly lost. Who knows, I might find some interesting use for them in the future. Probably the most important data to me are my pictures. I have digital photos dating all the way back to 2002 on this computer and it would be a terrible shame to lose them all. It's also quite interesting how all the data relating to our lives have become so digitized of the span of the last decade. Children born nearly 10 years ago, may be able to store their entire lifetime of photos in a digital format and by the time they grow old, they'll have a digital photo album of their entire life. The sound of a project like that now sounds really fascinating to me and I think there are lots of interesting opportunities for this kind of data. But I digress.

After the small crash I had yesterday, I just realized how vulnerable my data was and decided it was time to start baking up data that I'd hate to lose, mainly all my application data, pictures, university work, and music collection.

The interesting part of this is how little data I have, about 130 GB of data. I have about 3 GB hard drive space on the computer! Maybe over the course of a life time, I may only have about a 2~3 TB in total. That is amazing little compared to the size of a standard HD today.

Anyways, I just finished backing up all my data today on a separate HD and found a great program in Linux that just checks files and folders for changes only and will automatically update the archive copy. I've also setup the process to be automated so I'll have a fresh backup everyday. There is no way, I want to lose a lifetime of data now.

Perhaps it is also time to consider an offsite backup location too.

OS Upgrade: Ubuntu 9.10

This is the fastest OS upgrade I've ever done.

I downloaded the newest version of Ubuntu last night and made a bootable USB stick. I nuked the old OS partition (note: I keep my profiles directory and data on a different partition) and then fired up the installer and told the installer where my profile directory was.

The computer got rebooted and all of my software settings (and most of the preinstalled software I use) just came back online without a hitch. Simply amazing.

I used to spend a half-day doing OS upgrades, where I pulled out CD after CD to install software and then configure everything and reload settings. I just opened firefox and thunderbird and all my bookmarks and e-mail settings were just there. I probably had the whole OS upgraded in about 20 minutes and installed a few extra programs (which can be done in a batch btw) and that was it.

The computer response is far better than I had with Ubuntu 9.4, so far, I haven't had any of the sound problems (yet), open office and flash seem to be running much smoother now.

I haven't timed the how long the computer boots up, but I am up and running from a cold start in about 30 seconds. All in all, I am a pretty happy camper now.

Wednesday, October 28, 2009

90% of your computer cycles are wasted

I usually work with the task manager open as sort of a habit so I might have a general idea when my computer might start lagging on me, and it does from time to time. But for most of the time, the task manager usually has your CPU idling at about 3~5% of it's max usage for most of the time.

For all the impressive CPU speed we've got with growing clock speed and then now with the growing number of CPU cores, we just aren't using the computer to their maximum potential and it is going to stay that way for years to come-- it's just that most programs are very dependent on human input.

But what if we could reduce the need for a computer to try on human input and perform useful work while we are not around? I believe that there is an immense opportunity for software like these. Seti@home did something like this but it's more for charitable work. What if background processes could be created for a PC to your work while you're not using it?

To me, I think that would be awesome.

Tuesday, October 27, 2009

The things that you should do, but don't

There are whole bunch of things that I want to do but don't get around to. I come home, read the news (most of it garbage), play some computer games, goof off some more then all of a sudden it's 2 am and it's off to bed else I'll be screwed for the following morning.

Most of the time I spend after work goes into killing time, unfortunately and nearly everyday it feels like a terrible waste, but yet... it... is... so addictive. It's terrible because the time could be used for so much better purposes.

Will power is one of those strange things about human nature. I do wonder why can it be so hard to do the things that you want/should do? I used to think like a mathematician, since the solution was possible and it could be solved/done then no further work is necessary. Unfortunately, things don't usually work out like that and a lot of will power is required to do the hard work to accomplish something.

So there are a ton of things that I want to do but never get around to doing. How does one becomes excellent with executions with plans? I don't know, but for now, it just comes and goes with me. There are times when I really want to get out and do things and other times I'm must "meh." The real trick is finding the recipe to getting the things that you know you should do. The right motivation? It's gotta be something along that direction.

Saturday, October 24, 2009

On Ubuntu: Pretty good, still some raw edges

I switched out of the Windows about 2 years ago. I started of with an EEE PC, the first one that ran the Xandros linux distribution while I was backpacking through asia and didn't think it was bad at all. I got internet, could watch videos, listen to music and make skype calls through the little thing. My impressions of the Linux OS system was that it wasn't bad.

So last year, I bought myself a desktop PC because I had enough troubles with my laptops dying on me and the rediculous repair fees and the turn around time to get my computer back. If the laptop dies, then it is going to be chucked. Why spend $400~$500 for repairs if for about double the price you can usually get double the performance (which is about after the warrenty expires!). But spending $1000 for a new laptop is pricey anyways so I have moved onto using netbooks which cost in the $400 range. Completely disposable if something goes wrong. But I am going off on a tangent.

Anyways, about Ubuntu.

Ubuntu is a packaged version of Linux by a commercial group called Canonical. These guys basically put an interface on top of the thing, streamed lined the installation interface and have been working on the thing to make Linux user friendly. They've done a pretty good job of making the system user friendly as the installation process was quite smooth and testing the OS before you install it through the live CD is a nice feature. You can even install it through a USB disk if you like even.

I will note that the distribution is generally based on the same software base but with a different set of selected software installed. When some something doesn't work, it usually a configuration error or incompatibility of some software working with other software. Ubuntu it self isn't entirely to blame if the base software is buggy (the solution, however is a better selection with more stable software). Anyways, let's get started.

A little on hardware

Hardware support is fairly good, for generic pieces of hardware. You won't have problems with the video card which is usually the only piece of hardware that people install on their own. But support for other pieces of hardware is sometimes sketchy (everything else is OK though)

For example, I installed a new TV capture card designed to work on the PCI-e bus but found out after in installing the thing that there weren't any drivers that supported it. And no, it isn't as simple as looking up the part on the internet to see if the thing is supported. I was basically using commands to ID the chips the capture card used to see if there was any support for the thing. It turns out that there isn't for the time being and I would have been better off buying a card that ran on the standard PCI bus.

For "exotic" hardware sometimes things don't work, but it is a work in progress.

On Open Office, the MS office replacement

I am a heavy excel user. I do lots of calculations and usually deal with lots of data. One thing I've noticed about Calc for Open Office is that it is slow. I hate slow software. Interacting with the spreadsheet can start getting jerky when a data set is large and you are flying through the data. It is disorientating, but still usable. The spreadsheet experience on MS office is more pleasant. The Office Office word processor isn't bad, but I don't generally use word processors that much now a these days -- it's mainly simple text editors I use for programming

Sound has some bitchy quirks

If sound doesn't work properly, then it can be a show stopper. Sound didn't work perfectly me right out of the gate when I installed Ubuntu. Sure I could play music but from time to time the music would skip. I used to have skipping mp3s on a 90 MHz computer about 10 years ago, mp3s were just catching on at that time and it was acceptable. This is 10 years later and I am on a 1.6 GHz dual CPU computer having skipping sound out of the box isn't going to be acceptable for people that didn't have problems on a windows platform.

I eventually got the problem fixed after searching on the internet to install some patches and then do some tweaking. The problems seem to be different from computer to computer and not all of them always worked. The whole sound problem is through a sound server system (which in theory is nice, but still need more work in practice) called PulseAudio. For many people pulseaudio is the bane of their sound experience because sometimes it works properly and other times it doesn't.

Pulseaudio is a software layer that handles sound processing and mixing, which some of the older Linux sound drivers were not able to handle. Before you could only have one piece of software using the sound card at a time then software started to get developed to enable mixing.

There is a long story about this here. Read it if you have time, but it explains the development of sound for linux... and sort of why we have problems with sound from time to time.

Slow hard drive transfers (intermittent, but recently fixed)

There are times when I had to move large amounts of data around on the computer that would drive me nuts. Considering that I had bought new hard drives and wanted to redistribute my data, sometimes the transfer rates would be in the order of just a few 4~8 MB/sec. Slow compared to what you should be getting, which is in the 70~80 MB/sec range which you should be getting. The problem turned out to be a problem with the x64 version of ubuntu for AMD CPUs. I eventually downgraded to a 32bit version to get more relyable transfer rates. The 32 bit version, is also more stable than the 64 bit version (flash works properly and doesn't crash as much).

There were people out there that said that the 64 bit version of Ubuntu was stable. It wasn't good enough for me, and the 32 bit version is more mature. Had to learn it the hard way.

So you have a few problems, here's a shovel and dig

When it comes to dealing with software problems with Ubuntu your best resource is the Ubuntu forums, where many people ask questions and post about their problems. From my personal experience, searching through the forum is a pain in the ass. The search isn't good enough and sometimes the solutions I've found were for older versions which may not apply to the version I am using. This needs fixing.

There are people out there that are nice enought to post a link to a main article posted somewhere which my search didn't hit with solution for some strange reason. But still, I consider myself a competent searcher and I shouldn't have to go through a maze of comments to find what I am looking for.

Problems that many people face should be put somewhere more proiminent where people can find them easier. I've killed countless hours searching for a solution to some problem. It shouldn't be a needle in a haystack problem.

Free software is decent

Ubuntu is based on the Debian distribution, which uses a software repository system. Basically people that make software in their free time upload it to the repository and you can search the repository for something that you might need. There is a whole slew of stuff uploaded there, from video, image, sound editing, office applications, games (most amature, but some polished ones out there) and more. I am somewhat fond of the software repository because many of the programs that I would usually have to go out and buy, is there and available for free, legally.

Compared with Xandros and Windows?

I used Xandros for my first EEE-PC and I had a very enjoyable experience with that platform. The software on the computer was stable and I didn't have many bugs to deal with. I never really even have to trouble shoot the software on the system even once which I was pretty happy about.

Software should just work and perform well. I understand that making software and getting all the bugs out is a pain but polish is important. I don't have time to deal with problems. In my experience so far, there are distributions that exist out there where I have never had to debug and I may want to switch over in the future.

In general, the experience in Ubuntu is pretty decent and there are things in the Linux world that would put Windows to shame. The boot time for one is pretty quick. I can have the system up and running in about 30 seconds and I mean responsive. None of this, "let's get the log in screen quickly, but I am still loading" which we see in Windows... after logging in, I still can't use the computer for about 30 more seconds!

Conclusion

I took a leap into the Linux world, it isn't bad and there is some pretty nice cutting edge stuff out here. And if you like desktop eye candy (Compiz Fusion), some of the Linux features can blow the top of windows. See video here. This video is more than 2 years old and there are newer videos out there but I didn't care for the music to them.

Is it useful? Well, not really but it's cool. MS eventually copied some of it's features to Vista. They didn't do too good of a job of it and you got the hog which is known as Vista. Compiz fusion is to desktops as are boobs to women -- they're just sexy. But anyways...

So there you have it. I'm content with Ubuntu for now, but with some of the annoying experiences, I may trade up to something better something comes my way. The 9.10 version will be released at the end of this month and I'll be upgrading. If I get too annoyed, I'll go find another distro to try. But for now, I'm not going back to the world of windows.

Sunday, October 04, 2009

Back from the country side

Back from the country side in Japan. it was a long weekend the last week and took the chance to head out to Nagano for 5 days. It was great. Photos will be up later on!

In other news, the company dorm is having the shared connection shut down and everyone will be transitioning over to and ISP of their choice. Looks like the building is wired up with a shared optical connection. Going to be spending about $48/month for internet with gigabit speed. We'll see how this thing stacks up, going to be looking forward to it though, the old shared connection that I used to be on was not the fastest thing in the world, but sufficient enough for me to do the basic internet-y stuff, downloads, online videos, music and webpages.