I looked up on the Japanese postal service website this weekend that postcards cost about 80 cents to send abroad. In Japan, it is rather customary for people to send out post cards for seasonal greetings. I bought a bunch of then wrote them up and sent out 15 of them just today.
I then go back to the site to take a look around and realize that "greeting cards" cost $1.20 to send abroad. If it says "happy birthday," "congratulations" or "merry Christmas," then instead of the usual post card price the price to send out my cards jumps up to the $1.20 price mark. Instead of "net neutrality," I think we need "postal neutrality!"
Long story short, it means that the cards that I spent a few days writing are apparently going to get trashed. If you get your card late, you'll know why... time to do some re writing....
bah humbug!
Monday, December 14, 2009
Tuesday, December 08, 2009
My outlook on the US economy
Obviously from the last post, I have been busy so I haven't had much time to much in depth research as of late into the economy but my forecasts are still going to be bleak for the US economy. I haven't been doing much research as of late so I'll be talking off the hip today, it's late and I should be in bed.
What I will be watching for in the US is their debt and interest levels for the foreseeable future because that will be effecting the value of the US dollar, tax rates and bank interest rates. Interest rates in the US was at about 5% before the whole housing crash, which brought down the interest rate at 0.25%.
Using a future value of money model with the internal rate of return set at the FED interest rate we can calculate for the present value of a security that provides a perpetual return. The present value is multiplied by the annuity by a constant, dependent on the interest rate. I have no time to write the formula here but for those in the know, you know where to look or how to do the calculation.
At 0.25% the factor is 401 and at the FED rate of 5% at 2007 the factor drops down to 21. This model obviously breaks down for very small values of interest rates because the multiplier starts to become huge. As interest rates drop we should expect stock prices to rise. This was exactly what happened as the FED started cutting interest rates. What they were really doing was masking the real drop in equity prices by lowering the FED rates, thus pushing up stock prices. With the FED rates at 0.25%, they have nowhere to go when it comes to rate cuts and the only direction that the interest rates is up. Unless the US decided to pull a Sweden and go for negative interest rates. This scenario is unlikely.
The multiplier curve for the present value of cash as a function of interest rate is very steep at interest rates rise from a very small interest rate. The US economy is still very weak as it is right now and raising interest rates will cause equity and commodity prices to fall considerably. While interest rates are low, however, money will be pumped into the financial system leading to inflation. The drop in the USD is already is a direct result of this. As long as the FED rates continue to be this low and the US continues to pump out debt, expect further devaluation of the USD.
The only thing that will stop value erosion of the USD is if the US economy becomes productive, producing a financial surplus to pay off their debt and with significant enough profits such that the FED can raise rated without killing the economy. I don't think this will be happening for a while.
We've already seeing speculation on a interest rate hike because the USD is getting hammered. If a rate hike does happen, it will probably be done to stave off fears of inflation in the sort term by temporarily driving down prices of say gold and oil, but I believe that the economy is still going down; I think it's just rumor mongering to temporarily stop the drop in USD and rises in gold. The economy will continue to drop until the full extent of bad investments have been realized. In other words, until when the parties that made the bad investments have taken their losses. Unfortunately, these losses are being mitigated from the private sector to the public by bailouts to banks and other large institutions.
Recovery will happen if these institutions become profitable using public money and paying off their debts. If that doesn't happen then these institutions will likely to continue on a "life support system," until someone pulls the plug on them. It's a matter of accepting the losses or trying to pretend that nothing happened and climbing out of a hole with a weight around your neck.
For US economy to improve, we need to see debt numbers to stabilize and see good investments in the economy. Right now, I don't see it. People don't have money to invest and they have too much debt. The people that can probably make the biggest difference are the ones that don't have debt, either people that are too young to have debt or the very rich with no debt. People without debt are the ones with power.
What I will be watching for in the US is their debt and interest levels for the foreseeable future because that will be effecting the value of the US dollar, tax rates and bank interest rates. Interest rates in the US was at about 5% before the whole housing crash, which brought down the interest rate at 0.25%.
Using a future value of money model with the internal rate of return set at the FED interest rate we can calculate for the present value of a security that provides a perpetual return. The present value is multiplied by the annuity by a constant, dependent on the interest rate. I have no time to write the formula here but for those in the know, you know where to look or how to do the calculation.
At 0.25% the factor is 401 and at the FED rate of 5% at 2007 the factor drops down to 21. This model obviously breaks down for very small values of interest rates because the multiplier starts to become huge. As interest rates drop we should expect stock prices to rise. This was exactly what happened as the FED started cutting interest rates. What they were really doing was masking the real drop in equity prices by lowering the FED rates, thus pushing up stock prices. With the FED rates at 0.25%, they have nowhere to go when it comes to rate cuts and the only direction that the interest rates is up. Unless the US decided to pull a Sweden and go for negative interest rates. This scenario is unlikely.
The multiplier curve for the present value of cash as a function of interest rate is very steep at interest rates rise from a very small interest rate. The US economy is still very weak as it is right now and raising interest rates will cause equity and commodity prices to fall considerably. While interest rates are low, however, money will be pumped into the financial system leading to inflation. The drop in the USD is already is a direct result of this. As long as the FED rates continue to be this low and the US continues to pump out debt, expect further devaluation of the USD.
The only thing that will stop value erosion of the USD is if the US economy becomes productive, producing a financial surplus to pay off their debt and with significant enough profits such that the FED can raise rated without killing the economy. I don't think this will be happening for a while.
We've already seeing speculation on a interest rate hike because the USD is getting hammered. If a rate hike does happen, it will probably be done to stave off fears of inflation in the sort term by temporarily driving down prices of say gold and oil, but I believe that the economy is still going down; I think it's just rumor mongering to temporarily stop the drop in USD and rises in gold. The economy will continue to drop until the full extent of bad investments have been realized. In other words, until when the parties that made the bad investments have taken their losses. Unfortunately, these losses are being mitigated from the private sector to the public by bailouts to banks and other large institutions.
Recovery will happen if these institutions become profitable using public money and paying off their debts. If that doesn't happen then these institutions will likely to continue on a "life support system," until someone pulls the plug on them. It's a matter of accepting the losses or trying to pretend that nothing happened and climbing out of a hole with a weight around your neck.
For US economy to improve, we need to see debt numbers to stabilize and see good investments in the economy. Right now, I don't see it. People don't have money to invest and they have too much debt. The people that can probably make the biggest difference are the ones that don't have debt, either people that are too young to have debt or the very rich with no debt. People without debt are the ones with power.
Got sent home early from work; did too much over time
Looks like there are even limits to the Japanese when it comes to doing crazy overtime hours. I've been busy building a new generation of prototype samples. The schedule is kind of tight so I've been working some long hours to get things done. In addition, I managed to develop a simple simulation model to start evaluating our devices.
The guys I work with are hard core experimental types and there seem to be a lack of theorists in the group. From the measurement data we've been collecting, I've found that I can back solve for some device properties like resistance and semiconductor constants. We've never been able to get hard numbers before and this is a first for the group. I ended up staying in the office till 2 am on a Friday night summarizing data and writing up a presentation for our Monday meetings because I knew I'd be busy with experimental work.
Apparently I hit an internal 16 hour work day limit. Meaning that it is usually mandatory for people to take the next day off. Unfortunately on my experimental schedule, I don't have the luxury of taking the next day off. Since I have booked machine time and the experiments must go on. Instead, I got sent home early, at 5 pm, because HR called in to say that I shouldn't be doing any over time. The call was at 4 pm and I got into the office by 7 am and I was already on overtime.
I spent the weekend chilling out, doing nothing but after getting home and eating dinner, I konked out and slept for 4 hours. It's 1:30 am now and I'm need to get into the office by 7 am again to start taking data. The problem is that I'm not sleepy. Tomorrow is going to be rough.
Looking forward to a vacation and I'll be taking one later this month. But more on that later.
The guys I work with are hard core experimental types and there seem to be a lack of theorists in the group. From the measurement data we've been collecting, I've found that I can back solve for some device properties like resistance and semiconductor constants. We've never been able to get hard numbers before and this is a first for the group. I ended up staying in the office till 2 am on a Friday night summarizing data and writing up a presentation for our Monday meetings because I knew I'd be busy with experimental work.
Apparently I hit an internal 16 hour work day limit. Meaning that it is usually mandatory for people to take the next day off. Unfortunately on my experimental schedule, I don't have the luxury of taking the next day off. Since I have booked machine time and the experiments must go on. Instead, I got sent home early, at 5 pm, because HR called in to say that I shouldn't be doing any over time. The call was at 4 pm and I got into the office by 7 am and I was already on overtime.
I spent the weekend chilling out, doing nothing but after getting home and eating dinner, I konked out and slept for 4 hours. It's 1:30 am now and I'm need to get into the office by 7 am again to start taking data. The problem is that I'm not sleepy. Tomorrow is going to be rough.
Looking forward to a vacation and I'll be taking one later this month. But more on that later.
Sunday, December 06, 2009
Do they want a blood sample too?
What does making an online transaction have to be such an intrusive procedure. If I was buying a physical item, I would understand why I would need to provide my address and contact information, but when it comes to buying something like a music subscription to some streaming audio, do they need my address and telephone number?
The payment is done through paypal and this is the amount of detail they want out of people doing transactions through them. When I go in person to make a physical transaction with my card, I am not asked my age, where I live or for any contact information. What next, do they need a blood sample too? I shake my head at this.
The payment is done through paypal and this is the amount of detail they want out of people doing transactions through them. When I go in person to make a physical transaction with my card, I am not asked my age, where I live or for any contact information. What next, do they need a blood sample too? I shake my head at this.
Saturday, December 05, 2009
Friday night, at the office till 2 am
I don't know why I did it. I managed to create a crude model of a resistor and a diode and it looks like I can get plenty of data out of some measurement data. I still can't convey complicated thoughts in written Japanese but after finishing experimental work at 11 pm, I was compelled to stay late at the office to finish writing a presentation for a regular Monday meeting.
I gave up writing in Japanese for the first time. I had detailed ideas that I wanted to communicate, that unfortunately are beyond my skills to convey in written Japanese. I find it awkward that I can't think as deeply in a second language and sadly a lot of information does go over my head. Learning to master a second language and being able to communicate in the subtle nuances is tough stuff. There's more to communication than just the words. It's like a good joke; it's about the delivery.
Language is more than just words.
I gave up writing in Japanese for the first time. I had detailed ideas that I wanted to communicate, that unfortunately are beyond my skills to convey in written Japanese. I find it awkward that I can't think as deeply in a second language and sadly a lot of information does go over my head. Learning to master a second language and being able to communicate in the subtle nuances is tough stuff. There's more to communication than just the words. It's like a good joke; it's about the delivery.
Language is more than just words.
Monday, November 30, 2009
A day off to do nothing
I decided to have the day off today and it's great. Turns out that if I worked today, I would have over run my over time limit and since I maxed out my over time hours already, I might as well take the day off and expect a nice pay cheque for this month's work.
I woke up at 10 am for once, which was nice as I've been starting work at either 8 or 7 am recently. Just because it is hard to get machine time other wise. Everyone likes to work late so I've decided to in the other direction to start early, use all of the busy machines and switch over to the less busy equipment later in the day. This method of working does wonders because I don't have to waste the day waiting for equipment to become available.
Things have been so busy as of late that I haven't had the time to catch up on doing a lot of small things like cleaning the room, going out and buying things like new socks or what not since I just don't feel like doing too much after coming home from work; it might be some exercise in my room while watching a few episodes off West Wing on the computer.
One of the nice things about having a weekday off is that no one else is available, meaning that I have plenty of time to concentrate to do things like program instead of getting dragged out (which isn't a bad thing of course). It's so much easier to concentrate on a project when you have an entire day to dedicate to it, instead of doing something after work. I've started to understand why people mention that it's really hard to work on something like a startup while working for an ordinary company. It takes free time and concentration to make something, which is something that I don't have a whole lot of after work.
Though I usually have a few hours of relaxation time before I go to bed after work, if I can get focused enough, I might be able to use those hours for something productive. So I'm going to try and see how that goes.
I woke up at 10 am for once, which was nice as I've been starting work at either 8 or 7 am recently. Just because it is hard to get machine time other wise. Everyone likes to work late so I've decided to in the other direction to start early, use all of the busy machines and switch over to the less busy equipment later in the day. This method of working does wonders because I don't have to waste the day waiting for equipment to become available.
Things have been so busy as of late that I haven't had the time to catch up on doing a lot of small things like cleaning the room, going out and buying things like new socks or what not since I just don't feel like doing too much after coming home from work; it might be some exercise in my room while watching a few episodes off West Wing on the computer.
One of the nice things about having a weekday off is that no one else is available, meaning that I have plenty of time to concentrate to do things like program instead of getting dragged out (which isn't a bad thing of course). It's so much easier to concentrate on a project when you have an entire day to dedicate to it, instead of doing something after work. I've started to understand why people mention that it's really hard to work on something like a startup while working for an ordinary company. It takes free time and concentration to make something, which is something that I don't have a whole lot of after work.
Though I usually have a few hours of relaxation time before I go to bed after work, if I can get focused enough, I might be able to use those hours for something productive. So I'm going to try and see how that goes.
Wednesday, November 25, 2009
There ought to be good money in reporting software
The thing about working in a large company is that there are lots of meetings. It's unimaginable how many meetings there are. We have meetings for general office announcements, a meeting for one sub group, then there are other meetings for other sub-groups, other meetings for managers and etc.
In my situation, I am working on a project that has implications to a few other teams and thus it becomes necessary to attend several other meetings to keep everyone abreast of what is going on. The problem is that once you start attending many meetings, the time to make presentation material starts eating into time that could have been used for me to get real work done.
Things for me are starting to move out of the research to the development phase, which means that the work we do is starting to be come more standardized and more focused more on making incremental improvements instead of radical changes. For me, this means generally carrying out the same experiments with slightly different conditions to try and find the perfect parameters to make what we're building. There is a crap load of data that needs to be taken, plotted and then thrown into a power point presentation and that does take up a considerable amount of time.
I've already managed to cut down some of that time to automate the analysis but, it seems to me that more is possible to speed things up. Specifically, if I could find a way to automate to take data and automatically make reports and presentations out of them then life would be a hell of a lot easier for me and I can imagine how software like this could be useful in similar kinds of corporate situations. There are likely companies out there that do specifically this when it comes to finances, sales, inventory tracking and more.
There are companies that do exactly this and most likely make good money by tailoring their software to their client's needs and having something like this right now, would really be a kick ass tool.
In my situation, I am working on a project that has implications to a few other teams and thus it becomes necessary to attend several other meetings to keep everyone abreast of what is going on. The problem is that once you start attending many meetings, the time to make presentation material starts eating into time that could have been used for me to get real work done.
Things for me are starting to move out of the research to the development phase, which means that the work we do is starting to be come more standardized and more focused more on making incremental improvements instead of radical changes. For me, this means generally carrying out the same experiments with slightly different conditions to try and find the perfect parameters to make what we're building. There is a crap load of data that needs to be taken, plotted and then thrown into a power point presentation and that does take up a considerable amount of time.
I've already managed to cut down some of that time to automate the analysis but, it seems to me that more is possible to speed things up. Specifically, if I could find a way to automate to take data and automatically make reports and presentations out of them then life would be a hell of a lot easier for me and I can imagine how software like this could be useful in similar kinds of corporate situations. There are likely companies out there that do specifically this when it comes to finances, sales, inventory tracking and more.
There are companies that do exactly this and most likely make good money by tailoring their software to their client's needs and having something like this right now, would really be a kick ass tool.
Tuesday, November 24, 2009
The West Wing
Just started watching The West Wing a few weeks ago and it's a series that I've found myself rather addicted to. I wouldn't call myself a political junkie and usually I am quite happy to stay clear of politics, but for some reason, because of the exceptional writing and interesting characters, I'm hooked.
Hard to imagine that this was a pretty old series, but the story is pretty good and it's fascinating watching a series about busy people running the Whitehouse. I even thought that the series at first was about pilots... but I had it confused with another series called Wings.
Just goes to say how far out of the loop I've been with TV.
Hard to imagine that this was a pretty old series, but the story is pretty good and it's fascinating watching a series about busy people running the Whitehouse. I even thought that the series at first was about pilots... but I had it confused with another series called Wings.
Just goes to say how far out of the loop I've been with TV.
Sunday, November 22, 2009
Prioritization
Prioritizing things to do is important. I've just started to have that concept sink into my head recently. Time is becoming scarce. During the weekdays, I have work and come home usually brain fried; meaning that I don't want to do any other work after work. Weekends are dedicated to going out, meeting people or other recreational things. This leaves me with the feeling that I don't have much time to do anything else and I see that as a problem.
I equate the the flow of a person's life to a position-velocity-acceleration kind of physics model. Basically, you are at some position, moving in some direction at some speed at some time in your life. Work needs to be applied to change one's momentum to change the vector of your direction and speed to get to desirable position.
Excuse the looseness of the language but to affect change in one's life occurs when one produces that "work" which I define as work = effort*time. In other words, no effort or time means no change.
I view work (as in working for a company) as "dead time" which is where a person trades time for money. Relaxation time is a by product of recovering from work which also falls into this category. Whatever is left can be invested into one's self into productive means... if one so chooses to do so and it is this kind of time that I find precious.
This is where prioritizing comes in.
When I used to be a student, my priorities used to be relatively simple. I had a set of courses that I needed to pass/obtain good marks in and I would allocate time to do what was necessary. Being human, it was usually the allocation of the "minimum" amount of time to do what was necessary and the rest to do whatever else I wanted to do, which was goofing off. Life back then was simple because my priorities were simple.
Now that I have graduated from University and moved into the work force, those priorities are gone. Now what?
What are your priorities?
I've been trying to prioritize what I've been wanting to do for the last while but couldn't come up with anything then it dawned on me for a second that I wasn't sure of what my priorities were. It wasn't one of those black and white moments that whacked me in the face, but one of those "maybe I don't know what my priorities are" kind of thoughts that made me want to write about this.
In no particular order of importance, my general priorities are :
1. Enjoy life
2. Maximize income for minimal work
3. Do work/projects that I enjoy
4. Travel
5. Have an awesome girlfriend
6. Have a circle of friends that is talented, reliable, active and fun
7. Family
Short term priorities:
1. Establish a reputation at current company
2. Perfect my Japanese
3. Learn Chinese
4. Head into automation technologies (both informational and physical)
5. Improve memory
6. Increase muscle mass, get a mild 6 pack
7. Passive income stream
8. Develop a network of talented people
9. Reduce time wasted goofing off
The list is by no means definitive and will likely chance in as my priorities change, but I'll leave it as an alpha version for now.
It's obvious that there are many things that I want to do and there isn't going to be enough time for me to do everything. Being ruthless at making decisions is not one of those things that I am particularly good at but when it comes to having a tight time budget, one does not have much of a choice when it comes to making a plan. Playing an active role in making a time table for one's self personal life seems as something unnatural, but it is going to be something that I need to do.
The other thing is that I also have a bad habit of getting sucked into events and work that aren't particularly aligned to my priorities. I just have a terrible habit of saying "yes" to everything and I am going to have to put an end to that because I've been stretching myself too thin in the time department recently.
Well, here is a start and we'll se how things go.
I equate the the flow of a person's life to a position-velocity-acceleration kind of physics model. Basically, you are at some position, moving in some direction at some speed at some time in your life. Work needs to be applied to change one's momentum to change the vector of your direction and speed to get to desirable position.
Excuse the looseness of the language but to affect change in one's life occurs when one produces that "work" which I define as work = effort*time. In other words, no effort or time means no change.
I view work (as in working for a company) as "dead time" which is where a person trades time for money. Relaxation time is a by product of recovering from work which also falls into this category. Whatever is left can be invested into one's self into productive means... if one so chooses to do so and it is this kind of time that I find precious.
This is where prioritizing comes in.
When I used to be a student, my priorities used to be relatively simple. I had a set of courses that I needed to pass/obtain good marks in and I would allocate time to do what was necessary. Being human, it was usually the allocation of the "minimum" amount of time to do what was necessary and the rest to do whatever else I wanted to do, which was goofing off. Life back then was simple because my priorities were simple.
Now that I have graduated from University and moved into the work force, those priorities are gone. Now what?
What are your priorities?
I've been trying to prioritize what I've been wanting to do for the last while but couldn't come up with anything then it dawned on me for a second that I wasn't sure of what my priorities were. It wasn't one of those black and white moments that whacked me in the face, but one of those "maybe I don't know what my priorities are" kind of thoughts that made me want to write about this.
In no particular order of importance, my general priorities are :
1. Enjoy life
2. Maximize income for minimal work
3. Do work/projects that I enjoy
4. Travel
5. Have an awesome girlfriend
6. Have a circle of friends that is talented, reliable, active and fun
7. Family
Short term priorities:
1. Establish a reputation at current company
2. Perfect my Japanese
3. Learn Chinese
4. Head into automation technologies (both informational and physical)
5. Improve memory
6. Increase muscle mass, get a mild 6 pack
7. Passive income stream
8. Develop a network of talented people
9. Reduce time wasted goofing off
The list is by no means definitive and will likely chance in as my priorities change, but I'll leave it as an alpha version for now.
It's obvious that there are many things that I want to do and there isn't going to be enough time for me to do everything. Being ruthless at making decisions is not one of those things that I am particularly good at but when it comes to having a tight time budget, one does not have much of a choice when it comes to making a plan. Playing an active role in making a time table for one's self personal life seems as something unnatural, but it is going to be something that I need to do.
The other thing is that I also have a bad habit of getting sucked into events and work that aren't particularly aligned to my priorities. I just have a terrible habit of saying "yes" to everything and I am going to have to put an end to that because I've been stretching myself too thin in the time department recently.
Well, here is a start and we'll se how things go.
Wednesday, November 11, 2009
Developing a Crawler and Parser library
The internet has a huge plethora of readily accessible information, the problem is that the average human being isn't able to process large quantities of information in a short period of time. So I have taken to the task of developing a small library of functions to allow me to automate downloading of webpages and extract data out of them for analysis.
This project of mine has been going on and off for the past year since doing work in matlab and then moving on to python which has the advantage of running multi-threaded programs. This is a must since you are usually limited to the response time and the speed of a website instead of the processing capabilities of your CPU. Processing textual data can be ridiculously fast, even for an interpretive language like python.
Mashing up data from different sources is a very fascinating experience and I do see some interesting opportunities in the future. The first application I designed was downloading all the prices of different CPUs from an online store and then combining that data with published benchmarking data from another site. Using both pieces of information, I could easily calculate price/performance ratios for every listed CPU to select a CPU which was best suited to my computing requirements and price range. I wouldn't have to thumb through long benchmarking articles anymore to figure out what might be the best CPU for me.
It even gets better as the process can also be automated to the point where it is possible to create a program that will inform me when certain products have gone on sale and notify me if I would like to purchase something. This brings a new paradigm to shopping as it becomes possible to set up an automated notification system when something you want comes into your price range. This is a good thing since you don't have to waste time reading advertisements since you have a program that does that for you.
I am now ramping up the scale of this program to allow me to download larger data sets to mash up financial data from publicly stocks with their stock price to see if I can develop a valuation model to determine the fair price of a stock by using fundamental data. Instead of limiting myself to tracking small groups of stocks, I might be able to look at the stock market as a whole. Using a large data set to look at pricing distributions I can determine with greater confidence as to what makes one stock expensive or cheap compared to another set of stocks or perhaps understand what is going on with the stock market as a whole instead of the filtered (and usually useless) information provided through most financial sites.
The power of this program is immense as I have been working on downloading financial reports from every company listed company for the past 10 years. To get to this data, one must transverse several webpages to finally get to the real data. In the past week, I have already downloaded and parsed 180,000 webpages so far and will be going be downloading another 150,000 tonight while I sleep. This program has read and processed more than I will ever read in my entire lifetime and I think that is amazing.
I have no idea what I am going to learn yet, but the prospect of looking at large data sets and interpreting them has me quite excited. I am looking forward to working on this little project.
This project of mine has been going on and off for the past year since doing work in matlab and then moving on to python which has the advantage of running multi-threaded programs. This is a must since you are usually limited to the response time and the speed of a website instead of the processing capabilities of your CPU. Processing textual data can be ridiculously fast, even for an interpretive language like python.
Mashing up data from different sources is a very fascinating experience and I do see some interesting opportunities in the future. The first application I designed was downloading all the prices of different CPUs from an online store and then combining that data with published benchmarking data from another site. Using both pieces of information, I could easily calculate price/performance ratios for every listed CPU to select a CPU which was best suited to my computing requirements and price range. I wouldn't have to thumb through long benchmarking articles anymore to figure out what might be the best CPU for me.
It even gets better as the process can also be automated to the point where it is possible to create a program that will inform me when certain products have gone on sale and notify me if I would like to purchase something. This brings a new paradigm to shopping as it becomes possible to set up an automated notification system when something you want comes into your price range. This is a good thing since you don't have to waste time reading advertisements since you have a program that does that for you.
I am now ramping up the scale of this program to allow me to download larger data sets to mash up financial data from publicly stocks with their stock price to see if I can develop a valuation model to determine the fair price of a stock by using fundamental data. Instead of limiting myself to tracking small groups of stocks, I might be able to look at the stock market as a whole. Using a large data set to look at pricing distributions I can determine with greater confidence as to what makes one stock expensive or cheap compared to another set of stocks or perhaps understand what is going on with the stock market as a whole instead of the filtered (and usually useless) information provided through most financial sites.
The power of this program is immense as I have been working on downloading financial reports from every company listed company for the past 10 years. To get to this data, one must transverse several webpages to finally get to the real data. In the past week, I have already downloaded and parsed 180,000 webpages so far and will be going be downloading another 150,000 tonight while I sleep. This program has read and processed more than I will ever read in my entire lifetime and I think that is amazing.
I have no idea what I am going to learn yet, but the prospect of looking at large data sets and interpreting them has me quite excited. I am looking forward to working on this little project.
Saturday, October 31, 2009
Data Backup Action: Backing up a life time of data
If you have one HD crash, you're probably more likely to have another one in the future with the same hard drive.
Just yesterday, I had a small HD crash, leaving some data corrupted. I managed to backup most of my important data before the crash happened (what a stroke of luck) and restored stuff like my e-mail address book. I just realized that I have close to a life time of data sitting on this computer, starting from my university years.
Probably the most important data are my digital pictures and old university assignments. Looking back, I think I managed to solve some rather interesting problems in my spare time and I would hate for the work I did a long time back to get suddenly lost. Who knows, I might find some interesting use for them in the future. Probably the most important data to me are my pictures. I have digital photos dating all the way back to 2002 on this computer and it would be a terrible shame to lose them all. It's also quite interesting how all the data relating to our lives have become so digitized of the span of the last decade. Children born nearly 10 years ago, may be able to store their entire lifetime of photos in a digital format and by the time they grow old, they'll have a digital photo album of their entire life. The sound of a project like that now sounds really fascinating to me and I think there are lots of interesting opportunities for this kind of data. But I digress.
After the small crash I had yesterday, I just realized how vulnerable my data was and decided it was time to start baking up data that I'd hate to lose, mainly all my application data, pictures, university work, and music collection.
The interesting part of this is how little data I have, about 130 GB of data. I have about 3 GB hard drive space on the computer! Maybe over the course of a life time, I may only have about a 2~3 TB in total. That is amazing little compared to the size of a standard HD today.
Anyways, I just finished backing up all my data today on a separate HD and found a great program in Linux that just checks files and folders for changes only and will automatically update the archive copy. I've also setup the process to be automated so I'll have a fresh backup everyday. There is no way, I want to lose a lifetime of data now.
Perhaps it is also time to consider an offsite backup location too.
Just yesterday, I had a small HD crash, leaving some data corrupted. I managed to backup most of my important data before the crash happened (what a stroke of luck) and restored stuff like my e-mail address book. I just realized that I have close to a life time of data sitting on this computer, starting from my university years.
Probably the most important data are my digital pictures and old university assignments. Looking back, I think I managed to solve some rather interesting problems in my spare time and I would hate for the work I did a long time back to get suddenly lost. Who knows, I might find some interesting use for them in the future. Probably the most important data to me are my pictures. I have digital photos dating all the way back to 2002 on this computer and it would be a terrible shame to lose them all. It's also quite interesting how all the data relating to our lives have become so digitized of the span of the last decade. Children born nearly 10 years ago, may be able to store their entire lifetime of photos in a digital format and by the time they grow old, they'll have a digital photo album of their entire life. The sound of a project like that now sounds really fascinating to me and I think there are lots of interesting opportunities for this kind of data. But I digress.
After the small crash I had yesterday, I just realized how vulnerable my data was and decided it was time to start baking up data that I'd hate to lose, mainly all my application data, pictures, university work, and music collection.
The interesting part of this is how little data I have, about 130 GB of data. I have about 3 GB hard drive space on the computer! Maybe over the course of a life time, I may only have about a 2~3 TB in total. That is amazing little compared to the size of a standard HD today.
Anyways, I just finished backing up all my data today on a separate HD and found a great program in Linux that just checks files and folders for changes only and will automatically update the archive copy. I've also setup the process to be automated so I'll have a fresh backup everyday. There is no way, I want to lose a lifetime of data now.
Perhaps it is also time to consider an offsite backup location too.
OS Upgrade: Ubuntu 9.10
This is the fastest OS upgrade I've ever done.
I downloaded the newest version of Ubuntu last night and made a bootable USB stick. I nuked the old OS partition (note: I keep my profiles directory and data on a different partition) and then fired up the installer and told the installer where my profile directory was.
The computer got rebooted and all of my software settings (and most of the preinstalled software I use) just came back online without a hitch. Simply amazing.
I used to spend a half-day doing OS upgrades, where I pulled out CD after CD to install software and then configure everything and reload settings. I just opened firefox and thunderbird and all my bookmarks and e-mail settings were just there. I probably had the whole OS upgraded in about 20 minutes and installed a few extra programs (which can be done in a batch btw) and that was it.
The computer response is far better than I had with Ubuntu 9.4, so far, I haven't had any of the sound problems (yet), open office and flash seem to be running much smoother now.
I haven't timed the how long the computer boots up, but I am up and running from a cold start in about 30 seconds. All in all, I am a pretty happy camper now.
I downloaded the newest version of Ubuntu last night and made a bootable USB stick. I nuked the old OS partition (note: I keep my profiles directory and data on a different partition) and then fired up the installer and told the installer where my profile directory was.
The computer got rebooted and all of my software settings (and most of the preinstalled software I use) just came back online without a hitch. Simply amazing.
I used to spend a half-day doing OS upgrades, where I pulled out CD after CD to install software and then configure everything and reload settings. I just opened firefox and thunderbird and all my bookmarks and e-mail settings were just there. I probably had the whole OS upgraded in about 20 minutes and installed a few extra programs (which can be done in a batch btw) and that was it.
The computer response is far better than I had with Ubuntu 9.4, so far, I haven't had any of the sound problems (yet), open office and flash seem to be running much smoother now.
I haven't timed the how long the computer boots up, but I am up and running from a cold start in about 30 seconds. All in all, I am a pretty happy camper now.
Wednesday, October 28, 2009
90% of your computer cycles are wasted
I usually work with the task manager open as sort of a habit so I might have a general idea when my computer might start lagging on me, and it does from time to time. But for most of the time, the task manager usually has your CPU idling at about 3~5% of it's max usage for most of the time.
For all the impressive CPU speed we've got with growing clock speed and then now with the growing number of CPU cores, we just aren't using the computer to their maximum potential and it is going to stay that way for years to come-- it's just that most programs are very dependent on human input.
But what if we could reduce the need for a computer to try on human input and perform useful work while we are not around? I believe that there is an immense opportunity for software like these. Seti@home did something like this but it's more for charitable work. What if background processes could be created for a PC to your work while you're not using it?
To me, I think that would be awesome.
For all the impressive CPU speed we've got with growing clock speed and then now with the growing number of CPU cores, we just aren't using the computer to their maximum potential and it is going to stay that way for years to come-- it's just that most programs are very dependent on human input.
But what if we could reduce the need for a computer to try on human input and perform useful work while we are not around? I believe that there is an immense opportunity for software like these. Seti@home did something like this but it's more for charitable work. What if background processes could be created for a PC to your work while you're not using it?
To me, I think that would be awesome.
Tuesday, October 27, 2009
The things that you should do, but don't
There are whole bunch of things that I want to do but don't get around to. I come home, read the news (most of it garbage), play some computer games, goof off some more then all of a sudden it's 2 am and it's off to bed else I'll be screwed for the following morning.
Most of the time I spend after work goes into killing time, unfortunately and nearly everyday it feels like a terrible waste, but yet... it... is... so addictive. It's terrible because the time could be used for so much better purposes.
Will power is one of those strange things about human nature. I do wonder why can it be so hard to do the things that you want/should do? I used to think like a mathematician, since the solution was possible and it could be solved/done then no further work is necessary. Unfortunately, things don't usually work out like that and a lot of will power is required to do the hard work to accomplish something.
So there are a ton of things that I want to do but never get around to doing. How does one becomes excellent with executions with plans? I don't know, but for now, it just comes and goes with me. There are times when I really want to get out and do things and other times I'm must "meh." The real trick is finding the recipe to getting the things that you know you should do. The right motivation? It's gotta be something along that direction.
Most of the time I spend after work goes into killing time, unfortunately and nearly everyday it feels like a terrible waste, but yet... it... is... so addictive. It's terrible because the time could be used for so much better purposes.
Will power is one of those strange things about human nature. I do wonder why can it be so hard to do the things that you want/should do? I used to think like a mathematician, since the solution was possible and it could be solved/done then no further work is necessary. Unfortunately, things don't usually work out like that and a lot of will power is required to do the hard work to accomplish something.
So there are a ton of things that I want to do but never get around to doing. How does one becomes excellent with executions with plans? I don't know, but for now, it just comes and goes with me. There are times when I really want to get out and do things and other times I'm must "meh." The real trick is finding the recipe to getting the things that you know you should do. The right motivation? It's gotta be something along that direction.
Saturday, October 24, 2009
On Ubuntu: Pretty good, still some raw edges
I switched out of the Windows about 2 years ago. I started of with an EEE PC, the first one that ran the Xandros linux distribution while I was backpacking through asia and didn't think it was bad at all. I got internet, could watch videos, listen to music and make skype calls through the little thing. My impressions of the Linux OS system was that it wasn't bad.
So last year, I bought myself a desktop PC because I had enough troubles with my laptops dying on me and the rediculous repair fees and the turn around time to get my computer back. If the laptop dies, then it is going to be chucked. Why spend $400~$500 for repairs if for about double the price you can usually get double the performance (which is about after the warrenty expires!). But spending $1000 for a new laptop is pricey anyways so I have moved onto using netbooks which cost in the $400 range. Completely disposable if something goes wrong. But I am going off on a tangent.
Anyways, about Ubuntu.
Ubuntu is a packaged version of Linux by a commercial group called Canonical. These guys basically put an interface on top of the thing, streamed lined the installation interface and have been working on the thing to make Linux user friendly. They've done a pretty good job of making the system user friendly as the installation process was quite smooth and testing the OS before you install it through the live CD is a nice feature. You can even install it through a USB disk if you like even.
I will note that the distribution is generally based on the same software base but with a different set of selected software installed. When some something doesn't work, it usually a configuration error or incompatibility of some software working with other software. Ubuntu it self isn't entirely to blame if the base software is buggy (the solution, however is a better selection with more stable software). Anyways, let's get started.
A little on hardware
Hardware support is fairly good, for generic pieces of hardware. You won't have problems with the video card which is usually the only piece of hardware that people install on their own. But support for other pieces of hardware is sometimes sketchy (everything else is OK though)
For example, I installed a new TV capture card designed to work on the PCI-e bus but found out after in installing the thing that there weren't any drivers that supported it. And no, it isn't as simple as looking up the part on the internet to see if the thing is supported. I was basically using commands to ID the chips the capture card used to see if there was any support for the thing. It turns out that there isn't for the time being and I would have been better off buying a card that ran on the standard PCI bus.
For "exotic" hardware sometimes things don't work, but it is a work in progress.
On Open Office, the MS office replacement
I am a heavy excel user. I do lots of calculations and usually deal with lots of data. One thing I've noticed about Calc for Open Office is that it is slow. I hate slow software. Interacting with the spreadsheet can start getting jerky when a data set is large and you are flying through the data. It is disorientating, but still usable. The spreadsheet experience on MS office is more pleasant. The Office Office word processor isn't bad, but I don't generally use word processors that much now a these days -- it's mainly simple text editors I use for programming
Sound has some bitchy quirks
If sound doesn't work properly, then it can be a show stopper. Sound didn't work perfectly me right out of the gate when I installed Ubuntu. Sure I could play music but from time to time the music would skip. I used to have skipping mp3s on a 90 MHz computer about 10 years ago, mp3s were just catching on at that time and it was acceptable. This is 10 years later and I am on a 1.6 GHz dual CPU computer having skipping sound out of the box isn't going to be acceptable for people that didn't have problems on a windows platform.
I eventually got the problem fixed after searching on the internet to install some patches and then do some tweaking. The problems seem to be different from computer to computer and not all of them always worked. The whole sound problem is through a sound server system (which in theory is nice, but still need more work in practice) called PulseAudio. For many people pulseaudio is the bane of their sound experience because sometimes it works properly and other times it doesn't.
Pulseaudio is a software layer that handles sound processing and mixing, which some of the older Linux sound drivers were not able to handle. Before you could only have one piece of software using the sound card at a time then software started to get developed to enable mixing.
There is a long story about this here. Read it if you have time, but it explains the development of sound for linux... and sort of why we have problems with sound from time to time.
Slow hard drive transfers (intermittent, but recently fixed)
There are times when I had to move large amounts of data around on the computer that would drive me nuts. Considering that I had bought new hard drives and wanted to redistribute my data, sometimes the transfer rates would be in the order of just a few 4~8 MB/sec. Slow compared to what you should be getting, which is in the 70~80 MB/sec range which you should be getting. The problem turned out to be a problem with the x64 version of ubuntu for AMD CPUs. I eventually downgraded to a 32bit version to get more relyable transfer rates. The 32 bit version, is also more stable than the 64 bit version (flash works properly and doesn't crash as much).
There were people out there that said that the 64 bit version of Ubuntu was stable. It wasn't good enough for me, and the 32 bit version is more mature. Had to learn it the hard way.
So you have a few problems, here's a shovel and dig
When it comes to dealing with software problems with Ubuntu your best resource is the Ubuntu forums, where many people ask questions and post about their problems. From my personal experience, searching through the forum is a pain in the ass. The search isn't good enough and sometimes the solutions I've found were for older versions which may not apply to the version I am using. This needs fixing.
There are people out there that are nice enought to post a link to a main article posted somewhere which my search didn't hit with solution for some strange reason. But still, I consider myself a competent searcher and I shouldn't have to go through a maze of comments to find what I am looking for.
Problems that many people face should be put somewhere more proiminent where people can find them easier. I've killed countless hours searching for a solution to some problem. It shouldn't be a needle in a haystack problem.
Free software is decent
Ubuntu is based on the Debian distribution, which uses a software repository system. Basically people that make software in their free time upload it to the repository and you can search the repository for something that you might need. There is a whole slew of stuff uploaded there, from video, image, sound editing, office applications, games (most amature, but some polished ones out there) and more. I am somewhat fond of the software repository because many of the programs that I would usually have to go out and buy, is there and available for free, legally.
Compared with Xandros and Windows?
I used Xandros for my first EEE-PC and I had a very enjoyable experience with that platform. The software on the computer was stable and I didn't have many bugs to deal with. I never really even have to trouble shoot the software on the system even once which I was pretty happy about.
Software should just work and perform well. I understand that making software and getting all the bugs out is a pain but polish is important. I don't have time to deal with problems. In my experience so far, there are distributions that exist out there where I have never had to debug and I may want to switch over in the future.
In general, the experience in Ubuntu is pretty decent and there are things in the Linux world that would put Windows to shame. The boot time for one is pretty quick. I can have the system up and running in about 30 seconds and I mean responsive. None of this, "let's get the log in screen quickly, but I am still loading" which we see in Windows... after logging in, I still can't use the computer for about 30 more seconds!
Conclusion
I took a leap into the Linux world, it isn't bad and there is some pretty nice cutting edge stuff out here. And if you like desktop eye candy (Compiz Fusion), some of the Linux features can blow the top of windows. See video here. This video is more than 2 years old and there are newer videos out there but I didn't care for the music to them.
Is it useful? Well, not really but it's cool. MS eventually copied some of it's features to Vista. They didn't do too good of a job of it and you got the hog which is known as Vista. Compiz fusion is to desktops as are boobs to women -- they're just sexy. But anyways...
So there you have it. I'm content with Ubuntu for now, but with some of the annoying experiences, I may trade up to something better something comes my way. The 9.10 version will be released at the end of this month and I'll be upgrading. If I get too annoyed, I'll go find another distro to try. But for now, I'm not going back to the world of windows.
So last year, I bought myself a desktop PC because I had enough troubles with my laptops dying on me and the rediculous repair fees and the turn around time to get my computer back. If the laptop dies, then it is going to be chucked. Why spend $400~$500 for repairs if for about double the price you can usually get double the performance (which is about after the warrenty expires!). But spending $1000 for a new laptop is pricey anyways so I have moved onto using netbooks which cost in the $400 range. Completely disposable if something goes wrong. But I am going off on a tangent.
Anyways, about Ubuntu.
Ubuntu is a packaged version of Linux by a commercial group called Canonical. These guys basically put an interface on top of the thing, streamed lined the installation interface and have been working on the thing to make Linux user friendly. They've done a pretty good job of making the system user friendly as the installation process was quite smooth and testing the OS before you install it through the live CD is a nice feature. You can even install it through a USB disk if you like even.
I will note that the distribution is generally based on the same software base but with a different set of selected software installed. When some something doesn't work, it usually a configuration error or incompatibility of some software working with other software. Ubuntu it self isn't entirely to blame if the base software is buggy (the solution, however is a better selection with more stable software). Anyways, let's get started.
A little on hardware
Hardware support is fairly good, for generic pieces of hardware. You won't have problems with the video card which is usually the only piece of hardware that people install on their own. But support for other pieces of hardware is sometimes sketchy (everything else is OK though)
For example, I installed a new TV capture card designed to work on the PCI-e bus but found out after in installing the thing that there weren't any drivers that supported it. And no, it isn't as simple as looking up the part on the internet to see if the thing is supported. I was basically using commands to ID the chips the capture card used to see if there was any support for the thing. It turns out that there isn't for the time being and I would have been better off buying a card that ran on the standard PCI bus.
For "exotic" hardware sometimes things don't work, but it is a work in progress.
On Open Office, the MS office replacement
I am a heavy excel user. I do lots of calculations and usually deal with lots of data. One thing I've noticed about Calc for Open Office is that it is slow. I hate slow software. Interacting with the spreadsheet can start getting jerky when a data set is large and you are flying through the data. It is disorientating, but still usable. The spreadsheet experience on MS office is more pleasant. The Office Office word processor isn't bad, but I don't generally use word processors that much now a these days -- it's mainly simple text editors I use for programming
Sound has some bitchy quirks
If sound doesn't work properly, then it can be a show stopper. Sound didn't work perfectly me right out of the gate when I installed Ubuntu. Sure I could play music but from time to time the music would skip. I used to have skipping mp3s on a 90 MHz computer about 10 years ago, mp3s were just catching on at that time and it was acceptable. This is 10 years later and I am on a 1.6 GHz dual CPU computer having skipping sound out of the box isn't going to be acceptable for people that didn't have problems on a windows platform.
I eventually got the problem fixed after searching on the internet to install some patches and then do some tweaking. The problems seem to be different from computer to computer and not all of them always worked. The whole sound problem is through a sound server system (which in theory is nice, but still need more work in practice) called PulseAudio. For many people pulseaudio is the bane of their sound experience because sometimes it works properly and other times it doesn't.
Pulseaudio is a software layer that handles sound processing and mixing, which some of the older Linux sound drivers were not able to handle. Before you could only have one piece of software using the sound card at a time then software started to get developed to enable mixing.
There is a long story about this here. Read it if you have time, but it explains the development of sound for linux... and sort of why we have problems with sound from time to time.
Slow hard drive transfers (intermittent, but recently fixed)
There are times when I had to move large amounts of data around on the computer that would drive me nuts. Considering that I had bought new hard drives and wanted to redistribute my data, sometimes the transfer rates would be in the order of just a few 4~8 MB/sec. Slow compared to what you should be getting, which is in the 70~80 MB/sec range which you should be getting. The problem turned out to be a problem with the x64 version of ubuntu for AMD CPUs. I eventually downgraded to a 32bit version to get more relyable transfer rates. The 32 bit version, is also more stable than the 64 bit version (flash works properly and doesn't crash as much).
There were people out there that said that the 64 bit version of Ubuntu was stable. It wasn't good enough for me, and the 32 bit version is more mature. Had to learn it the hard way.
So you have a few problems, here's a shovel and dig
When it comes to dealing with software problems with Ubuntu your best resource is the Ubuntu forums, where many people ask questions and post about their problems. From my personal experience, searching through the forum is a pain in the ass. The search isn't good enough and sometimes the solutions I've found were for older versions which may not apply to the version I am using. This needs fixing.
There are people out there that are nice enought to post a link to a main article posted somewhere which my search didn't hit with solution for some strange reason. But still, I consider myself a competent searcher and I shouldn't have to go through a maze of comments to find what I am looking for.
Problems that many people face should be put somewhere more proiminent where people can find them easier. I've killed countless hours searching for a solution to some problem. It shouldn't be a needle in a haystack problem.
Free software is decent
Ubuntu is based on the Debian distribution, which uses a software repository system. Basically people that make software in their free time upload it to the repository and you can search the repository for something that you might need. There is a whole slew of stuff uploaded there, from video, image, sound editing, office applications, games (most amature, but some polished ones out there) and more. I am somewhat fond of the software repository because many of the programs that I would usually have to go out and buy, is there and available for free, legally.
Compared with Xandros and Windows?
I used Xandros for my first EEE-PC and I had a very enjoyable experience with that platform. The software on the computer was stable and I didn't have many bugs to deal with. I never really even have to trouble shoot the software on the system even once which I was pretty happy about.
Software should just work and perform well. I understand that making software and getting all the bugs out is a pain but polish is important. I don't have time to deal with problems. In my experience so far, there are distributions that exist out there where I have never had to debug and I may want to switch over in the future.
In general, the experience in Ubuntu is pretty decent and there are things in the Linux world that would put Windows to shame. The boot time for one is pretty quick. I can have the system up and running in about 30 seconds and I mean responsive. None of this, "let's get the log in screen quickly, but I am still loading" which we see in Windows... after logging in, I still can't use the computer for about 30 more seconds!
Conclusion
I took a leap into the Linux world, it isn't bad and there is some pretty nice cutting edge stuff out here. And if you like desktop eye candy (Compiz Fusion), some of the Linux features can blow the top of windows. See video here. This video is more than 2 years old and there are newer videos out there but I didn't care for the music to them.
Is it useful? Well, not really but it's cool. MS eventually copied some of it's features to Vista. They didn't do too good of a job of it and you got the hog which is known as Vista. Compiz fusion is to desktops as are boobs to women -- they're just sexy. But anyways...
So there you have it. I'm content with Ubuntu for now, but with some of the annoying experiences, I may trade up to something better something comes my way. The 9.10 version will be released at the end of this month and I'll be upgrading. If I get too annoyed, I'll go find another distro to try. But for now, I'm not going back to the world of windows.
Sunday, October 04, 2009
Back from the country side
Back from the country side in Japan. it was a long weekend the last week and took the chance to head out to Nagano for 5 days. It was great. Photos will be up later on!
In other news, the company dorm is having the shared connection shut down and everyone will be transitioning over to and ISP of their choice. Looks like the building is wired up with a shared optical connection. Going to be spending about $48/month for internet with gigabit speed. We'll see how this thing stacks up, going to be looking forward to it though, the old shared connection that I used to be on was not the fastest thing in the world, but sufficient enough for me to do the basic internet-y stuff, downloads, online videos, music and webpages.
In other news, the company dorm is having the shared connection shut down and everyone will be transitioning over to and ISP of their choice. Looks like the building is wired up with a shared optical connection. Going to be spending about $48/month for internet with gigabit speed. We'll see how this thing stacks up, going to be looking forward to it though, the old shared connection that I used to be on was not the fastest thing in the world, but sufficient enough for me to do the basic internet-y stuff, downloads, online videos, music and webpages.
Saturday, September 26, 2009
Stopping and Thinking
In a rare coincidence, it seems that a bunch of Japanese holidays managed to line up this month resulting in having 3 week days off. I opted to take an additional 2 days off to take the week off for an entire 9 days.
I've been away from work for about 8 days so far and it's been great to get away from everything for a while.
I'll have pictures later on, but I opted to head out to the Japanese country side in Nagano to spent 5 days to attend a fire festival and go hiking through a mountain range known as the Japanese Alps. It was also nice to get away from the internet and my computer too, as it some how ends up being a significant time sink, which allowed me to do a whole lot of activities and meet people that I wouldn't usually have the opportunity to.
I'v also realized that being away from the computer for a while has been a good thing, which has allowed me to use some of the down time to just do some thinking that I usually wouldn't do, which has left me a little rusty in the cognative and reflection department. Also, I haven't been able to put perspective into what has been going on in life recently as it's rather easy to get stuck into a repetitive grind. And when that happens, sometimes a lot of things going on around loses a lot of meaning... and it also can get quite disorientating, especially when it comes to making decisions.
This has been kind of tough these last month with the long hours and other things going on with the personal life, for which for the time being I am going to leave the details out. But I have some tough but necessary things to do for which I haven't been seeing in a positive light, which also makes it tougher. It's important to find the positive things and focus on them... and keep going, because if you don't, you'll end up in a situation/place that you don't want to be.
I'll admit that I am being a little vague right now, because it doesn't seem right to say everything at the moment, though I would much rather be entirely open. I need to put all the bad things that happened this year and a few recent things behind me and move on.
I've been away from work for about 8 days so far and it's been great to get away from everything for a while.
I'll have pictures later on, but I opted to head out to the Japanese country side in Nagano to spent 5 days to attend a fire festival and go hiking through a mountain range known as the Japanese Alps. It was also nice to get away from the internet and my computer too, as it some how ends up being a significant time sink, which allowed me to do a whole lot of activities and meet people that I wouldn't usually have the opportunity to.
I'v also realized that being away from the computer for a while has been a good thing, which has allowed me to use some of the down time to just do some thinking that I usually wouldn't do, which has left me a little rusty in the cognative and reflection department. Also, I haven't been able to put perspective into what has been going on in life recently as it's rather easy to get stuck into a repetitive grind. And when that happens, sometimes a lot of things going on around loses a lot of meaning... and it also can get quite disorientating, especially when it comes to making decisions.
This has been kind of tough these last month with the long hours and other things going on with the personal life, for which for the time being I am going to leave the details out. But I have some tough but necessary things to do for which I haven't been seeing in a positive light, which also makes it tougher. It's important to find the positive things and focus on them... and keep going, because if you don't, you'll end up in a situation/place that you don't want to be.
I'll admit that I am being a little vague right now, because it doesn't seem right to say everything at the moment, though I would much rather be entirely open. I need to put all the bad things that happened this year and a few recent things behind me and move on.
Monday, September 07, 2009
How long till your first million?
Work is starting to tire me out. The long hours and running multiple projects at the same time does bad things to one's social life, stamina, stress level and concentration. For July and August, I've done 80 hours of over time and this month I'll be trying to scale back to 50 hours. A 8~12 hour work day is not exactly the way I want to be spending the rest of my life.
The trick to living a good life is working smarter, not harder. So, I've started doing some calculations to get a general idea of how long would it take for a person to make their first $1 million dependent on the amount they are able to save per year, both dependent on whether if they just stuck that cash in a bank or earned some interest.
There are probably similar types of graphs like these in financial planning books but I have created one for myself as shown in the image below (click for an enlarged and much clearer version).
The results don't look encouraging, but let's do the math. The above graph plots the amount of money you will have saved dependent on your annual savings rate and depending if you reinvest the money to earn 7% or not. The dotted lines represents a linear savings rate.
I have been collecting expenditure data for my life style and it comes out that I spend approximately $2000/month in living expenses, including taxes. Given this, I will have expenditures at $24,000 year. Suppose now that I want to save $20,000 a year, requiring earnings at approximately $44,000/year.
Without investing, it will take me 50 years to make my first $1 million, or 23 years if I reinvest my entire savings at 7%. I'm going to be pretty old by the time I get that far, considering inflation and everything, $1 million is not going to be the worth the same thing in 23 or 50 years. This is not an acceptable solution, so we are going to have to do something to increase income.
Suppose that we bumped things up a notch and aimed for a $40,000/year savings rate. Making the bad assumption that the tax rate doesn't change, I would have have to earn at least $64,000/year to make this goal. Obviously, the time to make the first $1 million is cut in 1/2 to 25 years if you just stashed in the bank or 15 years if the funds are reinvested at 7%. The numbers are starting to look a little more reasonable.
Now, suppose for a young person that your income is $44,000 and you need to bump it up to $64,000 now to hit that $1 million target in 15 years using the 7% investment plan.
You have 2 choices:
1. work approximately 50% longer or
2. find more productive ways of generating income.
Suppose that I worked an 8 hour work day and took option 1 and extended the work day to 12 hours. Including a 1.5 hours of commute time and about 8 hours of sleep for a total of about 21.5 hours/day being used up. This leaves 3.5 hours for personal time during the weekdays.
That obviously does not seem like a reasonable lifestyle to me. Thus working longer for more money is out, so option 1 is dead, so we consider option 2.
How does one find more productive ways of generating income? How do you go to your boss and say that you want 50% more pay? Under what conditions would they provide you with that cash? The most obvious answer to me would be to improve productivity either by doing more of the same in less time, or doing something completely different to produce more value in less time.
Negotiating with HR or management for salary increases is obviously a thorny issue, but you are going to have to be equipped with the right kind of information to make your point. From my point of view, talking directly in dollars and cents or productivity is very important to winning that salary increase. But also, there are obviously limits on the amount of money your employer is willing to pay an employee. If you really want to make the big bucks, then you are going to have to go at it alone.
I now have some real world experience in me to finally appreciate these numbers, I only wish that people would have found ways of understanding the magnitude of long term planning in their early 20s. Imagine if you were 35 and you made your first million.
The impact is huge.
So you want to gun for your first $1 million? I'll give you a chart for how much and how long you need to save to achieve it.
I will admit that the calculations done here are crude and requires refinement, but the basic analysis of the $1 million problem should give everyone a good idea of what exactly you're up against.
Attaining this goal is a very tough challenge, hard enough that it isn't easy to do alone. For all you young people out there, if this is a worthy goal for you to attain, look to your peers and find ways to help, work together and educate yourselves. Because it's going to be now or never, and the sooner the dialogue starts, the better.
The trick to living a good life is working smarter, not harder. So, I've started doing some calculations to get a general idea of how long would it take for a person to make their first $1 million dependent on the amount they are able to save per year, both dependent on whether if they just stuck that cash in a bank or earned some interest.
There are probably similar types of graphs like these in financial planning books but I have created one for myself as shown in the image below (click for an enlarged and much clearer version).
The results don't look encouraging, but let's do the math. The above graph plots the amount of money you will have saved dependent on your annual savings rate and depending if you reinvest the money to earn 7% or not. The dotted lines represents a linear savings rate.
I have been collecting expenditure data for my life style and it comes out that I spend approximately $2000/month in living expenses, including taxes. Given this, I will have expenditures at $24,000 year. Suppose now that I want to save $20,000 a year, requiring earnings at approximately $44,000/year.
Without investing, it will take me 50 years to make my first $1 million, or 23 years if I reinvest my entire savings at 7%. I'm going to be pretty old by the time I get that far, considering inflation and everything, $1 million is not going to be the worth the same thing in 23 or 50 years. This is not an acceptable solution, so we are going to have to do something to increase income.
Suppose that we bumped things up a notch and aimed for a $40,000/year savings rate. Making the bad assumption that the tax rate doesn't change, I would have have to earn at least $64,000/year to make this goal. Obviously, the time to make the first $1 million is cut in 1/2 to 25 years if you just stashed in the bank or 15 years if the funds are reinvested at 7%. The numbers are starting to look a little more reasonable.
Now, suppose for a young person that your income is $44,000 and you need to bump it up to $64,000 now to hit that $1 million target in 15 years using the 7% investment plan.
You have 2 choices:
1. work approximately 50% longer or
2. find more productive ways of generating income.
Suppose that I worked an 8 hour work day and took option 1 and extended the work day to 12 hours. Including a 1.5 hours of commute time and about 8 hours of sleep for a total of about 21.5 hours/day being used up. This leaves 3.5 hours for personal time during the weekdays.
That obviously does not seem like a reasonable lifestyle to me. Thus working longer for more money is out, so option 1 is dead, so we consider option 2.
How does one find more productive ways of generating income? How do you go to your boss and say that you want 50% more pay? Under what conditions would they provide you with that cash? The most obvious answer to me would be to improve productivity either by doing more of the same in less time, or doing something completely different to produce more value in less time.
Negotiating with HR or management for salary increases is obviously a thorny issue, but you are going to have to be equipped with the right kind of information to make your point. From my point of view, talking directly in dollars and cents or productivity is very important to winning that salary increase. But also, there are obviously limits on the amount of money your employer is willing to pay an employee. If you really want to make the big bucks, then you are going to have to go at it alone.
I now have some real world experience in me to finally appreciate these numbers, I only wish that people would have found ways of understanding the magnitude of long term planning in their early 20s. Imagine if you were 35 and you made your first million.
The impact is huge.
So you want to gun for your first $1 million? I'll give you a chart for how much and how long you need to save to achieve it.
I will admit that the calculations done here are crude and requires refinement, but the basic analysis of the $1 million problem should give everyone a good idea of what exactly you're up against.
Attaining this goal is a very tough challenge, hard enough that it isn't easy to do alone. For all you young people out there, if this is a worthy goal for you to attain, look to your peers and find ways to help, work together and educate yourselves. Because it's going to be now or never, and the sooner the dialogue starts, the better.
Friday, September 04, 2009
What I have learned while working
What I've learned while working:
I work at my own pace
I don't like repitious work, and will usually dream at finding a way
to automate it
I am good at automating data analysis
I enjoy putting machines together that reduces my work load
I attend about 10 hours of meetings every week
I also don't care for most of the meetings
I don't generally like discussions with too many "what if's"
I also don't like discussions when everyone is shooting off the hip
I am generally slow when it comes to e-mail
I'll get back to people faster if it is important
My work related e-mails (when written in Japanese) tend to be short
I am far more motivated to work when I see an immediate goal (and
somewhat tangible reward)
I make mistakes (lots of them)
I am really forgetful
I tend to think about other things while doing boring work
I have a terrible habit of forgetting everything I've thought about
after getting home
I have not seen many young people contribute or have the opportunity
to contribute radically new ideas / projects
Observations:
Mistakes are a waste of time
If you are credible, people will generally take what you say at face value
Giving good presentations at meetings is 50% of what is required to succeed
The other 50% is doing a good job
The best managers have excellent memories and are very detailed
The best managers are good at identifying the important issues quickly
The worst ones (even though they are nice) hold too many meetings and
progress tends to be slow
Managers generally like definitave answers
If you are good at your job, managers tend to be friendlier
Being 2x more efficient than everyone else will not result in 2x more pay
Given the option to take a chance vs going the safe route, more often
the safe route is chosen
Getting something new approved requires a lot of testing... even for
small changes
Problems can occur even for small changes
Young people are often not in a position of high impact
When mistakes occur, counter measures are usually often discussed
Most counter measures usually slow work down to prevent mistakes
Having too many counter measures is a pain in the ass
A few things about Japan:
Business level customer service in Japan is amazingly good
If you really need something done, they can usually work something out
Tuesday, August 25, 2009
Resting the hands for now
It is a lull in writing on this blog for reasons I don't know at the moment. I probably am just a little tired and finding that I have less time to self reflect and write. There have been a lot of things I have been thinking about but usually end up forgetting about them, that or I've just been too lazy to write.
I've found that I've become much less motivated to write. The reasons why are probably numerous. For a reason, I have started keeping more to myself as of late, meaning that I do much less communication and at the same time, I realize, I have also have started to lose my communication skills in tandem.
There aren't a whole lot of people I can communicate at the same level that I think at, with some of the language barrier here. There are still many cultural "in" things (like old TV shows or want not) that I don't get either. From time to time, I find myself the odd man out and have gotten used to it, so I usually don't mind finding my own ways of going about and enjoying myself. Usually, just walks or heading out to new places I've never been to on my own.
Anyways, when it seems I am ready to come back out to the world again, I will make my return. For a person that has usually seen myself as an extrovert, I am also finding plenty of peace spending time on my own.
I've found that I've become much less motivated to write. The reasons why are probably numerous. For a reason, I have started keeping more to myself as of late, meaning that I do much less communication and at the same time, I realize, I have also have started to lose my communication skills in tandem.
There aren't a whole lot of people I can communicate at the same level that I think at, with some of the language barrier here. There are still many cultural "in" things (like old TV shows or want not) that I don't get either. From time to time, I find myself the odd man out and have gotten used to it, so I usually don't mind finding my own ways of going about and enjoying myself. Usually, just walks or heading out to new places I've never been to on my own.
Anyways, when it seems I am ready to come back out to the world again, I will make my return. For a person that has usually seen myself as an extrovert, I am also finding plenty of peace spending time on my own.
Subscribe to:
Posts (Atom)