Anthony’s Blog

I’ve been a fan of Wolfram’s A New Kind of Science when I first heard about it maybe 5 years ago.  The book was a very interesting read but I didn’t dive too much deeper into the material at the time.  CA (cellular automata) were interesting from the perspective of my CS background, and I still find it fascinating that complex systems such as fluid flow can be modeled with a set of simple equations rather then beast that are the Navier-Stokes equations.  But if I was a physics major I probably would have played with Mathematica substancially more and studied the concepts further, rather then let them sit in the back of my mind as mere curiosity.  Regardless, I kept an ear open for any more projects Steven was working on and when I first saw an glimpse of Wolfram|Alpha, I was seriously impressed.  (overview video)

Since then I’ve been patiently waiting for the public launch, and last night I spent watching the live webcast and finally playing around with the engine.  It is still very much in a beta stage as it can only understand certain branches of knowledge.  But for what it can do, wow.  I’m extremely interested to learn how Wolfram exactly accomlished all this, I understand it uses Mathematica as a backend but just the idea of expressing that depth and breath of data in a computing language is fascinating.  There were a few clips of the engineers talking about the infrastructure.  Hardware geeks would get their fill at the supercomputer they build to run this thing (44th largest @ 10,000 cores using Dell quad Xeon’s and nearly an exabyte of storage).  Oh, and they’ve opened up an API for developers!

There are lots of example queries to browse through, but here are some simple ones:

Weather on a particular date – http://www.wolframalpha.com/input/?i=weather+november+5+1955

…no thunderstorms predicted that night at 45 F and overcast (uses your current location).

The natural-language parser is fairly flexible.  You can enter queries like “weather day obama was born”.  It’s far from perfect and chokes on more complicated strings but useful nonetheless.

Playing around with the knowledge engine for a few minutes, I’ve learned that:

• A 5 earth mass body orbiting a 10 solar mass star with a semi-major axis of 2.5 AU has a period of 1.251 years.
• A 50 megaton explosion (TNT) is:
  • 1.2 times the total energy that hits earth every second from the sun
  • 1.0 times the energy released the Krakatoa eruption and the amount of energy
  • Has the same energy as a relativistic mass of 2.3 kg
• Hurricane Andrew lasted 4 days longer then Katrina, but had the same maximum wind speed of 150 mph (on dates 5 calendar days apart)

You can also get nice visual representations of chords.  Or checkout the blackbody spectrum at the temperature of the surface of the sun.

Go give it a shot!  You can also download W|A toolbars, firefox search engine add-ons, gadgets, and more.

I couldn’t help myself anymore.  Newegg had 1 TB green drives on sale…  again, and my old ~1 TB storage array was nearly full.  Since my random computer parts are scattered about, I grabbed the only extra working machine I could find and threw the 4 drives into it.  Unfortunately for me the machine was an old Athlon 64 3200+ so the RAID-5 syncing took some time (10+ hours, it was maxing out CPU at ~25MB/s).

Now came the process of migrating the data over from my file server to the new array.  I didn’t want to fiddle with NFS or anything of that nature since I was booting off a Jaunty live CD.  SSH was certainly possible but then there was the overhead.  Rsync was another solution.  But then I recalled a extremely fast way with tar & netcat.  Combine that with pipeviewer and you’ll get a fast transfer complete with verbose information.

It’s very simple.  With two computers, source and dest, you simply run the following:

On source (with IP 192.168.0.10):

tar -cf - /path | pv | nc -l -p 8888 -q 5

This will tar up /path and pipe it to netcat, which is listening on port 8888 for an incoming connection.

On dest:

nc 192.168.0.10 | pv | tar -xf -

Connect to source and pipe the output to tar for extraction.

Credit to Peteris’ wonderful blog entry on pv.

Learning.  A subject of much interest, for those who respect it’s power.  Something that can absorb you completely and spit you back out nearly a new person.  I’ve always loved the process of learning and strived to prioritize it above all things but have never put it so wonderfully as my friend Matt over at Standalone Sysadmin.  A brief quote:

If you’re unfamiliar with the term “autodidact”, you’re not alone. An autodidact is an individual who takes the initiative to teach themselves, rather than go through the formal process of education and studying under a professor. Autodidactism, as it is known, has a long history and includes such luminaries as Socrates, Benjamin Franklin, and Thomas Edison. Even Samuel Clemens once famously wrote as Mark Twain, “I have never let my schooling interfere with my education”. Indeed.

I don’t believe autodidact sounds familiar, but definitely something I’m familiar with.  The way I see it, it’s the only way to truly know a subject.  Maybe you will catch some inspiraction reading the rest of Matt’s posting.