High Performance Computing with Linux

When I was in college, there was a rich kid down the hall who had a computer with 16MB of RAM. Before you scoff, you need to think back to 1993. The standard amount of RAM in a new computer was 2MB, with 4MB being "high-end". Anyway, this kid's computer was amazingly fast because he could create a RAM disk big enough to contain Windows 3.1 completely, so the entire OS ran from RAM. It was the 1993 rich-kid version of an SSD.

Back then, the most intense computation I ever did on a computer was image rendering with POV-Ray. We all assumed the rich kid would blow us out of the water with his awesome computer running completely in RAM—except that he didn't. Although his computer was indeed the most responsive computer I'd ever seen, it didn't have a math coprocessor. My friend with the 386DX2-66 computer with 4MB of RAM could render POV-Ray images faster than anything I'd ever seen. And, that's when I first understood high-performance computing. Granted, HPC has changed through the years, but the concept remains the same—heavy-duty hardware for heavy-duty number-crunching. And, this month, we focus on HPC in the Linux world.

Reuven M. Lerner starts out the issue with Web security. Firewalls and intrusion detection can't protect you from poor coding, so it's important to develop with a security mindset, and Reuven provides some great information to that end. Next, Dave Taylor reminds us of the other side of what's important with programming: having fun. Dave continues his series on Cribbage and shows how complicated it is to program things that seem simple for humans to do in their heads.

Kyle Rankin helps solve a problem that pops up when taking a laptop back and forth from work to home. Plugging in a different external monitor can be frustrating when all of your programs and windows don't line up the same. If you add a monitor with a different aspect ratio, the frustration can be even greater. Kyle shows how he handles the problem on his own laptop.

In my Open-Source Classroom column, I tackle the issue of overly long URLs. Although it's perfectly acceptable to use a free URL shortener, things like Google shutting down Google Reader remind us that if we're depending on a free service, we can't complain when it goes away. I demonstrate a handful of ways to shorten URLs from your own hosted domain.

And finally, let's get to the meat of this issue—namely, HPC stuff. Adam Monsen describes how to use MapReduce with Hadoop on Linux. Grep is an amazing tool, but there are times when you need to trade in the grep Swiss Army knife for a chainsaw. Adam shows how. If you're facing the issue of grepping enough data to turn to MapReduce, perhaps you also should look into data deduplication. Jeramiah Bowling follows Adam's article with a piece on Opendedup. If you find yourself dedicating the majority of your drive space to storing redundant data, you'll want to read Jeramiah's study.

You might also like

Inside the Stunning Deal That Put Apple and IBM on the Same Side  — The Market Oracle
Its huge corporate and government clients -including 80% of the Fortune 500 – pay dearly for IBM's high-performance computing services. IBM counts some 1,000 universities and 2,215 companies as business partners.

Southeast could become an overdeveloped 'megalopolis' in the next half century  — Washington Post
Combining USGS demographic modeling with North Carolina State's High Performance Computing Services and analyzing the data for six years, Terando and his five co-authors estimated that urbanization in the Southeast will increase by up to 190 percent.


Why java execute with high performance?

I think java is object oriented language thats why that execute with high performance.