5 Tips for Bulk Data Processing Programming

September 2nd, 2007 I extensively use awk (along with cut and grep) for data processing of log files or for any text processing needs. AWK is an excellent text processing tool / filter and report generator.

April 5th, 2008 TechCrunch got it from a source that Google plans to launch their BigTable, their proprietary internal database which is used for Google Search, as a web service to compete with Amazon SimpleDB Web Service. Bigtable is a distributed storage system for managing structured data that is designed to scale to a very large size: petabytes of data across thousands of commodity servers at Google.

April 20th, 2008 AWK is an extremely versatile and powerful language for processing files and text data. Often you can use awk to perform complex tasks on Unix / Linux / Mac OS command line which would otherwise take a full-fledged programming effort.

April 1st, 2009 I am sure if you are associated with software developments or serious enterprise workships, you must have heard of XP or extreme programming. The core idea of XP is Agile programming that is fast and flexible and Iterative development.

June 26th, 2009 If you are not one of those Twitterati's, someone sort of Guy Kawasaki, you might follow way more people than who are following you. Are you tired of following and wanna unfollow a bulk of those who don't follow you on Twitter? Hope, you've a long list of those un-followers.

November 8th, 2008 Any reasonable (web) application which deals with some subset of web data (rss feeds, web pages, product pricing data etc.), has to use distributed data processing to go anywhere. Unless you have very deep pockets and / or have strong VC funding (which is rarer than a bottle of Mouton Rothschild Pauillac Premier Cru First Growth these days) you will have to opt for consumer grade hardware (instead of big iron which more companies opted during the dotcom era ) and use them in a distributed computing framework like hadoop or GridGain or older (more mature) high throughput computing systems like OpenPBS (ignore the marketing talk to download the free version) or Condor.

December 20th, 2008 Java is a programming language originally developed by Sun Microsystems and released in 1995. But its been more than 10 years from then and the popularity has taken Java to an enviable height.

July 21st, 2007 Normally we need fake id's when we are developing or testing any application with user authentication & entitlement. Fake ids are required to populate the database for testing.

July 17th, 2005 According to Forrester survey data and analysis, Java's 66% penetration is the highest among strategic programming languages for enterprise applications. Visual Basic 6 (VB6) and C/C++ have nearly as much penetration as Java, but VB6 is past mainstream support and C/C++ has a comparatively limited ecosystem.

December 30th, 2007 PayPal provides an API to automate transaction processing. This is great for businesses selling electronic products.

June 6th, 2006 Java continues as the leading programming language according to TIOBE index updated on June 2006. Java is rated at 21.128%, an increase of 2.56% from June, 2005.

July 31st, 2009 'Last Lecture' prof's program to be updatedPITTSBURGH — Carnegie Mellon University will release an updated version of the animation-based software developed by late "last lecture" professor Randy Pausch to teach computer programming. Pausch, a Carnegie Mellon computer science professor and pioneer of virtual reality research, was involved with the Alice software project.

September 27th, 2006 Allen Holub (Author of Compiler Design in C and famous OO Guru) said: "XML is perhaps the worst programming language ever conceived. I’m not talking about XML as a data-description language, which was its original design.

September 29th, 2005 According to TIOBE Programming Community Index Java is the leading programming language again, ahead of C and C++, its nearest rivals. Perl and PHP occupy 4th and 5th positions respectively attesting to the power of scripting languages.

August 10th, 2009 WASHINGTON - Scientists have developed a new operating software for condition monitoring (CM) systems that are used to monitor machines remotely, which can be adapted for use with various types of facility without the need for manual programming. CM systems monitor machines remotely, with sensors mounted on the equipment feeding continuous measurements back to a control box, which records and stores the data, and if an error occurs, the system alerts the operator.