November 04, 2009

STFW, fix Pipes, and repair Mac disks; voila!

The next time someone asks you a question and you know they haven't bothered to do the obvious, to wit, look it up on Google, send them a link to Let Me Google That For You. For example, if someone were to write to me and ask if there's an archive of Gearhead columns, I might reply with "Try this link: http://tinyurl.com/yfg33ty". Voila!

Anyway, last week I was discussing my trials and tribulations attempting to get a list of numbers randomized (exactly why I wanted to do this is too complex to go into).

[ Discover what's new in business applications with InfoWorld's Technology: Applications newsletter and Killer Apps blog. ]

My solution was to use Yahoo Pipes to grab the random sequence from the service random.org using an HTTP proxy on my own server.

The reason for this labyrinthine methodology was that Pipes, being the good citizen it is, will not access remote content blocked by a robots.txt access control file -- exactly what random.org has. My proxy hasn't got a robots.txt file so when Pipes looks for the robots.txt file it won't see one: Problem solved.

Now here's an interesting thing: When I finally got my pipe working it tested fine. In the development interface I could monitor the RSS feed output and whenever I refreshed the monitor I could see a new sequence being returned. Foolishly I concluded that it was working correctly.

It turns out that Pipes has a caching algorithm that is only used when you request the pipe be run from the Internet; requests made from within the Yahoo Pipes site are always honored. It took me a goodly time to figure this out because, of course, I assumed that the problem lay with everything other than Yahoo Pipes.

Thus, should you externally request the output of a pipe more than once during an unspecified and undocumented time period set by Yahoo, only the result of the first request is returned. There have been quite a few support questions about this raised in both the Pipes forum and other places, but apparently Yahoo doesn't care to explain what's going on.

For all of you (countless thousands I suspect) struggling with this issue, there's a simple solution: When you define the arguments for the pipe's URL, add another argument that the pipe will do nothing with.

For example, let’s name this additional argument "fudge". When you call the pipe, just make the value of this additional argument something such as the time; thus: "fudge=10:33:45".

The format of the value doesn't matter as long you change it for each request. Now, when Yahoo Pipes gets a request for your pipe it will always assume that it is a new request and therefore run the pipe rather than pull the previous results from cache. Voila encore!

Before I sign off I wanted to get back to an issue I touched on in Backspin a few weeks ago … tribulations with Apple's iDVD and my Mac G4. It appears that iDVD had some kind of problem with my video content. I discovered this by copying my iDVD project to a friend's Mac and then trying to burn the DVD on his machine. I got exactly the same failure with exactly the same lack of any useful information.

Close

On Twitter now

Applications

Powered by Twitter

On Twitter now

White Paper

D2D Virtual Tape Library Replication Primer

This whitepaper explains the terminology and concepts behind Data Replication technologies and establishes some sizing rules through worked examples. Learn the new paradigm in disaster tolerance—protect data anywhere.

Download now »

White Paper

An Alternative to Virtualization for Datacenter Cost Savings

Server virtualization is a popular option for dealing with mounting datacenter costs. Another equally promising approach is the use of an Application Delivery Controller. Citrix NetScaler provides a low-cost way for organizations to reduce their server count and accrue cost savings from a reduction in space, cooling, power and personnel.

Download now »

White Paper

Why Your Firewall, VPN, and IEEE 802.11i Aren't Enough to Protect Your Network

The emergence of WLANs has created a new breed of security threats to enterprise networks.

Included in HP ProCurve WLAN solutions is security technology that alleviates threats from WLANs through:
* Monitoring wireless activity inside and out of the enterprise
* Classifying WLAN transmissions into harmful and harmless
* Preventing transmissions that pose a security threat to the enterprise network
* Locating participating devices for physical remediation

Download now »

White Paper

Bringing the Edge to the Data Center

Effectively address data protection challenges, implementing solutions that help store and protect business–critical data while cutting costs and improving efficiency and reliability.

Download now »

Sign up to receive Applications Resource Alerts

Subscribe to the Applications Newsletter

Stay informed of the latest news and technologies around application, project and performance management.

White paper

Turn Your IT Department into a Lean Machine

Like any valuable resource, IT is a terrible thing to waste. But by applying the same lean techniques that have been used to streamline manufacturing processes, IT departments can reduce costs, improve performance and better manage resources.

Download now! »

Podcast

Economy Makes Automation a Must-Have Tech for 2009

Stephen Elliot, vice president of strategy for CA's Infrastructure Management and Data Center Automation business unit, explains why difficult economic times drive the need for simplified management capabilities and advanced automation tools.

Listen now! »

White paper

What You Need to Know About Virtual Infrastructure Management - Now

According to a recent study CA conducted with 300 CIOs and top IT executives, 64 percent of respondents say they've already invested in virtualization, and the other 36 percent reported that they plan to invest in virtualization.

Download now! »

Webcast

Leveraging Virtualization and Process Automation

In this video learn about process automation in a virtualized world. How CA and VMware are enabling enterprise datacenter automation.

View now! »
©1994-2009 Infoworld, Inc.