Speeding Up Grep Log Queries with GNU Parallel

Posted on by

Enter GNU Parallel, a shell tool designed for executing tasks in parallel using one or more computers. For my purposes I just ran in on a single system, but wanted to take advantage of multiple cores.

Having enough memory on my system, I loaded the entire massive file into memory and pipe it to GNU Parallel along with another file consisting of thousands of different strings I want to search for in the “PATTERNFILE”:

cat BIGFILE | parallel –pipe grep -f PATTERNFILE

via Speeding Up Grep Log Queries with GNU Parallel – The State of Security.

On MetaFilter Being Penalized By Google

Posted on by

The truth is more likely that it’s less to do with his site and more to do with Google seeing a pattern of what it considers to be unnatural linking by the publishers it is contacting. As Haughey guesses, it’s more likely that MetaFilter is “collateral damage,” with the damage being the annoying link removal requests rather than any real distrust of the site. That’s especially since its ranking drop seems to well predate these requests.

But it is worrisome, especially when Haughey writes about how much care apparently goes into trying to ensure all links are relevant:

via On MetaFilter Being Penalized By Google: An Explainer.

Earn respect. That’s your best defense if things go south with Google. It’s also your best offense for doing well in Google

“What is post-PC”?

Posted on by

The market is changing. PCs are lasting longer, and people are finding acceptable utility in replacing casual-use, low-end PCs with smartphones and tablets.

Again, it’s about the total compute time across all of society. The PC is just becoming a smaller chunk of a larger whole, the majority of which will be post-PC devices.

via “What is post-PC”? — The Post-PC FAQ | The Platform.

Google Fiber Blog

Posted on by

Bringing fiber all the way to your home is only one piece of the puzzle. We also partner with content providers (like YouTube, Netflix, and Akamai) to make the rest of your video’s journey shorter and faster. (This doesn’t involve any deals to prioritize their video ‘packets’ over others or otherwise discriminate among Internet traffic — we don’t do that.)

via Google Fiber Blog.

British MoD works on ‘quantum compass’ technology to replace GPS

Posted on by

At their lowest energies, the atoms become the coldest known bodies in the universe. Super-cooled low energy atoms are extremely sensitive to changes in the Earth’s magnetic and gravitational field.

If trapped on a small device, their fluctuations can allow scientists to track their movements from great distances away and their locations pinpointed with extreme precision.

via British MoD works on ‘quantum compass’ technology to replace GPS.

NASA’s Plan to Block Light From Distant Stars to Find ‘Earth 2.0’

Posted on by

The plan calls for a satellite to be sent out several tens of thousands of miles from Earth. The satellite will unfold a huge, flower-shaped metal shade that will literally block the light of some far-out star to the point where a space telescope, which will directly communicate with Starshade, will be able to image whatever planets are orbiting it directly.

via NASA’s Plan to Block Light From Distant Stars to Find ‘Earth 2.0’ | Motherboard.

Wi-Fi networks are wasting a gigabit—but multi-user beamforming will save the day

Posted on by

It’s hard to imagine a single smartphone or tablet needing to receive more than 433Mbps of data. But the fact that MU-MIMO-powered Wi-Fi will be able to serve more users simultaneously could bring huge benefits to large-scale wireless networks, like those in airports, convention centers, and sports stadiums. Real-world throughput will end up being something lower than 433Mbps to each user because of networking overhead and other limitations, but given that a high-definition Netflix stream is just 5Mbps, there isn’t much reason to worry about that yet.

via Wi-Fi networks are wasting a gigabit—but multi-user beamforming will save the day | Ars Technica.

The first 11ac products implemented single-user beamforming, sending one transmission to a single receiver. Multi-user beamforming, coming in the next wave of 11ac products this year and next year, enables MU-MIMO and its simultaneous transmission to multiple devices.

7 open source control-panel

Posted on by

We have collection of more than 1 Million open source products ranging from Enterprise product to small libraries in all platforms. We aggregate information from all open source repositories. Search and find the best for your needs.

via 7 open source control-panel.

This site looks like an interesting resource to find useful open source packages.  Webmin is listed as second in this list of 7 control panels.  I have been using Webmin forever but might try out ISPConfig.  Although something is listed on this site I always download packages from sourceforge.net.

In Letter to Obama, Cisco CEO Complains About NSA Allegations

Posted on by

The letter follows new revelations, including photos, published in a book based on documents leaked by former NSA contractor Edward Snowden alleging that the NSA intercepted equipment from Cisco and other manufacturers and loaded them with surveillance software. The photos, which have not been independently verified, appear to show NSA technicians working with Cisco equipment. Cisco is not said to have cooperated in the NSA’s efforts.

via In Letter to Obama, Cisco CEO Complains About NSA Allegations | Re/code.