By replacing independent, fragmented databases with a distributed system, banks can reduce data reconciliation costs while also improving data quality and ensuring data security.
Source: Blockchain Tech Could Save Banks $12 Billion A Year
It has become increasingly obvious in recent months that blockchain will be key to the future of the banking industry, with the majority of banks expected to adopt the technology within the next three years.
The problem of reliable distributed storage is arguably even more historically challenging than distributed consensus. In the algorithms required to implement distributed storage correctly, mistakes can have serious consequences. Data sets in distributed storage systems are often extremely large, and storage errors may propagate alarmingly while remaining difficult to detect. The burgeoning size of this data is also changing the way we create backups, archives, and other fail-safe measures to protect agains
Source: Presenting Torus: A modern distributed storage system by CoreOS
IPFS is still in the alpha stages of development, so we’re calling this an experiment for now. It hasn’t replaced our existing site storage (yet). Like with any complex new technology, there’s a lot of improvements to make. But IPFS isn’t vaporware, it works right now. You can try it out on your own computer, and already can use it to help us serve and persist Neocities sites.
Source: HTTP is obsolete. It’s time for the distributed, permanent web
You’ll learn how data is replicated within a cluster, how failover occurs, and the evolution of how his team decided to split data across a cluster of machines. Paul also touches on distributed consensus with Raft, replication fault tolerance with a write ahead log, and how we schedule frequent tasks to run in a reliable way across a cluster.
via The Distributed Database Internals of InfluxDB – open source software.
Borg is a way of efficiently parceling work across Google’s vast fleet of computer servers, and according to Wilkes, the system is so effective, it has probably saved Google the cost of building an extra data center. Yes, an entire data center. That may seem like something from another world — and in a way, it is — but the new-age hardware and software that Google builds to run its enormous online empire usually trickles down to the rest of the web. And Borg is no exception.
via Return of the Borg: How Twitter Rebuilt Google’s Secret Weapon | Wired Enterprise | Wired.com.
At Twitter, a small team of engineers has built a similar system using a software platform originally developed by researchers at the University of California at Berkeley. Known as Mesos, this software platform is open source — meaning it’s freely available to anyone — and it’s gradually spreading to other operations as well.
Abstract While playing around with the Nmap Scripting Engine (NSE) we discovered an amazing number of open embedded devices on the Internet. Many of them are based on Linux and allow login to standard BusyBox with empty or default credentials. We used these devices to build a distributed port scanner to scan all IPv4 addresses. These scans include service probes for the most common ports, ICMP ping, reverse DNS and SYN scans. We analyzed some of the data to get an estimation of the IP address usage.
All data gathered during our research is released into the public domain for further study.
via Internet Census 2012.
They’re also launching a new distributed database called Plazma, which offers significant improvements over HDFS (Hadoop Distributed Files System). Plazma is significantly better than HDFS precisely because it’s more efficient and is able to compile and parse data at a much faster rate.
via Treasure Data Projects 500 Percent Growth This Year, Launches New “Plazma” Distributed Database | TechCrunch.
A single misclick.
No, really: A Titan pilot beneath the Cluster banner was attempting a “bridge”—using a ship to act as an artificial warp corridor for other ships—to Asakai VI when he accidentally warped himself straight into a very surprised Pandemic Legion fleet. The pilot, named Dabigredboat, immediately came under heavy attack as the Legion pounced on the extremely valuable ship.
via EVE Online’s Battle of Asakai: who was involved, the stakes, and the aftermath | News | PC Gamer.
I sometimes find the drama in these MMORPG fascinating and Eve Online usually has the best stories. The cynical side of me suspects this might have been staged as a marketing promotion. I hear nothing but good things about Eve Online however.
Netflix has released Hystrix, a library designed for managing interactions between distributed systems, complete with “fallback” options for when those systems inevitably fail.
The code for Hystrix—which Netflix tested on its own systems—can be downloaded at Github, with documentation available here, in addition a getting-started guide and operations examples, among others.
via Netflix Gives Data Center Tools to Fail.
Netflix will also release the real-time dashboard it uses for monitoring Hystrix. That dashboard relies on a traffic-light system to display service dependencies for the last ten seconds, with colors measuring latency and the size of the circles showing traffic.
Some particular user going by the name ‘Jadd’ has posted a video claiming to have nuked entire cities. There is no official news of Blizzard as yet about the reason behind the dead cities. We have got the videos [below].
[Update]: There is a lot of chatter on Ycombinator and WOWInsider about this story.
via Entire Cities in World of Warcraft Dead, Hack Suspected – ParityNews.com: …Because Technology Matters.