mindstorms

NoSQL: Autoscaling, welcome to Google Compute Engine

2014-11-24T18:16:00.001+02:00

Autoscaling, welcome to Google Compute Engine

Autoscaling allows customers to build more cost effective and resilient applications. Using Compute Engine Autoscaling, you can ensure that exactly the right number of Compute Engine instances are available at any given time to handle your application's workload. This saves you money when your application's usage is low, and ensures your application is responsive when utilization is high.

tags:distributed systems,scalability

via NoSQL databases

NoSQL: Aurora for MySQL is coming

2014-11-24T13:15:00.001+02:00

Aurora for MySQL is coming

Mark Callghan takes a look at:

tags:aurora,amazon

via NoSQL databases

NoSQL: Medium uses Neo4j and Go for GoSocial service

2014-11-24T12:15:00.001+02:00

Medium uses Neo4j and Go for GoSocial service

Medium's social graph stored in Neo4j and exposed through a Go service:

tags:neo4j,go,graphdb,graph database

via NoSQL databases

NoSQL: Stripe's Hadoop tools open sourced

2014-11-22T13:15:00.001+02:00

Stripe's Hadoop tools open sourced

Stripe has put on GitHub 4 Hadoop related projects they've developed internally:

tags:hadoop,impala,parquet,mapreduce,bigdata

via NoSQL databases

NoSQL: The states and transitions of a Couchbase node

2014-11-20T18:15:00.001+02:00

The states and transitions of a Couchbase node

The different states and the transitions of a Couchbase node in a diagram:

tags:couchbase,key-value store,document database

via NoSQL databases

NoSQL: Can MapReduce Solve Planning Problems?

2014-11-20T14:15:00.001+02:00

Can MapReduce Solve Planning Problems?

Betteridge's law of headlines .

tags:mapreduce

via NoSQL databases

NoSQL: NoSQL databases, Hadoop, Big Data: Pinned tabs Nov.19th

2014-11-20T11:15:00.001+02:00

NoSQL databases, Hadoop, Big Data: Pinned tabs Nov.19th

01 : Teradata QueryGrid is the technology used to allow querying both Teradata/AsterData and external data stored in Hadoop or Oracle. ★

tags:teradata,marklogic,document database

via NoSQL databases

NoSQL: It Ain’t Easy Making Money in Open Source: Thoughts on the Hortonworks's IPO Filling

2014-11-19T15:15:00.001+02:00

It Ain't Easy Making Money in Open Source: Thoughts on the Hortonworks's IPO Filling

Dave Kellogg's in-depth look at the Hortonworks's filling for IPO, a comparison with RedHat's model, and a definitely interesting hypothesis and conclusion:

tags:hortonworks,hadoop market

via NoSQL databases

NoSQL: Apache CouchDB 2.0 gets clustering support

2014-11-19T14:15:00.003+02:00

Apache CouchDB 2.0 gets clustering support

At ApacheCon Europe 2014, the Apache CouchDB™ project today announced a Developer Preview release of its CouchDB 2.0 document database. The Developer Preview release brings all-new clustering technology to the Open Source NoSQL database, enabling a range of big data capabilities that include being able to store, replicate, sync, and process large amounts of data distributed across individual servers, data centers, and geographical regions in any deployment configuration, including private, hybrid, and multi-cloud.

tags:couchdb,document database

via NoSQL databases

NoSQL: CouchDB's long road to clustering

2014-11-19T14:15:00.001+02:00

CouchDB's long road to clustering

Keyword is partially :

tags:couchdb,cloudant,document database

via NoSQL databases

NoSQL: The data flow and the massive historical Tweet index

2014-11-19T11:15:00.001+02:00

The data flow and the massive historical Tweet index

We rarely have the opportunity to learn about the almost complete architecture and data flow for a massive data indexing solution. Twitter's blog post covers many details of their indexing solution starting with design goals and getting down to technical

tags:full text indexing

via NoSQL databases

NoSQL: What skills is a recruiting company looking for in a data scientist

2014-11-19T09:14:00.001+02:00

What skills is a recruiting company looking for in a data scientist

For the technical part the list goes like this:

tags:data science

via NoSQL databases

NoSQL: Why Couchbase Lite is so strategically important for you?

2014-11-19T08:15:00.001+02:00

Why Couchbase Lite is so strategically important for you?

In an interview with Bob Widerhold 1 , Roberto V. Zicary asks: "why Couchbase Lite is so strategically important?"

tags:couchbase,key-value store,document database

via NoSQL databases

NoSQL: Hortonwork's filling for IPO: The marketing of going public

2014-11-18T13:14:00.001+02:00

Hortonwork's filling for IPO: The marketing of going public

Pretty much the same perspective about Hortonwork's filling for IPO from Yves de Montcheuil ( InfoWorld ):

tags:hortonworks,hadoop market

via NoSQL databases

NoSQL: Hortonworks IPO - Why Now? Or better, who will benefit from the IPO

2014-11-18T12:14:00.001+02:00

Hortonworks IPO - Why Now? Or better, who will benefit from the IPO

Merv Adrian is looking at 3 possible reasons for Hortonworks's filing for IPO by switching the why question to who will benefit from this IPO. As for the why now part, the main question I've also asked myself , this seems to be the general answer:

tags:hortonworks

via NoSQL databases

NoSQL: Design consideration for Kayos messaging and durable queueing

2014-11-17T15:14:00.001+02:00

Design consideration for Kayos messaging and durable queueing

More details about Damien Katz's new message queue project : it has a name, Kayos, and some goals:

tags:kayos

via NoSQL databases

NoSQL: Kafka and Samza: Distributed stream processing in practice

2014-11-17T14:14:00.001+02:00

Kafka and Samza: Distributed stream processing in practice

Fantastic slide deck from Martin Kleppmann. These 2 screenshots below are a good summary of the talk, but I strongly encourage you to go through the 42 slides. Totally worth the time .

tags:kafka,samza

via NoSQL databases

NoSQL: What do you have to say for the skeptics of Hadoop who think that the ecosystem is getting too complex with too many overlapping projects doing almost similar things?

2014-11-15T07:14:00.001+02:00

What do you have to say for the skeptics of Hadoop who think that the ecosystem is getting too complex with too many overlapping projects doing almost similar things?

There is a truth to the point of growing complexity of the entire ecosystem but there is also a misattribution of the complexity that comes with it. Unlike many other unified single-stack architectures that came before, the Hadoop platform is built around individual layers of individual responsibilities. This is the Unix philosophy; each of these layers is built in order to perform one thing and one thing well. This not only helps in delineating responsibilities, but it also helps in a much faster evolution. Remember that several different open developer communities are working on each layer. Sometimes, this does mean there are two or more disjoint sets of developers that work on the same layer, but that's okay – either each of those projects carve out their niche or the single best project simply emerges. In a truly open community, a meritocracy, no single vendor ultimately decides the best approach.

tags:hadoop,mapreduce,bigdata

via NoSQL databases

NoSQL: Can hard drives' failure be predicted?

2014-11-14T21:14:00.001+02:00

Can hard drives' failure be predicted?

Hardware failure is one of the major causes leading to failure of systems and implicitely to the deterioration of the quality of service. Predicting hardward failures would allow taking proactive measures, thus reducing the chances of downtime in the systems.

via NoSQL databases

NoSQL: MongoDB WiredTiger Compression and Performance

2014-11-14T11:14:00.001+02:00

MongoDB WiredTiger Compression and Performance

The soon to be released MongoDB 2.8 gets a new storage engine named WiredTiger . Adam Comerford, a MongoDB Sen. solutions engineer, has run some test to compare the different compression options of the new engine—snappy and zlib.

tags:mongodb,document database

via NoSQL databases

NoSQL: Amazon Aurora in bullet points

2014-11-14T11:13:00.001+02:00

Amazon Aurora in bullet points

The rest of the story can be read in Jeff Barr's post .

tags:aurora,amazon

via NoSQL databases

NoSQL: HowFuckedIsMyDatabase?

2014-11-14T04:13:00.001+02:00

HowFuckedIsMyDatabase?

Howfuckedismydatabase.com . 'nuff said.

tags:fun

via NoSQL databases

NoSQL: Precise design: Use of Formal Methods at Amazon Web Services

2014-11-13T12:13:00.001+02:00

Precise design: Use of Formal Methods at Amazon Web Services

There are various aspects that must be considered when building a distributed system: fault-tolerance, replication, consistency, concurrency, etc. Combining algorithms and solutions to address these requirements increases the complexity of the system. Is there a way to prove, reliably and with a high level of confidence, that the system will behave as needed? Can there be a formal proof that the design of the system satisfies the requirements?

tags:distributed systems

via NoSQL databases

NoSQL: Consistency and coordination

2014-11-13T11:13:00.001+02:00

Consistency and coordination

"Does a system always need coordination to ensure consistency?" Considering the costs of coordination, being able to determine in what conditions consistency can be achieved without coordination would lead to significant performance and/or cost improvements.

tags:distributed systems

via NoSQL databases

NoSQL: 2014 Gartner Hype Cycle

2014-11-13T05:13:00.001+02:00

2014 Gartner Hype Cycle

tags:bigdata,iot

via NoSQL databases