Mesos, Yet Another Cloud OS?
YARN stands for Yet Another Resource Negotiator. According to Hortonworks,
it is "the architectural center of Hadoop". YARN is the stack layer that
allows multiple processing engines, with varying workloads (streaming, SQL,
batch, machine learning etc.) to run on top of the Hadoop file system, HDFS.
Before YARN there was another resource negotiator, Mesos
(Hence the "yet another" in YARN)
Mesos was originally documented in a research paper, followed by an Apache
project, and now commercialized as Mesosphere - who are building out an
ecosystem around Mesos.
Is Mesos yet another cloud OS?
In fairness to Mesosphere, their marketing doesn't stray into the hyperbole
of calling Mesos a Cloud OS (maybe a data center OS or a distributed
systems OS). This makes sense because it would probably confuse people.
However, they do talk about running yo... (more)
How to Keep CALMS and Release More
DevOps is fundamentally changing.
It is no longer considered a fad by those working with the latest development
tools. Now, DevOps emphasizes people and processes as much as the cool
tools, and there are many different approaches to bringing them together.
If you Google search for "DevOps flow," you will find lots of flow diagrams
and methodologies. While each one highlights different priorities and names,
they all have the same general themes.
Start with people Bring in automation Stay lean Measure everything Share
This strategy is called the CAL... (more)
It takes a lot of will power, in our data obsessed world to say "too much!"
However, there are many ways where too much information is destroying
productivity, and actually causing bad decision making, not good. But it is
hard to avoid the world of opportunities that has been opened in data
collection and analysis. So how do you balance the two? The first step is to
understand there is a big difference between data collection, and it's
utilization. While it seems subtle, the difference is key, and utilization is
where many make mistakes.
Many confuse data collection and data uti... (more)
Three Common Problems Solved With JSON
One of the most common questions we get asked by customers is:
“What’s the best way to log my data?” My answer is always:
"log using JSON format wherever possible.”
The next question we often get asked – (but not as much)…
Yeah JSON, …Hmmm, what is JSON again?
But put simply, this is a way that data can be stored in a structured format,
where each piece of data will usually have an identifier (known as a key) and
a value (which can be in multiple formats). It also can have a nested
Log Analysis Takes Automated Orchestration Further
Log analysis is a simple and cool way to add oversight to your orchestration
While scripting your infrastructure is a powerful tool, using it alone is a
But wait, there is more! You don’t even have to create the scripts
manually; there are tools out there that will scan your base environment, and
make the scripts for you!
Register For DevOps Summit "FREE" (before Friday) ▸ Here
How do you manage the script runs? How do you know which version of which
script was used for which deployment of the infrastr... (more)