Plot

Conclusion

As you can tell from the chart, after a short burst on the namenode (nk01) the load gets distributed equally over the 4 nodes. In other Spark works like advertised on the box!

And we found out that the yellow cabs in New York city in 2015 clocked 2 billion miles carrying 245 million passengers, spread over 146 million taxi-rides.