Episode 65: The High-level WTF on "Scheduling"

Published: June 10, 2016, 10 p.m.

b'

SPONSOR

\\n\\n\\n\\n

Show notes

\\n\\n\\n\\n

Father\\u2019s Day

\\n\\n\\n\\n

MesosCon

\\n\\n
    \\n
  • Platform Infrastructure at Twitter: The Past, Present and - Future - Chris Pinkham, VP of Engineering, Twitter
  • \\n
  • Forgot to talk about this, but here are my notes from the MesosCon presentation by Twitter
  • \\n
  • Former Nimbula founder (Oracle acquisition), early AWS founder.
  • \\n
  • Twitter\'s kinda big deal, maybe you\'ve heard of them. Over 1000 services manage Twitter, over 1,000,000 cores.
  • \\n
  • http://twitter.github.io
  • \\n
  • Heron is a newly open-sourced replacement for Storm. Supporting all of our own code isn\'t sustainable, need an open source community.
  • \\n
  • The Ellen Degeneres photo tweet from the 2015 Academy Awards knocked a couple of services over. 25% traffic spike, hit 255k/tweets per second. 2016 Academy Awards had 2x the traffic, no failures.
  • \\n
  • 30,000 node Mesos cluster (probably largest). "We don\'t like being the biggest of anything, we find the edge cases." 130,000,000 containers launched daily.
  • \\n
  • Some of their acquisitions were in public cloud, they don\'t move them in-house. They\'re actually pushing new services out to AWS where they can. Vine, TellApart, Crashlytics, MoPub, BlueFin, etc. Ad-serving is mostly in AWS.\\nUsers: Time Warner, Twitter (30,000 host deployment), Apple Siri.
  • \\n
\\n\\n

What exactly is scheduling?

\\n\\n
    \\n
  • BMC CONTROL-M
  • \\n
  • Coté gets Matt to "checks out" his crudes understanding. (Spoiler: Checks out.)
  • \\n
\\n\\n

Serverless, what\\u2019s the deal?

\\n\\n\\n\\n

Mid-roll

\\n\\n\\n\\n

BONUS LINKS!

\\n\\n

Not covered in show:

\\n\\n

Somebody\\u2019s using Kubernetes

\\n\\n
    \\n
  • Hear the tale!
  • \\n
  • Concur & Barkly Protects
  • \\n
  • Both shops did customizations to the codebase (AWS AZ & ELB support, Prometheus)
  • \\n
\\n\\n

AWS & Australia News

\\n\\n\\n\\n

Cot\\xe9\\u2019s revamped Pivotal Conversations Podcast

\\n\\n\\n\\n

Typosquatting Package Managers

\\n\\n
    \\n
  • Seriously messed up.
  • \\n
  • \\u201cIn the thesis itself, several powerful methods to defend against typo squatting attacks are discussed. Therefore they are not included in this blog post.\\u201d
  • \\n
\\n\\n

A Docker on every HPE Server

\\n\\n
    \\n
  • Running on HPE
  • \\n
  • Reference Architectures!
  • \\n
  • HPE 3PAR and SiteScope plugins!
  • \\n
  • Maybe Brandon can regale us with some history: tales of The Mercury Wars!
  • \\n
  • Also, some ALM stuff. Sadly, I don\\u2019t have access to the IDC reports on this, however, they\\u2019re expecting big things: \\u201cIDC\'s analysis of this market resulted in worldwide agile application life-cycle management software 2014 revenue of $450.3 million, up 30.5% from the 2013 revenue of $345 million. IDC expects very strong growth for agile ALM software for the 2014\\u20132019 time frame, with growth to $1.8 billion by 2019 and a high CAGR of 32%\\u201d
  • \\n
  • erry-one doin\\u2019 it! What\\u2019s up with Chef\\u2019s ALM/CD stuff? Pivotal circle of code vision, with ConcourseCI.
  • \\n
\\n\\n

Recommendations

\\n\\n'