Podcasts Technology Software Defined Talk Episode 65: The High-level WTF on "Scheduling"

Episode 65: The High-level WTF on "Scheduling"

Published: June 10, 2016, 10 p.m.

SPONSOR\n\n

\n\nShow notes\n\n\n\nFather\u2019s Day\n\n\n\nMesosCon\n\n
    \n
  • Platform Infrastructure at Twitter: The Past, Present and - Future - Chris Pinkham, VP of Engineering, Twitter
    • \n
  • Forgot to talk about this, but here are my notes from the MesosCon presentation by Twitter
    • \n
  • Former Nimbula founder (Oracle acquisition), early AWS founder.
    • \n
  • Twitter's kinda big deal, maybe you've heard of them. Over 1000 services manage Twitter, over 1,000,000 cores.
    • \n
  • http://twitter.github.io
    • \n
  • Heron is a newly open-sourced replacement for Storm. Supporting all of our own code isn't sustainable, need an open source community.
    • \n
  • The Ellen Degeneres photo tweet from the 2015 Academy Awards knocked a couple of services over. 25% traffic spike, hit 255k/tweets per second. 2016 Academy Awards had 2x the traffic, no failures.
    • \n
  • 30,000 node Mesos cluster (probably largest). "We don't like being the biggest of anything, we find the edge cases." 130,000,000 containers launched daily.
    • \n
  • Some of their acquisitions were in public cloud, they don't move them in-house. They're actually pushing new services out to AWS where they can. Vine, TellApart, Crashlytics, MoPub, BlueFin, etc. Ad-serving is mostly in AWS.\nUsers: Time Warner, Twitter (30,000 host deployment), Apple Siri.
    • \n
\n\nWhat exactly is scheduling?\n\n
    \n
  • BMC CONTROL-M
    • \n
  • Coté gets Matt to "checks out" his crudes understanding. (Spoiler: Checks out.)
    • \n
\n\nServerless, what\u2019s the deal?\n\n\n\nMid-roll\n\n\n\nBONUS LINKS!\n\n

Not covered in show:

\n\nSomebody\u2019s using Kubernetes\n\n
    \n
  • Hear the tale!
    • \n
  • Concur & Barkly Protects
    • \n
  • Both shops did customizations to the codebase (AWS AZ & ELB support, Prometheus)
    • \n
\n\nAWS & Australia News\n\n\n\nCot\xe9\u2019s revamped Pivotal Conversations Podcast\n\n\n\nTyposquatting Package Managers\n\n
    \n
  • Seriously messed up.
    • \n
  • \u201cIn the thesis itself, several powerful methods to defend against typo squatting attacks are discussed. Therefore they are not included in this blog post.\u201d
    • \n
\n\nA Docker on every HPE Server\n\n
    \n
  • Running on HPE
    • \n
  • Reference Architectures!
    • \n
  • HPE 3PAR and SiteScope plugins!
    • \n
  • Maybe Brandon can regale us with some history: tales of The Mercury Wars!
    • \n
  • Also, some ALM stuff. Sadly, I don\u2019t have access to the IDC reports on this, however, they\u2019re expecting big things: \u201cIDC's analysis of this market resulted in worldwide agile application life-cycle management software 2014 revenue of $450.3 million, up 30.5% from the 2013 revenue of $345 million. IDC expects very strong growth for agile ALM software for the 2014\u20132019 time frame, with growth to $1.8 billion by 2019 and a high CAGR of 32%\u201d
    • \n
  • erry-one doin\u2019 it! What\u2019s up with Chef\u2019s ALM/CD stuff? Pivotal circle of code vision, with ConcourseCI.
    • \n
\n\nRecommendations\n\n