Extra 8: Scalability! But at What COST?

  • GraphX paper
    • lots of cores 128

  • repeated look at each label in the graph
    • flows through

  • ran a single core in Rust and it was fast!

  • with better algorithms! - Even faster

  • scalability fetishised by community

  • at 16 cores it is the same performance at a single core

  • 1, 2 cores
    • very very fast! micro-seconds

  • still high performance on a single laptop!

  • When you are focued - high performance compiled languages, caches, not JVM

  • step 1. get 100x on your computer
  • step 2. then 100x from 100x computers
    • but that's expensive!